Apr 29 14:59:53 devstack cinder-volume[75701]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75701) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 29 14:59:53 devstack cinder-volume[75701]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75701) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 29 14:59:53 devstack cinder-volume[75701]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75701) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 29 14:59:54 devstack cinder-volume[75701]: INFO dbcounter [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] Registered counter for database cinder Apr 29 14:59:54 devstack cinder-volume[75701]: DEBUG oslo_db.sqlalchemy.engines [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75701) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 14:59:54 devstack cinder-volume[75701]: DEBUG dbcounter [-] [75701] Writer thread running {{(pid=75701) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 29 14:59:54 devstack cinder-volume[75701]: INFO cinder.rpc [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 29 14:59:54 devstack cinder-volume[75701]: INFO cinder.rpc [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 29 14:59:54 devstack cinder-volume[75701]: DEBUG oslo_db.sqlalchemy.engines [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75701) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 14:59:54 devstack cinder-volume[75701]: INFO cinder.volume.manager [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] Determined volume DB was empty at startup. Apr 29 14:59:54 devstack cinder-volume[75701]: DEBUG cinder.volume.manager [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75701) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 29 14:59:54 devstack cinder-volume[75701]: INFO cinder.volume.manager [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 29 14:59:54 devstack cinder-volume[75701]: WARNING stevedore.named [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 29 14:59:54 devstack cinder-volume[75701]: WARNING castellan.key_manager [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 29 14:59:54 devstack cinder-volume[75701]: WARNING cinder.keymgr.conf_key_mgr [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG cinder.volume.drivers.lvm [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75701) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_concurrency.processutils [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75701) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_concurrency.processutils [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] CMD "cinder-rtstool verify" returned: 0 in 0.357s {{(pid=75701) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_db.sqlalchemy.engines [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75701) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 14:59:55 devstack cinder-volume[75701]: INFO cinder.rpc [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 29 14:59:55 devstack cinder-volume[75701]: INFO cinder.rpc [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Apr 29 14:59:55 devstack cinder-volume[75701]: WARNING stevedore.named [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 29 14:59:55 devstack cinder-volume[75701]: WARNING castellan.key_manager [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 29 14:59:55 devstack cinder-volume[75701]: INFO cinder.volume.manager [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] Image-volume cache enabled for host devstack@lvmdriver-1. Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_db.sqlalchemy.engines [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75701) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 14:59:55 devstack cinder-volume[75701]: INFO oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] Starting 1 workers Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] Started child 75871 {{(pid=75701) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] Full set of CONF: {{(pid=75701) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] ******************************************************************************** {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] Configuration options gathered from: {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] ================================================================================ {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Apr 29 14:59:55 devstack cinder-volume[75871]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] allow_availability_zone_fallback = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] allow_compression_on_image_upload = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] allowed_direct_url_schemes = [] {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] api_rate_limit = True {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] auth_strategy = keystone {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] az_cache_duration = 3600 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] backend_availability_zone = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] backend_host = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] backend_name = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] backend_stats_polling_interval = 60 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] backup_api_class = cinder.backup.api.API {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] backup_name_template = backup-%s {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] backup_use_same_host = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] backup_use_temp_snapshot = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] chap_password = **** {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] chap_username = {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] cinder_internal_tenant_project_id = 4576d27b7a8e4f74bfed45b5b74588bc {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] cinder_internal_tenant_user_id = 7a0144856f9b4206b9969013745dfd09 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] cloned_volume_same_az = True {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] cluster = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] compression_format = gzip {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] compute_api_class = cinder.compute.nova.API {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] config_dir = [] {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] config_source = [] {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] control_exchange = openstack {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] debug = True {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] default_availability_zone = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] default_group_type = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] default_volume_type = lvmdriver-1 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] disk_geometry = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] driver_client_cert = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] driver_client_cert_key = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] driver_data_namespace = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] driver_ssl_cert_path = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] driver_ssl_cert_verify = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] driver_use_ssl = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] enable_force_upload = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] enable_new_services = True {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] enable_unsupported_driver = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] enabled_backends = ['lvmdriver-1'] {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] enforce_multipath_for_image_xfer = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] filter_function = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] glance_api_insecure = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] glance_api_servers = ['http://192.168.122.236/image'] {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] glance_api_ssl_compression = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] glance_ca_certificates_file = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] glance_catalog_info = image:glance:publicURL {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] glance_certfile = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] glance_keyfile = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] glance_num_retries = 3 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] glance_request_timeout = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] goodness_function = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] graceful_shutdown_timeout = 5 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] group_api_class = cinder.group.api.API {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] host = devstack {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] image_compress_on_upload = True {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] image_conversion_address_space_limit = 1 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] image_conversion_cpu_limit = 60 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] image_conversion_disable = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] image_upload_use_cinder_backend = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] image_upload_use_internal_tenant = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] image_volume_cache_enabled = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] image_volume_cache_max_count = 0 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] image_volume_cache_max_size_gb = 0 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] init_host_max_objects_retrieval = 0 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] instance_format = [instance: %(uuid)s] {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] iscsi_target_flags = {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] iscsi_write_cache = on {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] iser_helper = tgtadm {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] iser_ip_address = 192.168.122.236 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] iser_port = 3260 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] log_color = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] log_config_append = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] log_dir = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] log_file = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] log_options = True {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] log_rotate_interval = 1 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] log_rotate_interval_type = days {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] log_rotation_type = none {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] max_age = 0 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] max_logfile_count = 30 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] max_logfile_size_mb = 200 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] max_over_subscription_ratio = 20.0 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] message_reap_interval = 86400 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] message_ttl = 2592000 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] migration_create_volume_timeout_secs = 300 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack sudo[75875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] monkey_patch = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] monkey_patch_modules = [] {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] my_ip = 192.168.122.236 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] no_snapshot_gb_quota = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack sudo[75875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 14:59:55 devstack cinder-volume[75871]: INFO cinder.volume.manager [None req-5a06be96-3258-4a58-a3b8-1d3b098f2c0d None None] Starting volume driver LVMVolumeDriver (3.0.0) Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] num_iser_scan_tries = 3 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] num_shell_tries = 3 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75871]: DEBUG oslo_concurrency.processutils [None req-5a06be96-3258-4a58-a3b8-1d3b098f2c0d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75871) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] num_volume_device_scan_tries = 3 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] nvmeof_conn_info_version = 1 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] nvmet_ns_id = 10 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] nvmet_port_id = 1 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] osapi_max_limit = 1000 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] osapi_volume_ext_list = [] {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] osapi_volume_listen = 0.0.0.0 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] osapi_volume_listen_port = 8776 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] osapi_volume_use_ssl = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] osapi_volume_workers = 2 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] per_volume_size_limit = -1 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] periodic_fuzzy_delay = 60 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] periodic_interval = 60 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] project_id_regex = [0-9a-f\-]+ {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] public_endpoint = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] publish_errors = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] quota_backup_gigabytes = 1000 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] quota_backups = 10 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] quota_gigabytes = 1000 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] quota_groups = 10 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] quota_snapshots = 10 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] quota_volumes = 10 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] rate_limit_burst = 0 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] rate_limit_except_level = CRITICAL {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] rate_limit_interval = 0 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] reinit_driver_count = 3 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] replication_device = **** {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] report_discard_supported = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] report_interval = 120 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] reservation_clean_interval = 86400 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] reservation_expire = 86400 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] reserved_image_namespaces = [] {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] reserved_percentage = 0 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] rpc_response_timeout = 120 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] run_external_periodic_tasks = True {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] scst_target_driver = iscsi {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] scst_target_iqn_name = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] service_down_time = 720 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] shell_completion = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] snapshot_name_template = snapshot-%s {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] snapshot_same_host = True {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] split_loggers = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] state_path = /opt/stack/data/cinder {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] storage_availability_zone = nova {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] storage_protocol = iSCSI {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] syslog_log_facility = LOG_USER {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] target_helper = lioadm {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] target_ip_address = 192.168.122.236 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] target_port = 3260 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] target_protocol = iscsi {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] target_secondary_ip_addresses = [] {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] trace_flags = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] transfer_api_class = cinder.transfer.api.API {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75871]: DEBUG oslo_concurrency.processutils [None req-5a06be96-3258-4a58-a3b8-1d3b098f2c0d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.038s {{(pid=75871) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] transport_url = **** {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] until_refresh = 0 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] use_chap_auth = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] use_default_quota_class = True {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] use_journal = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] use_json = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:55 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] use_multipath_for_image_xfer = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] use_stderr = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] use_syslog = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] verify_glance_signatures = enabled {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] volume_api_class = cinder.volume.api.API {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] volume_backend_name = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] volume_clear = zero {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] volume_clear_ionice = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] volume_clear_size = 0 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] volume_copy_bps_limit = 0 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] volume_dd_blocksize = 1M {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] volume_name_template = volume-%s {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:56 devstack cinder-volume[75871]: DEBUG oslo_concurrency.processutils [None req-5a06be96-3258-4a58-a3b8-1d3b098f2c0d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75871) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] volume_service_inithost_offload = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] volume_usage_audit_period = month {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] zoning_mode = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] oslo_concurrency.disable_process_locking = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] keystone_authtoken.admin_password = **** {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] keystone_authtoken.admin_tenant_name = admin {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] keystone_authtoken.admin_token = **** {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] keystone_authtoken.admin_user = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] keystone_authtoken.auth_admin_prefix = {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] keystone_authtoken.auth_port = 35357 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] keystone_authtoken.auth_protocol = https {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] keystone_authtoken.auth_section = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] keystone_authtoken.auth_type = password {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] keystone_authtoken.auth_uri = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] keystone_authtoken.auth_version = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] keystone_authtoken.cache = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] keystone_authtoken.certfile = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] keystone_authtoken.delay_auth_decision = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] keystone_authtoken.http_connect_timeout = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] keystone_authtoken.identity_uri = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] keystone_authtoken.include_service_catalog = True {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] keystone_authtoken.insecure = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] keystone_authtoken.interface = public {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] keystone_authtoken.keyfile = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] keystone_authtoken.memcache_password = {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] keystone_authtoken.memcache_username = {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] keystone_authtoken.region_name = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] keystone_authtoken.service_token_roles_required = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] keystone_authtoken.service_type = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75871]: DEBUG oslo_concurrency.processutils [None req-5a06be96-3258-4a58-a3b8-1d3b098f2c0d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.040s {{(pid=75871) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] keystone_authtoken.token_cache_time = 300 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.236/identity {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] cache.backend = dogpile.cache.null {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] cache.backend_argument = **** {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] cache.backend_expiration_time = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] cache.config_prefix = cache.oslo {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] cache.debug_cache_backend = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] cache.enable_retry_client = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] cache.enable_socket_keepalive = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] cache.enabled = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] cache.enforce_fips_mode = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75871]: DEBUG oslo_concurrency.processutils [None req-5a06be96-3258-4a58-a3b8-1d3b098f2c0d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75871) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] cache.expiration_time = 600 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] cache.hashclient_retry_attempts = 2 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] cache.memcache_dead_retry = 300 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] cache.memcache_pool_maxsize = 10 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] cache.memcache_sasl_enabled = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] cache.password = **** {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] cache.proxies = [] {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] cache.redis_db = 0 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] cache.redis_sentinel_service_name = mymaster {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] cache.redis_server = localhost:6379 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] cache.retry_attempts = 2 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] cache.retry_delay = 0.0 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] cache.socket_keepalive_count = 1 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] cache.socket_keepalive_idle = 1 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] cache.socket_keepalive_interval = 1 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] cache.socket_timeout = 1.0 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] cache.tls_allowed_ciphers = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] cache.tls_cafile = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] cache.tls_certfile = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] cache.tls_enabled = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] cache.tls_keyfile = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] cache.username = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] coordination.backend_url = **** {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] database.asyncio_connection = **** {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] database.asyncio_slave_connection = **** {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] database.backend = sqlalchemy {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] database.connection = **** {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] database.connection_debug = 0 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] database.connection_parameters = {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] database.connection_recycle_time = 3600 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] database.connection_trace = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] database.db_inc_retry_interval = True {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] database.db_max_retries = 20 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] database.db_max_retry_interval = 10 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] database.db_retry_interval = 1 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] database.max_overflow = 50 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] database.max_pool_size = 5 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] database.max_retries = 10 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] database.mysql_wsrep_sync_wait = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] database.pool_timeout = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] database.retry_interval = 10 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] database.slave_connection = **** {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] database.sqlite_synchronous = True {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] database.synchronous_reader = True {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] database.use_db_reconnect = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] profiler.connection_string = messaging:// {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] profiler.enabled = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] profiler.es_doc_type = notification {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] profiler.es_scroll_size = 10000 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] profiler.es_scroll_time = 2m {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] profiler.filter_error_trace = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] profiler.hmac_keys = **** {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75871]: DEBUG oslo_concurrency.processutils [None req-5a06be96-3258-4a58-a3b8-1d3b098f2c0d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.039s {{(pid=75871) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] profiler.sentinel_service_name = mymaster {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] profiler.socket_timeout = 0.1 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75871]: DEBUG oslo_concurrency.processutils [None req-5a06be96-3258-4a58-a3b8-1d3b098f2c0d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75871) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] profiler.trace_requests = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] profiler.trace_sqlalchemy = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] profiler_jaeger.process_tags = {} {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] profiler_jaeger.service_name_prefix = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] profiler_otlp.service_name_prefix = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] oslo_policy.enforce_new_defaults = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: WARNING oslo_config.cfg [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] oslo_policy.enforce_scope = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] oslo_policy.policy_default_rule = default {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] oslo_policy.policy_file = policy.yaml {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] oslo_policy.remote_timeout = 60.0 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] privsep_osbrick.group = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] privsep_osbrick.helper_command = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] privsep_osbrick.user = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] cinder_sys_admin.group = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] cinder_sys_admin.helper_command = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] cinder_sys_admin.user = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] service_user.auth_section = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] service_user.auth_type = password {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] service_user.cafile = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] service_user.certfile = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] service_user.collect_timing = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] service_user.insecure = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] service_user.keyfile = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] service_user.send_service_user_token = True {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] service_user.split_loggers = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] service_user.timeout = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] glance.auth_section = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] glance.auth_type = password {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] glance.certfile = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] glance.collect_timing = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] glance.insecure = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] glance.keyfile = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] glance.region_name = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] glance.split_loggers = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] glance.timeout = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] backend_defaults.backend_availability_zone = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] backend_defaults.chap_password = **** {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] backend_defaults.chap_username = {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] backend_defaults.disk_geometry = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] backend_defaults.driver_client_cert = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] backend_defaults.driver_client_cert_key = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] backend_defaults.driver_data_namespace = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] backend_defaults.driver_use_ssl = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] backend_defaults.enable_unsupported_driver = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] backend_defaults.extra_capabilities = {} {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] backend_defaults.filter_function = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] backend_defaults.goodness_function = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] backend_defaults.iscsi_target_flags = {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] backend_defaults.iscsi_write_cache = on {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] backend_defaults.iser_helper = tgtadm {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] backend_defaults.iser_ip_address = 192.168.122.236 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] backend_defaults.iser_port = 3260 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] backend_defaults.lvm_mirrors = 0 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] backend_defaults.lvm_share_target = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] backend_defaults.lvm_type = auto {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] backend_defaults.num_shell_tries = 3 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] backend_defaults.nvmet_port_id = 1 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] backend_defaults.replication_device = **** {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] backend_defaults.report_discard_supported = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] backend_defaults.reserved_percentage = 0 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] backend_defaults.scst_target_driver = iscsi {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] backend_defaults.scst_target_iqn_name = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] backend_defaults.storage_protocol = iSCSI {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] backend_defaults.target_helper = tgtadm {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] backend_defaults.target_ip_address = 192.168.122.236 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] backend_defaults.target_port = 3260 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] backend_defaults.target_protocol = iscsi {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] backend_defaults.trace_flags = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] backend_defaults.unique_fqdn_network = True {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] backend_defaults.use_chap_auth = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] backend_defaults.volume_backend_name = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] backend_defaults.volume_clear = zero {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] backend_defaults.volume_clear_ionice = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] backend_defaults.volume_clear_size = 0 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] backend_defaults.volume_group = cinder-volumes {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] oslo_reports.file_event_handler = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] oslo_reports.log_dir = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] lvmdriver-1.backend_availability_zone = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] lvmdriver-1.backend_host = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] lvmdriver-1.chap_password = **** {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] lvmdriver-1.chap_username = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] lvmdriver-1.chiscsi_conf = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] lvmdriver-1.disk_geometry = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] lvmdriver-1.driver_client_cert = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] lvmdriver-1.driver_data_namespace = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] lvmdriver-1.driver_use_ssl = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] lvmdriver-1.extra_capabilities = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] lvmdriver-1.filter_function = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] lvmdriver-1.goodness_function = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] lvmdriver-1.iser_helper = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] lvmdriver-1.iser_ip_address = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] lvmdriver-1.iser_port = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] lvmdriver-1.iser_target_prefix = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] lvmdriver-1.lvm_conf_file = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] lvmdriver-1.lvm_mirrors = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] lvmdriver-1.lvm_share_target = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] lvmdriver-1.lvm_type = auto {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] lvmdriver-1.num_shell_tries = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack sudo[75875]: pam_unix(sudo:session): session closed for user root Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] lvmdriver-1.nvmet_port_id = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] lvmdriver-1.replication_device = **** {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] lvmdriver-1.report_discard_supported = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] lvmdriver-1.reserved_percentage = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] lvmdriver-1.scst_target_driver = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack sudo[76063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] lvmdriver-1.storage_protocol = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] lvmdriver-1.target_helper = lioadm {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] lvmdriver-1.target_ip_address = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] lvmdriver-1.target_port = 3260 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] lvmdriver-1.target_protocol = iscsi {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] lvmdriver-1.trace_flags = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] lvmdriver-1.use_chap_auth = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack sudo[76063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] lvmdriver-1.volume_clear = zero {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] lvmdriver-1.volume_clear_size = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] lvmdriver-1.volumes_dir = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] oslo_messaging_rabbit.ssl = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] oslo_messaging_rabbit.ssl_version = {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] oslo_messaging_notifications.driver = [] {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] oslo_messaging_notifications.retry = -1 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] oslo_messaging_notifications.transport_url = **** {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] key_manager.fixed_key = **** {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] barbican.barbican_api_version = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] barbican.barbican_endpoint = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] barbican.barbican_endpoint_type = public {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] barbican.barbican_region_name = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] barbican.cafile = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] barbican.certfile = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] barbican.collect_timing = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] barbican.insecure = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] barbican.keyfile = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] barbican.number_of_retries = 60 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] barbican.retry_delay = 1 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] barbican.send_service_user_token = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] barbican.split_loggers = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] barbican.timeout = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] barbican.verify_ssl = True {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] barbican.verify_ssl_path = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] barbican_service_user.auth_section = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] barbican_service_user.auth_type = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] barbican_service_user.cafile = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] barbican_service_user.certfile = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] barbican_service_user.collect_timing = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] barbican_service_user.insecure = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] barbican_service_user.keyfile = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] barbican_service_user.split_loggers = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] barbican_service_user.timeout = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] vault.approle_role_id = **** {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] vault.approle_secret_id = **** {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] vault.kv_mountpoint = secret {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] vault.kv_path = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] vault.kv_version = 2 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] vault.namespace = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] vault.root_token_id = **** {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] vault.ssl_ca_crt_file = None {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] vault.timeout = 60.0 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] vault.use_ssl = False {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 14:59:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] ******************************************************************************** {{(pid=75701) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Apr 29 14:59:56 devstack cinder-volume[75871]: DEBUG oslo_concurrency.processutils [None req-5a06be96-3258-4a58-a3b8-1d3b098f2c0d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.949s {{(pid=75871) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 14:59:56 devstack cinder-volume[75871]: DEBUG oslo_concurrency.processutils [None req-5a06be96-3258-4a58-a3b8-1d3b098f2c0d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75871) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 14:59:57 devstack sudo[76063]: pam_unix(sudo:session): session closed for user root Apr 29 14:59:57 devstack cinder-volume[75871]: DEBUG oslo_concurrency.processutils [None req-5a06be96-3258-4a58-a3b8-1d3b098f2c0d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.627s {{(pid=75871) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 14:59:57 devstack cinder-volume[75871]: DEBUG oslo_concurrency.processutils [None req-5a06be96-3258-4a58-a3b8-1d3b098f2c0d None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75871) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 14:59:57 devstack cinder-volume[75871]: INFO cinder.brick.local_dev.lvm [None req-5a06be96-3258-4a58-a3b8-1d3b098f2c0d None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Apr 29 14:59:57 devstack cinder-volume[75871]: DEBUG oslo_concurrency.processutils [None req-5a06be96-3258-4a58-a3b8-1d3b098f2c0d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75871) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 14:59:57 devstack cinder-volume[75871]: DEBUG oslo_concurrency.processutils [None req-5a06be96-3258-4a58-a3b8-1d3b098f2c0d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75871) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 14:59:57 devstack cinder-volume[75871]: DEBUG oslo_concurrency.processutils [None req-5a06be96-3258-4a58-a3b8-1d3b098f2c0d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75871) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 14:59:57 devstack sudo[76248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 14:59:57 devstack sudo[76248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 14:59:57 devstack sudo[76248]: pam_unix(sudo:session): session closed for user root Apr 29 14:59:57 devstack cinder-volume[75871]: DEBUG oslo_concurrency.processutils [None req-5a06be96-3258-4a58-a3b8-1d3b098f2c0d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.638s {{(pid=75871) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 14:59:57 devstack cinder-volume[75871]: DEBUG cinder.brick.local_dev.lvm [None req-5a06be96-3258-4a58-a3b8-1d3b098f2c0d None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75871) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Apr 29 14:59:57 devstack cinder-volume[75871]: DEBUG oslo_concurrency.processutils [None req-5a06be96-3258-4a58-a3b8-1d3b098f2c0d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75871) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 14:59:57 devstack sudo[76439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 14:59:57 devstack sudo[76439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 14:59:59 devstack sudo[76439]: pam_unix(sudo:session): session closed for user root Apr 29 14:59:59 devstack cinder-volume[75871]: DEBUG oslo_concurrency.processutils [None req-5a06be96-3258-4a58-a3b8-1d3b098f2c0d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.152s {{(pid=75871) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 14:59:59 devstack cinder-volume[75871]: DEBUG oslo_concurrency.processutils [None req-5a06be96-3258-4a58-a3b8-1d3b098f2c0d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75871) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 14:59:59 devstack cinder-volume[75871]: DEBUG oslo_concurrency.processutils [None req-5a06be96-3258-4a58-a3b8-1d3b098f2c0d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=75871) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 14:59:59 devstack cinder-volume[75871]: DEBUG oslo_concurrency.processutils [None req-5a06be96-3258-4a58-a3b8-1d3b098f2c0d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75871) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 14:59:59 devstack sudo[76617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 14:59:59 devstack sudo[76617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 14:59:59 devstack sudo[76617]: pam_unix(sudo:session): session closed for user root Apr 29 14:59:59 devstack cinder-volume[75871]: DEBUG oslo_concurrency.processutils [None req-5a06be96-3258-4a58-a3b8-1d3b098f2c0d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.731s {{(pid=75871) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 14:59:59 devstack cinder-volume[75871]: DEBUG oslo_concurrency.processutils [None req-5a06be96-3258-4a58-a3b8-1d3b098f2c0d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75871) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 14:59:59 devstack cinder-volume[75871]: DEBUG oslo_concurrency.processutils [None req-5a06be96-3258-4a58-a3b8-1d3b098f2c0d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.039s {{(pid=75871) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 14:59:59 devstack cinder-volume[75871]: DEBUG oslo_concurrency.processutils [None req-5a06be96-3258-4a58-a3b8-1d3b098f2c0d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75871) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 14:59:59 devstack sudo[76647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Apr 29 14:59:59 devstack sudo[76647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:00:00 devstack sudo[76647]: pam_unix(sudo:session): session closed for user root Apr 29 15:00:00 devstack cinder-volume[75871]: DEBUG oslo_concurrency.processutils [None req-5a06be96-3258-4a58-a3b8-1d3b098f2c0d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.809s {{(pid=75871) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:00:00 devstack cinder-volume[75871]: DEBUG oslo_concurrency.processutils [None req-5a06be96-3258-4a58-a3b8-1d3b098f2c0d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75871) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:00:00 devstack sudo[76657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 15:00:00 devstack sudo[76657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:00:01 devstack sudo[76657]: pam_unix(sudo:session): session closed for user root Apr 29 15:00:01 devstack cinder-volume[75871]: DEBUG oslo_concurrency.processutils [None req-5a06be96-3258-4a58-a3b8-1d3b098f2c0d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.648s {{(pid=75871) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:00:01 devstack cinder-volume[75871]: DEBUG oslo_concurrency.processutils [None req-5a06be96-3258-4a58-a3b8-1d3b098f2c0d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75871) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:00:01 devstack sudo[76662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 15:00:01 devstack sudo[76662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:00:01 devstack sudo[76662]: pam_unix(sudo:session): session closed for user root Apr 29 15:00:01 devstack cinder-volume[75871]: DEBUG oslo_concurrency.processutils [None req-5a06be96-3258-4a58-a3b8-1d3b098f2c0d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.646s {{(pid=75871) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:00:01 devstack cinder-volume[75871]: DEBUG oslo_concurrency.processutils [None req-5a06be96-3258-4a58-a3b8-1d3b098f2c0d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75871) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:00:01 devstack sudo[76665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 15:00:01 devstack sudo[76665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:00:02 devstack sudo[76665]: pam_unix(sudo:session): session closed for user root Apr 29 15:00:02 devstack cinder-volume[75871]: DEBUG oslo_concurrency.processutils [None req-5a06be96-3258-4a58-a3b8-1d3b098f2c0d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.627s {{(pid=75871) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:00:02 devstack cinder-volume[75871]: DEBUG oslo_concurrency.processutils [None req-5a06be96-3258-4a58-a3b8-1d3b098f2c0d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75871) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:00:02 devstack sudo[76670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 15:00:02 devstack sudo[76670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:00:03 devstack sudo[76670]: pam_unix(sudo:session): session closed for user root Apr 29 15:00:03 devstack cinder-volume[75871]: DEBUG oslo_concurrency.processutils [None req-5a06be96-3258-4a58-a3b8-1d3b098f2c0d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.663s {{(pid=75871) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:00:03 devstack cinder-volume[75871]: DEBUG oslo_concurrency.processutils [None req-5a06be96-3258-4a58-a3b8-1d3b098f2c0d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75871) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:00:03 devstack cinder-volume[75871]: DEBUG oslo_concurrency.processutils [None req-5a06be96-3258-4a58-a3b8-1d3b098f2c0d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.035s {{(pid=75871) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:00:03 devstack cinder-volume[75871]: DEBUG oslo_concurrency.processutils [None req-5a06be96-3258-4a58-a3b8-1d3b098f2c0d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75871) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:00:03 devstack sudo[76677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 15:00:03 devstack sudo[76677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:00:04 devstack sudo[76677]: pam_unix(sudo:session): session closed for user root Apr 29 15:00:04 devstack cinder-volume[75871]: DEBUG oslo_concurrency.processutils [None req-5a06be96-3258-4a58-a3b8-1d3b098f2c0d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.832s {{(pid=75871) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:00:04 devstack cinder-volume[75871]: INFO cinder.volume.drivers.lvm [None req-5a06be96-3258-4a58-a3b8-1d3b098f2c0d None None] Enabling LVM thin provisioning by default because a thin pool exists. Apr 29 15:00:04 devstack cinder-volume[75871]: DEBUG oslo_concurrency.processutils [None req-5a06be96-3258-4a58-a3b8-1d3b098f2c0d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75871) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:00:04 devstack cinder-volume[75871]: DEBUG oslo_concurrency.processutils [None req-5a06be96-3258-4a58-a3b8-1d3b098f2c0d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75871) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:00:04 devstack cinder-volume[75871]: DEBUG oslo_concurrency.processutils [None req-5a06be96-3258-4a58-a3b8-1d3b098f2c0d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75871) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:00:04 devstack sudo[76688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 15:00:04 devstack sudo[76688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:00:04 devstack sudo[76688]: pam_unix(sudo:session): session closed for user root Apr 29 15:00:04 devstack cinder-volume[75871]: DEBUG oslo_concurrency.processutils [None req-5a06be96-3258-4a58-a3b8-1d3b098f2c0d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.828s {{(pid=75871) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:00:04 devstack cinder-volume[75871]: DEBUG cinder.volume.drivers.lvm [None req-5a06be96-3258-4a58-a3b8-1d3b098f2c0d None None] Updating volume stats {{(pid=75871) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 29 15:00:04 devstack cinder-volume[75871]: DEBUG oslo_concurrency.processutils [None req-5a06be96-3258-4a58-a3b8-1d3b098f2c0d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75871) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:00:04 devstack sudo[76802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 15:00:04 devstack sudo[76802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:00:05 devstack cinder-volume[75701]: DEBUG dbcounter [-] [75701] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75701) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:00:05 devstack sudo[76802]: pam_unix(sudo:session): session closed for user root Apr 29 15:00:05 devstack cinder-volume[75871]: DEBUG oslo_concurrency.processutils [None req-5a06be96-3258-4a58-a3b8-1d3b098f2c0d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.627s {{(pid=75871) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:00:05 devstack cinder-volume[75871]: DEBUG oslo_concurrency.processutils [None req-5a06be96-3258-4a58-a3b8-1d3b098f2c0d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75871) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:00:05 devstack sudo[76842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 15:00:05 devstack sudo[76842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:00:06 devstack sudo[76842]: pam_unix(sudo:session): session closed for user root Apr 29 15:00:06 devstack cinder-volume[75871]: DEBUG oslo_concurrency.processutils [None req-5a06be96-3258-4a58-a3b8-1d3b098f2c0d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.649s {{(pid=75871) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:00:06 devstack cinder-volume[75871]: DEBUG oslo_concurrency.processutils [None req-5a06be96-3258-4a58-a3b8-1d3b098f2c0d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75871) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:00:06 devstack sudo[76947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 15:00:06 devstack sudo[76947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:00:06 devstack sudo[76947]: pam_unix(sudo:session): session closed for user root Apr 29 15:00:06 devstack cinder-volume[75871]: DEBUG oslo_concurrency.processutils [None req-5a06be96-3258-4a58-a3b8-1d3b098f2c0d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.586s {{(pid=75871) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:00:06 devstack cinder-volume[75871]: DEBUG oslo_concurrency.processutils [None req-5a06be96-3258-4a58-a3b8-1d3b098f2c0d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75871) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:00:06 devstack sudo[76953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 15:00:06 devstack sudo[76953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:00:07 devstack sudo[76953]: pam_unix(sudo:session): session closed for user root Apr 29 15:00:07 devstack cinder-volume[75871]: DEBUG oslo_concurrency.processutils [None req-5a06be96-3258-4a58-a3b8-1d3b098f2c0d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.616s {{(pid=75871) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:00:07 devstack cinder-volume[75871]: INFO cinder.volume.driver [None req-5a06be96-3258-4a58-a3b8-1d3b098f2c0d None None] Driver hasn't implemented _init_vendor_properties() Apr 29 15:00:07 devstack cinder-volume[75871]: DEBUG cinder.volume.driver [None req-5a06be96-3258-4a58-a3b8-1d3b098f2c0d None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75871) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 29 15:00:07 devstack cinder-volume[75871]: DEBUG oslo_db.sqlalchemy.engines [None req-5a06be96-3258-4a58-a3b8-1d3b098f2c0d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75871) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 15:00:07 devstack cinder-volume[75871]: DEBUG dbcounter [-] [75871] Writer thread running {{(pid=75871) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 29 15:00:07 devstack cinder-volume[75871]: DEBUG cinder.db.sqlalchemy.api [None req-5a06be96-3258-4a58-a3b8-1d3b098f2c0d None None] Building query based on filter {{(pid=75871) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 29 15:00:07 devstack cinder-volume[75871]: DEBUG cinder.image.image_utils [None req-5a06be96-3258-4a58-a3b8-1d3b098f2c0d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75871) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 29 15:00:07 devstack cinder-volume[75871]: INFO cinder.keymgr.migration [None req-9721d09c-0b1e-4f1e-b131-36365317f407 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 29 15:00:07 devstack cinder-volume[75871]: DEBUG cinder.volume.drivers.lvm [None req-5a06be96-3258-4a58-a3b8-1d3b098f2c0d None None] Updating volume stats {{(pid=75871) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 29 15:00:07 devstack cinder-volume[75871]: DEBUG oslo_concurrency.processutils [None req-5a06be96-3258-4a58-a3b8-1d3b098f2c0d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75871) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:00:07 devstack sudo[76957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 15:00:07 devstack sudo[76957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:00:08 devstack sudo[76957]: pam_unix(sudo:session): session closed for user root Apr 29 15:00:08 devstack cinder-volume[75871]: DEBUG oslo_concurrency.processutils [None req-5a06be96-3258-4a58-a3b8-1d3b098f2c0d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.593s {{(pid=75871) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:00:08 devstack cinder-volume[75871]: DEBUG oslo_concurrency.processutils [None req-5a06be96-3258-4a58-a3b8-1d3b098f2c0d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75871) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:00:08 devstack sudo[76960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 15:00:08 devstack sudo[76960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:00:08 devstack sudo[76960]: pam_unix(sudo:session): session closed for user root Apr 29 15:00:08 devstack cinder-volume[75871]: DEBUG oslo_concurrency.processutils [None req-5a06be96-3258-4a58-a3b8-1d3b098f2c0d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.624s {{(pid=75871) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:00:08 devstack cinder-volume[75871]: DEBUG oslo_concurrency.processutils [None req-5a06be96-3258-4a58-a3b8-1d3b098f2c0d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75871) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:00:08 devstack sudo[76963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 15:00:08 devstack sudo[76963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:00:09 devstack sudo[76963]: pam_unix(sudo:session): session closed for user root Apr 29 15:00:09 devstack cinder-volume[75871]: DEBUG oslo_concurrency.processutils [None req-5a06be96-3258-4a58-a3b8-1d3b098f2c0d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.617s {{(pid=75871) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:00:09 devstack cinder-volume[75871]: DEBUG oslo_concurrency.processutils [None req-5a06be96-3258-4a58-a3b8-1d3b098f2c0d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75871) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:00:09 devstack sudo[76966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 15:00:09 devstack sudo[76966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:00:09 devstack sudo[76966]: pam_unix(sudo:session): session closed for user root Apr 29 15:00:09 devstack cinder-volume[75871]: DEBUG oslo_concurrency.processutils [None req-5a06be96-3258-4a58-a3b8-1d3b098f2c0d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.635s {{(pid=75871) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:00:09 devstack cinder-volume[75871]: DEBUG cinder.manager [None req-5a06be96-3258-4a58-a3b8-1d3b098f2c0d None None] Notifying Schedulers of capabilities ... {{(pid=75871) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:00:10 devstack cinder-volume[75871]: INFO cinder.volume.manager [None req-5a06be96-3258-4a58-a3b8-1d3b098f2c0d None None] Driver initialization completed successfully. Apr 29 15:00:10 devstack cinder-volume[75871]: INFO cinder.manager [None req-5a06be96-3258-4a58-a3b8-1d3b098f2c0d None None] Initiating service 2 cleanup Apr 29 15:00:10 devstack cinder-volume[75871]: INFO cinder.manager [None req-5a06be96-3258-4a58-a3b8-1d3b098f2c0d None None] Service 2 cleanup completed. Apr 29 15:00:10 devstack cinder-volume[75871]: DEBUG cinder.service [None req-5a06be96-3258-4a58-a3b8-1d3b098f2c0d None None] Creating RPC server for service cinder-volume {{(pid=75871) start /opt/stack/cinder/cinder/service.py:231}} Apr 29 15:00:10 devstack cinder-volume[75871]: DEBUG cinder.service [None req-5a06be96-3258-4a58-a3b8-1d3b098f2c0d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75871) start /opt/stack/cinder/cinder/service.py:237}} Apr 29 15:00:10 devstack cinder-volume[75871]: INFO cinder.volume.manager [None req-5a06be96-3258-4a58-a3b8-1d3b098f2c0d None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Apr 29 15:00:10 devstack cinder-volume[75871]: DEBUG cinder.volume.drivers.lvm [None req-5a06be96-3258-4a58-a3b8-1d3b098f2c0d None None] Updating volume stats {{(pid=75871) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 29 15:00:10 devstack cinder-volume[75871]: DEBUG oslo_concurrency.processutils [None req-5a06be96-3258-4a58-a3b8-1d3b098f2c0d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75871) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:00:10 devstack sudo[76974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 15:00:10 devstack sudo[76974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:00:10 devstack sudo[76974]: pam_unix(sudo:session): session closed for user root Apr 29 15:00:10 devstack cinder-volume[75871]: DEBUG oslo_concurrency.processutils [None req-5a06be96-3258-4a58-a3b8-1d3b098f2c0d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.635s {{(pid=75871) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:00:10 devstack cinder-volume[75871]: DEBUG oslo_concurrency.processutils [None req-5a06be96-3258-4a58-a3b8-1d3b098f2c0d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75871) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:00:10 devstack sudo[77014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 15:00:10 devstack sudo[77014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:00:11 devstack sudo[77014]: pam_unix(sudo:session): session closed for user root Apr 29 15:00:11 devstack cinder-volume[75871]: DEBUG oslo_concurrency.processutils [None req-5a06be96-3258-4a58-a3b8-1d3b098f2c0d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.642s {{(pid=75871) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:00:11 devstack cinder-volume[75871]: DEBUG oslo_concurrency.processutils [None req-5a06be96-3258-4a58-a3b8-1d3b098f2c0d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75871) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:00:11 devstack sudo[77019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 15:00:11 devstack sudo[77019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:00:12 devstack sudo[77019]: pam_unix(sudo:session): session closed for user root Apr 29 15:00:12 devstack cinder-volume[75871]: DEBUG oslo_concurrency.processutils [None req-5a06be96-3258-4a58-a3b8-1d3b098f2c0d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.601s {{(pid=75871) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:00:12 devstack cinder-volume[75871]: DEBUG oslo_concurrency.processutils [None req-5a06be96-3258-4a58-a3b8-1d3b098f2c0d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75871) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:00:12 devstack sudo[77076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 15:00:12 devstack sudo[77076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:00:12 devstack sudo[77076]: pam_unix(sudo:session): session closed for user root Apr 29 15:00:12 devstack cinder-volume[75871]: DEBUG oslo_concurrency.processutils [None req-5a06be96-3258-4a58-a3b8-1d3b098f2c0d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.587s {{(pid=75871) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:00:12 devstack cinder-volume[75871]: INFO cinder.volume.manager [None req-5a06be96-3258-4a58-a3b8-1d3b098f2c0d None None] Driver post RPC initialization completed successfully. Apr 29 15:00:22 devstack cinder-volume[75871]: DEBUG dbcounter [-] [75871] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75871) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:00:22 devstack cinder-volume[75871]: DEBUG dbcounter [-] [75871] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=75871) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:01:29 devstack cinder-volume[75871]: DEBUG oslo_service.periodic_task [None req-8c45ee78-8c98-4bb8-a25e-78be8528528a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75871) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 15:01:29 devstack cinder-volume[75871]: DEBUG cinder.volume.drivers.lvm [None req-8c45ee78-8c98-4bb8-a25e-78be8528528a None None] Updating volume stats {{(pid=75871) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 29 15:01:29 devstack cinder-volume[75871]: DEBUG oslo_concurrency.processutils [None req-8c45ee78-8c98-4bb8-a25e-78be8528528a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75871) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:01:29 devstack sudo[81734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 15:01:29 devstack sudo[81734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:01:30 devstack sudo[81734]: pam_unix(sudo:session): session closed for user root Apr 29 15:01:30 devstack cinder-volume[75871]: DEBUG oslo_concurrency.processutils [None req-8c45ee78-8c98-4bb8-a25e-78be8528528a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.599s {{(pid=75871) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:01:30 devstack cinder-volume[75871]: DEBUG oslo_concurrency.processutils [None req-8c45ee78-8c98-4bb8-a25e-78be8528528a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75871) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:01:30 devstack sudo[81738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 15:01:30 devstack sudo[81738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:01:30 devstack sudo[81738]: pam_unix(sudo:session): session closed for user root Apr 29 15:01:30 devstack cinder-volume[75871]: DEBUG oslo_concurrency.processutils [None req-8c45ee78-8c98-4bb8-a25e-78be8528528a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.611s {{(pid=75871) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:01:30 devstack cinder-volume[75871]: DEBUG oslo_concurrency.processutils [None req-8c45ee78-8c98-4bb8-a25e-78be8528528a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75871) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:01:30 devstack sudo[81744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 15:01:30 devstack sudo[81744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:01:31 devstack sudo[81744]: pam_unix(sudo:session): session closed for user root Apr 29 15:01:31 devstack cinder-volume[75871]: DEBUG oslo_concurrency.processutils [None req-8c45ee78-8c98-4bb8-a25e-78be8528528a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.590s {{(pid=75871) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:01:31 devstack cinder-volume[75871]: DEBUG oslo_concurrency.processutils [None req-8c45ee78-8c98-4bb8-a25e-78be8528528a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75871) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:01:31 devstack sudo[81747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 15:01:31 devstack sudo[81747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:01:32 devstack sudo[81747]: pam_unix(sudo:session): session closed for user root Apr 29 15:01:32 devstack cinder-volume[75871]: DEBUG oslo_concurrency.processutils [None req-8c45ee78-8c98-4bb8-a25e-78be8528528a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.589s {{(pid=75871) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:01:32 devstack cinder-volume[75871]: DEBUG cinder.manager [None req-8c45ee78-8c98-4bb8-a25e-78be8528528a None None] Notifying Schedulers of capabilities ... {{(pid=75871) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:02:22 devstack cinder-volume[75871]: DEBUG dbcounter [-] [75871] Writing DB stats cinder:SELECT=1 {{(pid=75871) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:02:22 devstack cinder-volume[75871]: DEBUG dbcounter [-] [75871] Writing DB stats cinder:UPDATE=1 {{(pid=75871) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:02:29 devstack cinder-volume[75871]: DEBUG oslo_service.periodic_task [None req-8c45ee78-8c98-4bb8-a25e-78be8528528a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75871) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 15:02:29 devstack cinder-volume[75871]: DEBUG cinder.volume.drivers.lvm [None req-8c45ee78-8c98-4bb8-a25e-78be8528528a None None] Updating volume stats {{(pid=75871) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 29 15:02:29 devstack cinder-volume[75871]: DEBUG oslo_concurrency.processutils [None req-8c45ee78-8c98-4bb8-a25e-78be8528528a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75871) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:02:29 devstack sudo[82170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 15:02:29 devstack sudo[82170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:02:30 devstack sudo[82170]: pam_unix(sudo:session): session closed for user root Apr 29 15:02:30 devstack cinder-volume[75871]: DEBUG oslo_concurrency.processutils [None req-8c45ee78-8c98-4bb8-a25e-78be8528528a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.609s {{(pid=75871) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:02:30 devstack cinder-volume[75871]: DEBUG oslo_concurrency.processutils [None req-8c45ee78-8c98-4bb8-a25e-78be8528528a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75871) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:02:30 devstack sudo[82175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 15:02:30 devstack sudo[82175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:02:30 devstack sudo[82175]: pam_unix(sudo:session): session closed for user root Apr 29 15:02:30 devstack cinder-volume[75871]: DEBUG oslo_concurrency.processutils [None req-8c45ee78-8c98-4bb8-a25e-78be8528528a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.581s {{(pid=75871) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:02:30 devstack cinder-volume[75871]: DEBUG oslo_concurrency.processutils [None req-8c45ee78-8c98-4bb8-a25e-78be8528528a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75871) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:02:30 devstack sudo[82194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 15:02:30 devstack sudo[82194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:02:31 devstack sudo[82194]: pam_unix(sudo:session): session closed for user root Apr 29 15:02:31 devstack cinder-volume[75871]: DEBUG oslo_concurrency.processutils [None req-8c45ee78-8c98-4bb8-a25e-78be8528528a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.598s {{(pid=75871) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:02:31 devstack cinder-volume[75871]: DEBUG oslo_concurrency.processutils [None req-8c45ee78-8c98-4bb8-a25e-78be8528528a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75871) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:02:31 devstack sudo[82198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 15:02:31 devstack sudo[82198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:02:32 devstack sudo[82198]: pam_unix(sudo:session): session closed for user root Apr 29 15:02:32 devstack cinder-volume[75871]: DEBUG oslo_concurrency.processutils [None req-8c45ee78-8c98-4bb8-a25e-78be8528528a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.603s {{(pid=75871) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:02:32 devstack cinder-volume[75871]: DEBUG cinder.manager [None req-8c45ee78-8c98-4bb8-a25e-78be8528528a None None] Notifying Schedulers of capabilities ... {{(pid=75871) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:02:56 devstack cinder-volume[75701]: INFO oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] Caught SIGTERM, stopping children Apr 29 15:02:56 devstack cinder-volume[75701]: DEBUG oslo_concurrency.lockutils [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] Acquiring lock "singleton_lock" {{(pid=75701) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 29 15:02:56 devstack cinder-volume[75701]: DEBUG oslo_concurrency.lockutils [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] Acquired lock "singleton_lock" {{(pid=75701) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 29 15:02:56 devstack cinder-volume[75701]: DEBUG oslo_concurrency.lockutils [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] Releasing lock "singleton_lock" {{(pid=75701) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 29 15:02:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] Stop services. {{(pid=75701) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 29 15:02:56 devstack cinder-volume[75701]: DEBUG oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] Killing children. {{(pid=75701) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 29 15:02:56 devstack cinder-volume[75701]: INFO oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] Waiting on 1 children to exit Apr 29 15:03:00 devstack cinder-volume[75871]: DEBUG oslo_concurrency.lockutils [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] Acquiring lock "singleton_lock" {{(pid=75871) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 29 15:03:00 devstack cinder-volume[75871]: DEBUG oslo_concurrency.lockutils [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] Acquired lock "singleton_lock" {{(pid=75871) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 29 15:03:00 devstack cinder-volume[75871]: DEBUG oslo_concurrency.lockutils [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] Releasing lock "singleton_lock" {{(pid=75871) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 29 15:03:00 devstack cinder-volume[75871]: WARNING amqp [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 29 15:03:00 devstack cinder-volume[75871]: WARNING amqp [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 29 15:03:00 devstack cinder-volume[75701]: INFO oslo_service.backend._eventlet.service [None req-26d822ea-81c2-41cc-a75c-874f800c40cc None None] Child 75871 exited with status 0 Apr 29 15:03:02 devstack cinder-volume[83525]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=83525) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 29 15:03:02 devstack cinder-volume[83525]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=83525) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 29 15:03:02 devstack cinder-volume[83525]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=83525) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 29 15:03:03 devstack cinder-volume[83525]: INFO dbcounter [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] Registered counter for database cinder Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_db.sqlalchemy.engines [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83525) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG dbcounter [-] [83525] Writer thread running {{(pid=83525) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 29 15:03:03 devstack cinder-volume[83525]: INFO cinder.rpc [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 29 15:03:03 devstack cinder-volume[83525]: INFO cinder.rpc [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_db.sqlalchemy.engines [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83525) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 15:03:03 devstack cinder-volume[83525]: INFO cinder.volume.manager [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] Determined volume DB was empty at startup. Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG cinder.volume.manager [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=83525) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 29 15:03:03 devstack cinder-volume[83525]: INFO cinder.volume.manager [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 29 15:03:03 devstack cinder-volume[83525]: WARNING stevedore.named [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 29 15:03:03 devstack cinder-volume[83525]: WARNING castellan.key_manager [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 29 15:03:03 devstack cinder-volume[83525]: WARNING cinder.keymgr.conf_key_mgr [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 29 15:03:03 devstack cinder-volume[83525]: INFO cinder.volume.manager [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_db.sqlalchemy.engines [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83525) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 15:03:03 devstack cinder-volume[83525]: INFO oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] Starting 1 workers Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] Started child 83734 {{(pid=83525) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] Full set of CONF: {{(pid=83525) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] ******************************************************************************** {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] Configuration options gathered from: {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] ================================================================================ {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Apr 29 15:03:03 devstack cinder-volume[83734]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] allow_availability_zone_fallback = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] allow_compression_on_image_upload = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] allowed_direct_url_schemes = [] {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] api_rate_limit = True {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] auth_strategy = keystone {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backend_availability_zone = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backend_host = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backend_name = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backend_stats_polling_interval = 60 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backup_api_class = cinder.backup.api.API {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backup_name_template = backup-%s {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backup_use_same_host = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backup_use_temp_snapshot = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] chap_password = **** {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] chap_username = {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] cinder_internal_tenant_project_id = 4576d27b7a8e4f74bfed45b5b74588bc {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] cinder_internal_tenant_user_id = 7a0144856f9b4206b9969013745dfd09 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] cluster = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] compression_format = gzip {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] compute_api_class = cinder.compute.nova.API {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] config_dir = [] {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] config_source = [] {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] control_exchange = openstack {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] debug = True {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] default_availability_zone = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] default_group_type = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] default_volume_type = QuobyteHD {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] disk_geometry = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] driver_client_cert = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] driver_client_cert_key = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] driver_data_namespace = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] driver_ssl_cert_path = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] driver_ssl_cert_verify = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] driver_use_ssl = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] enable_new_services = True {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] enable_unsupported_driver = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] enabled_backends = ['QuobyteHD'] {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] enforce_multipath_for_image_xfer = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] filter_function = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] glance_api_insecure = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] glance_api_servers = ['http://192.168.122.236/image'] {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] glance_api_ssl_compression = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] glance_ca_certificates_file = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] glance_catalog_info = image:glance:publicURL {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] glance_certfile = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] glance_keyfile = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83734]: INFO cinder.volume.manager [None req-39b9cb45-d463-48ff-b852-53c2b1cd9e40 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 29 15:03:03 devstack cinder-volume[83734]: DEBUG cinder.volume.drivers.remotefs [None req-39b9cb45-d463-48ff-b852-53c2b1cd9e40 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=83734) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] glance_num_retries = 3 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] glance_request_timeout = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] goodness_function = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] graceful_shutdown_timeout = 5 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] group_api_class = cinder.group.api.API {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] host = devstack {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] image_compress_on_upload = True {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] image_conversion_address_space_limit = 1 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] image_conversion_cpu_limit = 60 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] image_conversion_disable = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] image_upload_use_cinder_backend = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] image_upload_use_internal_tenant = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] image_volume_cache_enabled = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] image_volume_cache_max_count = 0 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] image_volume_cache_max_size_gb = 0 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] init_host_max_objects_retrieval = 0 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] instance_format = [instance: %(uuid)s] {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] iscsi_target_flags = {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] iscsi_write_cache = on {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] iser_helper = tgtadm {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] iser_ip_address = 192.168.122.236 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] iser_port = 3260 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] log_color = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] log_config_append = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] log_dir = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] log_file = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] log_options = True {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] log_rotate_interval = 1 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] log_rotate_interval_type = days {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] log_rotation_type = none {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] max_age = 0 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] max_logfile_count = 30 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] max_logfile_size_mb = 200 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] max_over_subscription_ratio = 20.0 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] message_reap_interval = 86400 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] message_ttl = 2592000 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] migration_create_volume_timeout_secs = 300 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] monkey_patch = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] monkey_patch_modules = [] {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:03 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] my_ip = 192.168.122.236 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] no_snapshot_gb_quota = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] num_iser_scan_tries = 3 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] num_shell_tries = 3 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] num_volume_device_scan_tries = 3 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] nvmeof_conn_info_version = 1 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] nvmet_ns_id = 10 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] nvmet_port_id = 1 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] osapi_max_limit = 1000 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] osapi_volume_ext_list = [] {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] osapi_volume_listen = 0.0.0.0 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] osapi_volume_listen_port = 8776 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] osapi_volume_use_ssl = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] osapi_volume_workers = 2 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] per_volume_size_limit = -1 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] periodic_fuzzy_delay = 60 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] periodic_interval = 60 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] project_id_regex = [0-9a-f\-]+ {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] public_endpoint = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] publish_errors = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] quota_backup_gigabytes = 1000 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] quota_backups = 10 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] quota_gigabytes = 1000 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] quota_groups = 10 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] quota_snapshots = 10 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] quota_volumes = 10 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] rate_limit_burst = 0 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] rate_limit_except_level = CRITICAL {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] rate_limit_interval = 0 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] reinit_driver_count = 3 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] replication_device = **** {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] report_discard_supported = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] report_interval = 120 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] reservation_clean_interval = 86400 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] reservation_expire = 86400 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] reserved_image_namespaces = [] {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] reserved_percentage = 0 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] rpc_response_timeout = 120 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] run_external_periodic_tasks = True {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] scst_target_driver = iscsi {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] scst_target_iqn_name = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] service_down_time = 720 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] shell_completion = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] snapshot_name_template = snapshot-%s {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] split_loggers = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] state_path = /opt/stack/data/cinder {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] storage_availability_zone = nova {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] storage_protocol = iSCSI {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] syslog_log_facility = LOG_USER {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] target_helper = lioadm {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] target_ip_address = 192.168.122.236 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] target_port = 3260 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] target_protocol = iscsi {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] target_secondary_ip_addresses = [] {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] trace_flags = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] transfer_api_class = cinder.transfer.api.API {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] transport_url = **** {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] until_refresh = 0 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] use_chap_auth = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] use_default_quota_class = True {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] use_journal = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] use_json = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] use_multipath_for_image_xfer = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] use_stderr = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] use_syslog = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] verify_glance_signatures = enabled {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] volume_api_class = cinder.volume.api.API {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] volume_backend_name = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] volume_clear = zero {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] volume_clear_ionice = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] volume_clear_size = 0 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] volume_copy_bps_limit = 0 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] volume_dd_blocksize = 1M {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] volume_name_template = volume-%s {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] volume_service_inithost_offload = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] volume_usage_audit_period = month {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] zoning_mode = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] oslo_concurrency.disable_process_locking = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83734]: DEBUG cinder.volume.drivers.quobyte [None req-39b9cb45-d463-48ff-b852-53c2b1cd9e40 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=83734) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 29 15:03:04 devstack cinder-volume[83734]: WARNING cinder.volume.drivers.quobyte [None req-39b9cb45-d463-48ff-b852-53c2b1cd9e40 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 29 15:03:04 devstack cinder-volume[83734]: WARNING cinder.volume.drivers.quobyte [None req-39b9cb45-d463-48ff-b852-53c2b1cd9e40 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] keystone_authtoken.admin_password = **** {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] keystone_authtoken.admin_token = **** {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] keystone_authtoken.admin_user = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] keystone_authtoken.auth_admin_prefix = {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] keystone_authtoken.auth_port = 35357 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83734]: DEBUG oslo_concurrency.processutils [None req-39b9cb45-d463-48ff-b852-53c2b1cd9e40 None None] Running cmd (subprocess): mount.quobyte {{(pid=83734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] keystone_authtoken.auth_protocol = https {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] keystone_authtoken.auth_section = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] keystone_authtoken.auth_type = password {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] keystone_authtoken.auth_uri = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] keystone_authtoken.auth_version = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] keystone_authtoken.cache = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] keystone_authtoken.certfile = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] keystone_authtoken.delay_auth_decision = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] keystone_authtoken.http_connect_timeout = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] keystone_authtoken.identity_uri = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] keystone_authtoken.include_service_catalog = True {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] keystone_authtoken.insecure = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] keystone_authtoken.interface = public {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] keystone_authtoken.keyfile = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] keystone_authtoken.memcache_password = {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] keystone_authtoken.memcache_username = {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] keystone_authtoken.region_name = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] keystone_authtoken.service_token_roles_required = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] keystone_authtoken.service_type = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] keystone_authtoken.token_cache_time = 300 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.236/identity {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] cache.backend = dogpile.cache.null {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] cache.backend_argument = **** {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] cache.backend_expiration_time = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] cache.config_prefix = cache.oslo {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] cache.debug_cache_backend = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] cache.enable_retry_client = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] cache.enable_socket_keepalive = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] cache.enabled = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] cache.enforce_fips_mode = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] cache.expiration_time = 600 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] cache.hashclient_retry_attempts = 2 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] cache.memcache_dead_retry = 300 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] cache.memcache_pool_maxsize = 10 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] cache.memcache_sasl_enabled = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] cache.password = **** {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] cache.proxies = [] {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] cache.redis_db = 0 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] cache.redis_sentinel_service_name = mymaster {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] cache.redis_server = localhost:6379 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] cache.retry_attempts = 2 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] cache.retry_delay = 0.0 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] cache.socket_keepalive_count = 1 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] cache.socket_keepalive_idle = 1 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] cache.socket_keepalive_interval = 1 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] cache.socket_timeout = 1.0 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] cache.tls_allowed_ciphers = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] cache.tls_cafile = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] cache.tls_certfile = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] cache.tls_enabled = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] cache.tls_keyfile = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] cache.username = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] coordination.backend_url = **** {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] database.asyncio_connection = **** {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] database.asyncio_slave_connection = **** {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] database.backend = sqlalchemy {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] database.connection = **** {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] database.connection_debug = 0 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] database.connection_parameters = {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] database.connection_recycle_time = 3600 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] database.connection_trace = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] database.db_inc_retry_interval = True {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] database.db_max_retries = 20 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] database.db_max_retry_interval = 10 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] database.db_retry_interval = 1 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] database.max_overflow = 50 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] database.max_pool_size = 5 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] database.max_retries = 10 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] database.mysql_wsrep_sync_wait = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] database.pool_timeout = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] database.retry_interval = 10 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] database.slave_connection = **** {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] database.sqlite_synchronous = True {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] database.synchronous_reader = True {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] database.use_db_reconnect = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] profiler.connection_string = messaging:// {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] profiler.enabled = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] profiler.es_doc_type = notification {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] profiler.es_scroll_size = 10000 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] profiler.es_scroll_time = 2m {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] profiler.filter_error_trace = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] profiler.hmac_keys = **** {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] profiler.sentinel_service_name = mymaster {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] profiler.socket_timeout = 0.1 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] profiler.trace_requests = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] profiler.trace_sqlalchemy = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] profiler_jaeger.process_tags = {} {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] profiler_jaeger.service_name_prefix = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] profiler_otlp.service_name_prefix = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] oslo_policy.enforce_new_defaults = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: WARNING oslo_config.cfg [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] oslo_policy.enforce_scope = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] oslo_policy.policy_default_rule = default {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] oslo_policy.policy_file = policy.yaml {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] oslo_policy.remote_timeout = 60.0 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] privsep_osbrick.group = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] privsep_osbrick.helper_command = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] privsep_osbrick.user = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] cinder_sys_admin.group = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] cinder_sys_admin.helper_command = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] cinder_sys_admin.user = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] service_user.auth_section = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] service_user.auth_type = password {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] service_user.cafile = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] service_user.certfile = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] service_user.collect_timing = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] service_user.insecure = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] service_user.keyfile = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] service_user.send_service_user_token = True {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] service_user.split_loggers = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] service_user.timeout = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] glance.auth_section = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] glance.auth_type = password {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] glance.certfile = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] glance.collect_timing = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] glance.insecure = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] glance.keyfile = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] glance.region_name = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] glance.split_loggers = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] glance.timeout = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backend_defaults.backend_availability_zone = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backend_defaults.chap_password = **** {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backend_defaults.chap_username = {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backend_defaults.disk_geometry = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backend_defaults.driver_client_cert = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backend_defaults.driver_client_cert_key = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backend_defaults.driver_data_namespace = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backend_defaults.driver_use_ssl = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backend_defaults.enable_unsupported_driver = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backend_defaults.extra_capabilities = {} {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backend_defaults.filter_function = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backend_defaults.goodness_function = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backend_defaults.iscsi_target_flags = {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backend_defaults.iscsi_write_cache = on {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backend_defaults.iser_helper = tgtadm {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backend_defaults.iser_ip_address = 192.168.122.236 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backend_defaults.iser_port = 3260 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack quobyte-client[83815]: Reading configuration file: /etc/quobyte/client.cfg Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack quobyte-client[83815]: Invalid parameters found, error: missing mount point. Apr 29 15:03:04 devstack quobyte-client[83815]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 29 15:03:04 devstack quobyte-client[83815]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backend_defaults.nas_host = {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backend_defaults.nas_login = admin {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backend_defaults.nas_mount_options = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backend_defaults.nas_password = **** {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backend_defaults.nas_private_key = {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backend_defaults.nas_share_path = {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backend_defaults.nas_ssh_port = 22 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83734]: DEBUG oslo_concurrency.processutils [None req-39b9cb45-d463-48ff-b852-53c2b1cd9e40 None None] CMD "mount.quobyte" returned: 1 in 0.143s {{(pid=83734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:03:04 devstack cinder-volume[83734]: DEBUG oslo_concurrency.lockutils [None req-39b9cb45-d463-48ff-b852-53c2b1cd9e40 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83734) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:03:04 devstack cinder-volume[83734]: DEBUG oslo_concurrency.lockutils [None req-39b9cb45-d463-48ff-b852-53c2b1cd9e40 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83734) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:03:04 devstack cinder-volume[83734]: DEBUG cinder.volume.drivers.quobyte [None req-39b9cb45-d463-48ff-b852-53c2b1cd9e40 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=83734) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backend_defaults.num_shell_tries = 3 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backend_defaults.nvmet_port_id = 1 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backend_defaults.quobyte_client_cfg = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83734]: INFO cinder.volume.drivers.quobyte [None req-39b9cb45-d463-48ff-b852-53c2b1cd9e40 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a ... Apr 29 15:03:04 devstack cinder-volume[83734]: DEBUG oslo_concurrency.processutils [None req-39b9cb45-d463-48ff-b852-53c2b1cd9e40 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 -c /etc/quobyte/client-cinder.cfg {{(pid=83734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backend_defaults.quobyte_volume_url = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backend_defaults.replication_device = **** {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backend_defaults.report_discard_supported = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backend_defaults.reserved_percentage = 0 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backend_defaults.scst_target_driver = iscsi {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backend_defaults.scst_target_iqn_name = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backend_defaults.storage_protocol = iSCSI {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backend_defaults.target_helper = tgtadm {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backend_defaults.target_ip_address = 192.168.122.236 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backend_defaults.target_port = 3260 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backend_defaults.target_protocol = iscsi {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backend_defaults.trace_flags = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backend_defaults.unique_fqdn_network = True {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backend_defaults.use_chap_auth = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backend_defaults.volume_backend_name = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backend_defaults.volume_clear = zero {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backend_defaults.volume_clear_ionice = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backend_defaults.volume_clear_size = 0 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] oslo_reports.file_event_handler = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] oslo_reports.log_dir = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] QuobyteHD.backend_availability_zone = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] QuobyteHD.backend_host = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] QuobyteHD.chap_password = **** {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] QuobyteHD.chap_username = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] QuobyteHD.chiscsi_conf = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] QuobyteHD.disk_geometry = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] QuobyteHD.driver_client_cert = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] QuobyteHD.driver_client_cert_key = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] QuobyteHD.driver_data_namespace = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack sudo[83817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 -c /etc/quobyte/client-cinder.cfg Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] QuobyteHD.driver_use_ssl = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack sudo[83817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] QuobyteHD.extra_capabilities = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] QuobyteHD.filter_function = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] QuobyteHD.goodness_function = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] QuobyteHD.iscsi_target_flags = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] QuobyteHD.iscsi_write_cache = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] QuobyteHD.iser_helper = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] QuobyteHD.iser_ip_address = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] QuobyteHD.iser_port = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] QuobyteHD.iser_target_prefix = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] QuobyteHD.nas_host = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] QuobyteHD.nas_login = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] QuobyteHD.nas_mount_options = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] QuobyteHD.nas_password = **** {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] QuobyteHD.nas_private_key = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] QuobyteHD.nas_share_path = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] QuobyteHD.nas_ssh_port = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] QuobyteHD.num_shell_tries = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] QuobyteHD.nvmet_ns_id = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] QuobyteHD.nvmet_port_id = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] QuobyteHD.replication_device = **** {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] QuobyteHD.report_discard_supported = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] QuobyteHD.reserved_percentage = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] QuobyteHD.scst_target_driver = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] QuobyteHD.storage_protocol = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] QuobyteHD.target_helper = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] QuobyteHD.target_ip_address = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] QuobyteHD.target_port = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] QuobyteHD.target_prefix = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] QuobyteHD.target_protocol = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] QuobyteHD.trace_flags = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] QuobyteHD.unique_fqdn_network = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] QuobyteHD.use_chap_auth = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] QuobyteHD.volume_clear = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] QuobyteHD.volume_clear_ionice = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] QuobyteHD.volume_clear_size = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] QuobyteHD.volumes_dir = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] oslo_messaging_rabbit.ssl = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] oslo_messaging_rabbit.ssl_version = {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] oslo_messaging_notifications.driver = [] {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] oslo_messaging_notifications.retry = -1 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] oslo_messaging_notifications.transport_url = **** {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] key_manager.fixed_key = **** {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] barbican.barbican_api_version = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] barbican.barbican_endpoint = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] barbican.barbican_endpoint_type = public {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] barbican.barbican_region_name = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] barbican.cafile = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] barbican.certfile = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] barbican.collect_timing = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] barbican.insecure = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] barbican.keyfile = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] barbican.number_of_retries = 60 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] barbican.retry_delay = 1 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] barbican.send_service_user_token = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] barbican.split_loggers = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] barbican.timeout = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] barbican.verify_ssl = True {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] barbican.verify_ssl_path = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] barbican_service_user.auth_section = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] barbican_service_user.auth_type = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] barbican_service_user.cafile = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] barbican_service_user.certfile = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] barbican_service_user.collect_timing = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] barbican_service_user.insecure = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] barbican_service_user.keyfile = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] barbican_service_user.split_loggers = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] barbican_service_user.timeout = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] vault.approle_role_id = **** {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] vault.approle_secret_id = **** {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] vault.kv_mountpoint = secret {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] vault.kv_path = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] vault.kv_version = 2 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] vault.namespace = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] vault.root_token_id = **** {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] vault.ssl_ca_crt_file = None {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] vault.timeout = 60.0 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] vault.use_ssl = False {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:04 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] ******************************************************************************** {{(pid=83525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Apr 29 15:03:05 devstack sudo[83817]: pam_unix(sudo:session): session closed for user root Apr 29 15:03:05 devstack cinder-volume[83734]: DEBUG oslo_concurrency.processutils [None req-39b9cb45-d463-48ff-b852-53c2b1cd9e40 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.848s {{(pid=83734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:03:05 devstack cinder-volume[83734]: INFO cinder.volume.drivers.quobyte [None req-39b9cb45-d463-48ff-b852-53c2b1cd9e40 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a succeeded Apr 29 15:03:05 devstack cinder-volume[83734]: DEBUG cinder.volume.drivers.quobyte [None req-39b9cb45-d463-48ff-b852-53c2b1cd9e40 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=83734) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:03:05 devstack cinder-volume[83734]: DEBUG oslo_concurrency.lockutils [None req-39b9cb45-d463-48ff-b852-53c2b1cd9e40 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.862s {{(pid=83734) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:03:05 devstack cinder-volume[83734]: DEBUG oslo_concurrency.processutils [None req-39b9cb45-d463-48ff-b852-53c2b1cd9e40 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=83734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:03:05 devstack sudo[83916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:03:05 devstack sudo[83916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:03:05 devstack sudo[83916]: pam_unix(sudo:session): session closed for user root Apr 29 15:03:05 devstack cinder-volume[83734]: DEBUG oslo_concurrency.processutils [None req-39b9cb45-d463-48ff-b852-53c2b1cd9e40 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.766s {{(pid=83734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:03:05 devstack cinder-volume[83734]: INFO cinder.volume.driver [None req-39b9cb45-d463-48ff-b852-53c2b1cd9e40 None None] Driver hasn't implemented _init_vendor_properties() Apr 29 15:03:05 devstack cinder-volume[83734]: DEBUG cinder.volume.driver [None req-39b9cb45-d463-48ff-b852-53c2b1cd9e40 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.583583831787, 'free_capacity_gb': 1775.583583831787, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83734) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 29 15:03:05 devstack cinder-volume[83734]: DEBUG oslo_db.sqlalchemy.engines [None req-39b9cb45-d463-48ff-b852-53c2b1cd9e40 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83734) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 15:03:05 devstack cinder-volume[83734]: DEBUG dbcounter [-] [83734] Writer thread running {{(pid=83734) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 29 15:03:05 devstack cinder-volume[83734]: DEBUG cinder.db.sqlalchemy.api [None req-39b9cb45-d463-48ff-b852-53c2b1cd9e40 None None] Building query based on filter {{(pid=83734) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 29 15:03:05 devstack cinder-volume[83734]: DEBUG cinder.image.image_utils [None req-39b9cb45-d463-48ff-b852-53c2b1cd9e40 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83734) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 29 15:03:05 devstack cinder-volume[83734]: INFO cinder.keymgr.migration [None req-9ec96a34-afa5-4982-a111-20e5da3596b7 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 29 15:03:05 devstack cinder-volume[83734]: DEBUG oslo_concurrency.lockutils [None req-39b9cb45-d463-48ff-b852-53c2b1cd9e40 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83734) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:03:05 devstack cinder-volume[83734]: DEBUG oslo_concurrency.lockutils [None req-39b9cb45-d463-48ff-b852-53c2b1cd9e40 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83734) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:03:05 devstack cinder-volume[83734]: DEBUG cinder.volume.drivers.quobyte [None req-39b9cb45-d463-48ff-b852-53c2b1cd9e40 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=83734) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:03:05 devstack cinder-volume[83734]: DEBUG cinder.volume.drivers.quobyte [None req-39b9cb45-d463-48ff-b852-53c2b1cd9e40 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=83734) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:03:05 devstack cinder-volume[83734]: DEBUG oslo_concurrency.lockutils [None req-39b9cb45-d463-48ff-b852-53c2b1cd9e40 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83734) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:03:05 devstack cinder-volume[83734]: DEBUG oslo_concurrency.processutils [None req-39b9cb45-d463-48ff-b852-53c2b1cd9e40 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=83734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:03:06 devstack sudo[83945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:03:06 devstack sudo[83945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:03:06 devstack sudo[83945]: pam_unix(sudo:session): session closed for user root Apr 29 15:03:06 devstack cinder-volume[83734]: DEBUG oslo_concurrency.processutils [None req-39b9cb45-d463-48ff-b852-53c2b1cd9e40 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 1.010s {{(pid=83734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:03:06 devstack cinder-volume[83734]: DEBUG cinder.manager [None req-39b9cb45-d463-48ff-b852-53c2b1cd9e40 None None] Notifying Schedulers of capabilities ... {{(pid=83734) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:03:07 devstack cinder-volume[83734]: INFO cinder.volume.manager [None req-39b9cb45-d463-48ff-b852-53c2b1cd9e40 None None] Driver initialization completed successfully. Apr 29 15:03:07 devstack cinder-volume[83734]: INFO cinder.manager [None req-39b9cb45-d463-48ff-b852-53c2b1cd9e40 None None] Initiating service 3 cleanup Apr 29 15:03:07 devstack cinder-volume[83734]: INFO cinder.manager [None req-39b9cb45-d463-48ff-b852-53c2b1cd9e40 None None] Service 3 cleanup completed. Apr 29 15:03:07 devstack cinder-volume[83734]: DEBUG cinder.service [None req-39b9cb45-d463-48ff-b852-53c2b1cd9e40 None None] Creating RPC server for service cinder-volume {{(pid=83734) start /opt/stack/cinder/cinder/service.py:231}} Apr 29 15:03:07 devstack cinder-volume[83734]: DEBUG cinder.service [None req-39b9cb45-d463-48ff-b852-53c2b1cd9e40 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83734) start /opt/stack/cinder/cinder/service.py:237}} Apr 29 15:03:07 devstack cinder-volume[83734]: INFO cinder.volume.manager [None req-39b9cb45-d463-48ff-b852-53c2b1cd9e40 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 29 15:03:07 devstack cinder-volume[83734]: DEBUG oslo_concurrency.lockutils [None req-39b9cb45-d463-48ff-b852-53c2b1cd9e40 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83734) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:03:07 devstack cinder-volume[83734]: DEBUG oslo_concurrency.lockutils [None req-39b9cb45-d463-48ff-b852-53c2b1cd9e40 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83734) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:03:07 devstack cinder-volume[83734]: DEBUG cinder.volume.drivers.quobyte [None req-39b9cb45-d463-48ff-b852-53c2b1cd9e40 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=83734) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:03:07 devstack cinder-volume[83734]: DEBUG cinder.volume.drivers.quobyte [None req-39b9cb45-d463-48ff-b852-53c2b1cd9e40 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=83734) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:03:07 devstack cinder-volume[83734]: DEBUG oslo_concurrency.lockutils [None req-39b9cb45-d463-48ff-b852-53c2b1cd9e40 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83734) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:03:07 devstack cinder-volume[83734]: DEBUG oslo_concurrency.processutils [None req-39b9cb45-d463-48ff-b852-53c2b1cd9e40 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=83734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:03:07 devstack sudo[84029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:03:07 devstack sudo[84029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:03:08 devstack sudo[84029]: pam_unix(sudo:session): session closed for user root Apr 29 15:03:08 devstack cinder-volume[83734]: DEBUG oslo_concurrency.processutils [None req-39b9cb45-d463-48ff-b852-53c2b1cd9e40 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.751s {{(pid=83734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:03:08 devstack cinder-volume[83734]: INFO cinder.volume.manager [None req-39b9cb45-d463-48ff-b852-53c2b1cd9e40 None None] Driver post RPC initialization completed successfully. Apr 29 15:03:10 devstack cinder-volume[83734]: DEBUG oslo_concurrency.lockutils [None req-bb0ca308-6d3b-4138-8ad7-108fc61a8fbb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83734) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:03:10 devstack cinder-volume[83734]: DEBUG oslo_concurrency.lockutils [None req-bb0ca308-6d3b-4138-8ad7-108fc61a8fbb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83734) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:03:10 devstack cinder-volume[83734]: DEBUG cinder.volume.drivers.quobyte [None req-bb0ca308-6d3b-4138-8ad7-108fc61a8fbb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=83734) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:03:10 devstack cinder-volume[83734]: DEBUG cinder.volume.drivers.quobyte [None req-bb0ca308-6d3b-4138-8ad7-108fc61a8fbb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=83734) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:03:10 devstack cinder-volume[83734]: DEBUG oslo_concurrency.lockutils [None req-bb0ca308-6d3b-4138-8ad7-108fc61a8fbb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83734) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:03:10 devstack cinder-volume[83734]: DEBUG oslo_concurrency.processutils [None req-bb0ca308-6d3b-4138-8ad7-108fc61a8fbb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=83734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:03:10 devstack sudo[84083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:03:10 devstack sudo[84083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:03:11 devstack sudo[84083]: pam_unix(sudo:session): session closed for user root Apr 29 15:03:11 devstack cinder-volume[83734]: DEBUG oslo_concurrency.processutils [None req-bb0ca308-6d3b-4138-8ad7-108fc61a8fbb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.549s {{(pid=83734) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:03:11 devstack cinder-volume[83734]: DEBUG cinder.manager [None req-bb0ca308-6d3b-4138-8ad7-108fc61a8fbb None None] Notifying Schedulers of capabilities ... {{(pid=83734) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:03:11 devstack cinder-volume[83525]: INFO oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] Caught SIGTERM, stopping children Apr 29 15:03:11 devstack cinder-volume[83525]: DEBUG oslo_concurrency.lockutils [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] Acquiring lock "singleton_lock" {{(pid=83525) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 29 15:03:11 devstack cinder-volume[83525]: DEBUG oslo_concurrency.lockutils [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] Acquired lock "singleton_lock" {{(pid=83525) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 29 15:03:11 devstack cinder-volume[83525]: DEBUG oslo_concurrency.lockutils [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] Releasing lock "singleton_lock" {{(pid=83525) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 29 15:03:11 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] Stop services. {{(pid=83525) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 29 15:03:11 devstack cinder-volume[83525]: DEBUG oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] Killing children. {{(pid=83525) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 29 15:03:11 devstack cinder-volume[83525]: INFO oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] Waiting on 1 children to exit Apr 29 15:03:15 devstack cinder-volume[83734]: DEBUG oslo_concurrency.lockutils [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] Acquiring lock "singleton_lock" {{(pid=83734) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 29 15:03:15 devstack cinder-volume[83734]: DEBUG oslo_concurrency.lockutils [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] Acquired lock "singleton_lock" {{(pid=83734) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 29 15:03:15 devstack cinder-volume[83734]: DEBUG oslo_concurrency.lockutils [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] Releasing lock "singleton_lock" {{(pid=83734) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 29 15:03:15 devstack cinder-volume[83734]: WARNING amqp [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 29 15:03:15 devstack cinder-volume[83734]: WARNING amqp [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 29 15:03:15 devstack cinder-volume[83525]: INFO oslo_service.backend._eventlet.service [None req-54becea9-4d1b-456b-8533-d242513b0527 None None] Child 83734 exited with status 0 Apr 29 15:03:18 devstack cinder-volume[84188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=84188) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 29 15:03:18 devstack cinder-volume[84188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=84188) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 29 15:03:18 devstack cinder-volume[84188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=84188) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 29 15:03:19 devstack cinder-volume[84188]: INFO dbcounter [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] Registered counter for database cinder Apr 29 15:03:19 devstack cinder-volume[84188]: DEBUG oslo_db.sqlalchemy.engines [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84188) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 15:03:19 devstack cinder-volume[84188]: DEBUG dbcounter [-] [84188] Writer thread running {{(pid=84188) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 29 15:03:19 devstack cinder-volume[84188]: INFO cinder.rpc [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 29 15:03:19 devstack cinder-volume[84188]: INFO cinder.rpc [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 29 15:03:19 devstack cinder-volume[84188]: DEBUG oslo_db.sqlalchemy.engines [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84188) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 15:03:20 devstack cinder-volume[84188]: INFO cinder.volume.manager [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] Determined volume DB was empty at startup. Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG cinder.volume.manager [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=84188) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 29 15:03:20 devstack cinder-volume[84188]: WARNING stevedore.named [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 29 15:03:20 devstack cinder-volume[84188]: WARNING castellan.key_manager [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 29 15:03:20 devstack cinder-volume[84188]: WARNING cinder.keymgr.conf_key_mgr [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 29 15:03:20 devstack cinder-volume[84188]: INFO cinder.volume.manager [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_db.sqlalchemy.engines [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84188) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 15:03:20 devstack cinder-volume[84188]: INFO oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] Starting 1 workers Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] Started child 84448 {{(pid=84188) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] Full set of CONF: {{(pid=84188) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] ******************************************************************************** {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] Configuration options gathered from: {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] ================================================================================ {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] allow_availability_zone_fallback = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] allow_compression_on_image_upload = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] allowed_direct_url_schemes = [] {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] api_rate_limit = True {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] auth_strategy = keystone {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backend_availability_zone = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backend_host = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backend_name = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backend_stats_polling_interval = 60 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backup_api_class = cinder.backup.api.API {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backup_name_template = backup-%s {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backup_use_same_host = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backup_use_temp_snapshot = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] chap_password = **** {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] chap_username = {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84448]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] cinder_internal_tenant_project_id = 4576d27b7a8e4f74bfed45b5b74588bc {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] cinder_internal_tenant_user_id = 7a0144856f9b4206b9969013745dfd09 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] cluster = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] compression_format = gzip {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] compute_api_class = cinder.compute.nova.API {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] config_dir = [] {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] config_source = [] {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] control_exchange = openstack {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] debug = True {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] default_availability_zone = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] default_group_type = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] default_volume_type = QuobyteHD {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] disk_geometry = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] driver_client_cert = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] driver_client_cert_key = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] driver_data_namespace = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] driver_ssl_cert_path = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] driver_ssl_cert_verify = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] driver_use_ssl = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] enable_new_services = True {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] enable_unsupported_driver = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] enabled_backends = ['QuobyteHD'] {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] enforce_multipath_for_image_xfer = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] filter_function = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] glance_api_insecure = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] glance_api_servers = ['http://192.168.122.236/image'] {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] glance_api_ssl_compression = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] glance_ca_certificates_file = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] glance_catalog_info = image:glance:publicURL {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] glance_certfile = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] glance_keyfile = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] glance_num_retries = 3 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] glance_request_timeout = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] goodness_function = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] graceful_shutdown_timeout = 5 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] group_api_class = cinder.group.api.API {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] host = devstack {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] image_compress_on_upload = True {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] image_conversion_address_space_limit = 1 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] image_conversion_cpu_limit = 60 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] image_conversion_disable = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] image_upload_use_cinder_backend = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] image_upload_use_internal_tenant = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] image_volume_cache_enabled = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] image_volume_cache_max_count = 0 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] image_volume_cache_max_size_gb = 0 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] init_host_max_objects_retrieval = 0 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] instance_format = [instance: %(uuid)s] {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] iscsi_target_flags = {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] iscsi_write_cache = on {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] iser_helper = tgtadm {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] iser_ip_address = 192.168.122.236 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] iser_port = 3260 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] log_color = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] log_config_append = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] log_dir = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] log_file = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] log_options = True {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] log_rotate_interval = 1 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] log_rotate_interval_type = days {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] log_rotation_type = none {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] max_age = 0 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] max_logfile_count = 30 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] max_logfile_size_mb = 200 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] max_over_subscription_ratio = 20.0 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] message_reap_interval = 86400 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] message_ttl = 2592000 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] migration_create_volume_timeout_secs = 300 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] monkey_patch = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] monkey_patch_modules = [] {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] my_ip = 192.168.122.236 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] no_snapshot_gb_quota = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] num_iser_scan_tries = 3 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] num_shell_tries = 3 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] num_volume_device_scan_tries = 3 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] nvmeof_conn_info_version = 1 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] nvmet_ns_id = 10 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] nvmet_port_id = 1 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] osapi_max_limit = 1000 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] osapi_volume_ext_list = [] {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] osapi_volume_listen = 0.0.0.0 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack quobyte-client[84449]: Reading configuration file: /etc/quobyte/client.cfg Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] osapi_volume_listen_port = 8776 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] osapi_volume_use_ssl = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] osapi_volume_workers = 2 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] per_volume_size_limit = -1 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] periodic_fuzzy_delay = 60 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] periodic_interval = 60 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] project_id_regex = [0-9a-f\-]+ {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack quobyte-client[84449]: Invalid parameters found, error: missing mount point. Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] public_endpoint = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] publish_errors = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] quota_backup_gigabytes = 1000 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] quota_backups = 10 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] quota_gigabytes = 1000 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] quota_groups = 10 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack quobyte-client[84449]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] quota_snapshots = 10 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] quota_volumes = 10 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] rate_limit_burst = 0 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] rate_limit_except_level = CRITICAL {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] rate_limit_interval = 0 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] reinit_driver_count = 3 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] replication_device = **** {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack quobyte-client[84449]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] report_discard_supported = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] report_interval = 120 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] reservation_clean_interval = 86400 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] reservation_expire = 86400 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] reserved_image_namespaces = [] {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] reserved_percentage = 0 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] rpc_response_timeout = 120 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] run_external_periodic_tasks = True {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] scst_target_driver = iscsi {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] scst_target_iqn_name = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] service_down_time = 720 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] shell_completion = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] snapshot_name_template = snapshot-%s {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-6c8eb9d1-a5ed-4c60-9471-986bfe3f6e88 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] split_loggers = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] state_path = /opt/stack/data/cinder {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-6c8eb9d1-a5ed-4c60-9471-986bfe3f6e88 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=84448) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] storage_availability_zone = nova {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] storage_protocol = iSCSI {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] syslog_log_facility = LOG_USER {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] target_helper = lioadm {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] target_ip_address = 192.168.122.236 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] target_port = 3260 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] target_protocol = iscsi {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] target_secondary_ip_addresses = [] {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] trace_flags = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] transfer_api_class = cinder.transfer.api.API {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] transport_url = **** {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] until_refresh = 0 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] use_chap_auth = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] use_default_quota_class = True {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] use_journal = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] use_json = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] use_multipath_for_image_xfer = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] use_stderr = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] use_syslog = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] verify_glance_signatures = enabled {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] volume_api_class = cinder.volume.api.API {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] volume_backend_name = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] volume_clear = zero {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] volume_clear_ionice = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] volume_clear_size = 0 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] volume_copy_bps_limit = 0 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] volume_dd_blocksize = 1M {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] volume_name_template = volume-%s {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] volume_service_inithost_offload = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] volume_usage_audit_period = month {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] zoning_mode = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] oslo_concurrency.disable_process_locking = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] keystone_authtoken.admin_password = **** {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] keystone_authtoken.admin_token = **** {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] keystone_authtoken.admin_user = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] keystone_authtoken.auth_admin_prefix = {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] keystone_authtoken.auth_port = 35357 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] keystone_authtoken.auth_protocol = https {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] keystone_authtoken.auth_section = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] keystone_authtoken.auth_type = password {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] keystone_authtoken.auth_uri = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] keystone_authtoken.auth_version = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] keystone_authtoken.cache = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] keystone_authtoken.certfile = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] keystone_authtoken.delay_auth_decision = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] keystone_authtoken.http_connect_timeout = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] keystone_authtoken.identity_uri = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] keystone_authtoken.include_service_catalog = True {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] keystone_authtoken.insecure = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] keystone_authtoken.interface = public {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] keystone_authtoken.keyfile = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] keystone_authtoken.memcache_password = {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] keystone_authtoken.memcache_username = {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] keystone_authtoken.region_name = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] keystone_authtoken.service_token_roles_required = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] keystone_authtoken.service_type = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] keystone_authtoken.token_cache_time = 300 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.236/identity {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] cache.backend = dogpile.cache.null {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] cache.backend_argument = **** {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] cache.backend_expiration_time = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] cache.config_prefix = cache.oslo {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] cache.debug_cache_backend = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] cache.enable_retry_client = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] cache.enable_socket_keepalive = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] cache.enabled = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] cache.enforce_fips_mode = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] cache.expiration_time = 600 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] cache.hashclient_retry_attempts = 2 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] cache.memcache_dead_retry = 300 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] cache.memcache_pool_maxsize = 10 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] cache.memcache_sasl_enabled = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] cache.password = **** {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] cache.proxies = [] {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] cache.redis_db = 0 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] cache.redis_sentinel_service_name = mymaster {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] cache.redis_server = localhost:6379 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] cache.retry_attempts = 2 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] cache.retry_delay = 0.0 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] cache.socket_keepalive_count = 1 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack sudo[84450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] cache.socket_keepalive_idle = 1 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] cache.socket_keepalive_interval = 1 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] cache.socket_timeout = 1.0 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] cache.tls_allowed_ciphers = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] cache.tls_cafile = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] cache.tls_certfile = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] cache.tls_enabled = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack sudo[84450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] cache.tls_keyfile = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] cache.username = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] coordination.backend_url = **** {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] database.asyncio_connection = **** {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] database.asyncio_slave_connection = **** {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] database.backend = sqlalchemy {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] database.connection = **** {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] database.connection_debug = 0 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] database.connection_parameters = {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] database.connection_recycle_time = 3600 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] database.connection_trace = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] database.db_inc_retry_interval = True {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] database.db_max_retries = 20 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] database.db_max_retry_interval = 10 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] database.db_retry_interval = 1 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] database.max_overflow = 50 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] database.max_pool_size = 5 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] database.max_retries = 10 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] database.mysql_wsrep_sync_wait = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] database.pool_timeout = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] database.retry_interval = 10 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] database.slave_connection = **** {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] database.sqlite_synchronous = True {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] database.synchronous_reader = True {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] database.use_db_reconnect = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] profiler.connection_string = messaging:// {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] profiler.enabled = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] profiler.es_doc_type = notification {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] profiler.es_scroll_size = 10000 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] profiler.es_scroll_time = 2m {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] profiler.filter_error_trace = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] profiler.hmac_keys = **** {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] profiler.sentinel_service_name = mymaster {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] profiler.socket_timeout = 0.1 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] profiler.trace_requests = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] profiler.trace_sqlalchemy = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] profiler_jaeger.process_tags = {} {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] profiler_jaeger.service_name_prefix = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] profiler_otlp.service_name_prefix = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] oslo_policy.enforce_new_defaults = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: WARNING oslo_config.cfg [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] oslo_policy.enforce_scope = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] oslo_policy.policy_default_rule = default {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] oslo_policy.policy_file = policy.yaml {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] oslo_policy.remote_timeout = 60.0 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] privsep_osbrick.group = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] privsep_osbrick.helper_command = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] privsep_osbrick.user = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] cinder_sys_admin.group = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] cinder_sys_admin.helper_command = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] cinder_sys_admin.user = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] service_user.auth_section = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] service_user.auth_type = password {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] service_user.cafile = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] service_user.certfile = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] service_user.collect_timing = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] service_user.insecure = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] service_user.keyfile = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] service_user.send_service_user_token = True {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] service_user.split_loggers = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] service_user.timeout = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] glance.auth_section = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] glance.auth_type = password {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] glance.certfile = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] glance.collect_timing = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] glance.insecure = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] glance.keyfile = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] glance.region_name = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] glance.split_loggers = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] glance.timeout = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backend_defaults.backend_availability_zone = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backend_defaults.chap_password = **** {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backend_defaults.chap_username = {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backend_defaults.disk_geometry = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backend_defaults.driver_client_cert = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backend_defaults.driver_client_cert_key = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backend_defaults.driver_data_namespace = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backend_defaults.driver_use_ssl = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backend_defaults.enable_unsupported_driver = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backend_defaults.extra_capabilities = {} {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backend_defaults.filter_function = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backend_defaults.goodness_function = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backend_defaults.iscsi_target_flags = {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backend_defaults.iscsi_write_cache = on {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backend_defaults.iser_helper = tgtadm {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backend_defaults.iser_ip_address = 192.168.122.236 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backend_defaults.iser_port = 3260 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backend_defaults.nas_host = {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backend_defaults.nas_login = admin {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backend_defaults.nas_mount_options = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backend_defaults.nas_password = **** {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backend_defaults.nas_private_key = {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backend_defaults.nas_share_path = {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backend_defaults.nas_ssh_port = 22 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backend_defaults.num_shell_tries = 3 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backend_defaults.nvmet_port_id = 1 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backend_defaults.quobyte_client_cfg = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-6c8eb9d1-a5ed-4c60-9471-986bfe3f6e88 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=84448) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backend_defaults.quobyte_volume_url = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backend_defaults.replication_device = **** {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backend_defaults.report_discard_supported = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backend_defaults.reserved_percentage = 0 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backend_defaults.scst_target_driver = iscsi {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backend_defaults.scst_target_iqn_name = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backend_defaults.storage_protocol = iSCSI {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84448]: WARNING cinder.volume.drivers.quobyte [None req-6c8eb9d1-a5ed-4c60-9471-986bfe3f6e88 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backend_defaults.target_helper = tgtadm {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84448]: WARNING cinder.volume.drivers.quobyte [None req-6c8eb9d1-a5ed-4c60-9471-986bfe3f6e88 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backend_defaults.target_ip_address = 192.168.122.236 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backend_defaults.target_port = 3260 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backend_defaults.target_protocol = iscsi {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6c8eb9d1-a5ed-4c60-9471-986bfe3f6e88 None None] Running cmd (subprocess): mount.quobyte {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backend_defaults.trace_flags = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backend_defaults.unique_fqdn_network = True {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backend_defaults.use_chap_auth = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backend_defaults.volume_backend_name = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backend_defaults.volume_clear = zero {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backend_defaults.volume_clear_ionice = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backend_defaults.volume_clear_size = 0 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] oslo_reports.file_event_handler = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] oslo_reports.log_dir = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] QuobyteHD.backend_availability_zone = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] QuobyteHD.backend_host = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] QuobyteHD.chap_password = **** {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] QuobyteHD.chap_username = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] QuobyteHD.chiscsi_conf = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] QuobyteHD.disk_geometry = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] QuobyteHD.driver_client_cert = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] QuobyteHD.driver_client_cert_key = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] QuobyteHD.driver_data_namespace = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] QuobyteHD.driver_use_ssl = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] QuobyteHD.extra_capabilities = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] QuobyteHD.filter_function = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] QuobyteHD.goodness_function = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] QuobyteHD.iscsi_target_flags = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] QuobyteHD.iscsi_write_cache = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] QuobyteHD.iser_helper = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] QuobyteHD.iser_ip_address = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] QuobyteHD.iser_port = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] QuobyteHD.iser_target_prefix = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] QuobyteHD.nas_host = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] QuobyteHD.nas_login = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] QuobyteHD.nas_mount_options = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] QuobyteHD.nas_password = **** {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] QuobyteHD.nas_private_key = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] QuobyteHD.nas_share_path = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] QuobyteHD.nas_ssh_port = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] QuobyteHD.num_shell_tries = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] QuobyteHD.nvmet_ns_id = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] QuobyteHD.nvmet_port_id = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] QuobyteHD.replication_device = **** {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] QuobyteHD.report_discard_supported = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] QuobyteHD.reserved_percentage = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] QuobyteHD.scst_target_driver = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] QuobyteHD.storage_protocol = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] QuobyteHD.target_helper = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] QuobyteHD.target_ip_address = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] QuobyteHD.target_port = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] QuobyteHD.target_prefix = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] QuobyteHD.target_protocol = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] QuobyteHD.trace_flags = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] QuobyteHD.unique_fqdn_network = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] QuobyteHD.use_chap_auth = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] QuobyteHD.volume_clear = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] QuobyteHD.volume_clear_ionice = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] QuobyteHD.volume_clear_size = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] QuobyteHD.volumes_dir = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] oslo_messaging_rabbit.ssl = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] oslo_messaging_rabbit.ssl_version = {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] oslo_messaging_notifications.driver = [] {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] oslo_messaging_notifications.retry = -1 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] oslo_messaging_notifications.transport_url = **** {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] key_manager.fixed_key = **** {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] barbican.barbican_api_version = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] barbican.barbican_endpoint = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] barbican.barbican_endpoint_type = public {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] barbican.barbican_region_name = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] barbican.cafile = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] barbican.certfile = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] barbican.collect_timing = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] barbican.insecure = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] barbican.keyfile = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] barbican.number_of_retries = 60 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] barbican.retry_delay = 1 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] barbican.send_service_user_token = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] barbican.split_loggers = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] barbican.timeout = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] barbican.verify_ssl = True {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] barbican.verify_ssl_path = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] barbican_service_user.auth_section = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] barbican_service_user.auth_type = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] barbican_service_user.cafile = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] barbican_service_user.certfile = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] barbican_service_user.collect_timing = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] barbican_service_user.insecure = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] barbican_service_user.keyfile = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] barbican_service_user.split_loggers = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] barbican_service_user.timeout = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] vault.approle_role_id = **** {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] vault.approle_secret_id = **** {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] vault.kv_mountpoint = secret {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] vault.kv_path = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] vault.kv_version = 2 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] vault.namespace = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] vault.root_token_id = **** {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] vault.ssl_ca_crt_file = None {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] vault.timeout = 60.0 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] vault.use_ssl = False {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 15:03:20 devstack cinder-volume[84188]: DEBUG oslo_service.backend._eventlet.service [None req-517a5b3e-f6c4-4b92-9cc1-7f84e20eed17 None None] ******************************************************************************** {{(pid=84188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Apr 29 15:03:20 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6c8eb9d1-a5ed-4c60-9471-986bfe3f6e88 None None] CMD "mount.quobyte" returned: 1 in 0.098s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:03:20 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-6c8eb9d1-a5ed-4c60-9471-986bfe3f6e88 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:03:20 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-6c8eb9d1-a5ed-4c60-9471-986bfe3f6e88 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:03:20 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-6c8eb9d1-a5ed-4c60-9471-986bfe3f6e88 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:03:20 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-6c8eb9d1-a5ed-4c60-9471-986bfe3f6e88 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:03:20 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-6c8eb9d1-a5ed-4c60-9471-986bfe3f6e88 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:03:20 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6c8eb9d1-a5ed-4c60-9471-986bfe3f6e88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:03:20 devstack sudo[84450]: pam_unix(sudo:session): session closed for user root Apr 29 15:03:20 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6c8eb9d1-a5ed-4c60-9471-986bfe3f6e88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.591s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:03:20 devstack cinder-volume[84448]: INFO cinder.volume.driver [None req-6c8eb9d1-a5ed-4c60-9471-986bfe3f6e88 None None] Driver hasn't implemented _init_vendor_properties() Apr 29 15:03:20 devstack cinder-volume[84448]: DEBUG cinder.volume.driver [None req-6c8eb9d1-a5ed-4c60-9471-986bfe3f6e88 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.583583831787, 'free_capacity_gb': 1775.583583831787, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=84448) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 29 15:03:20 devstack cinder-volume[84448]: DEBUG oslo_db.sqlalchemy.engines [None req-6c8eb9d1-a5ed-4c60-9471-986bfe3f6e88 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84448) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 15:03:21 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writer thread running {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 29 15:03:21 devstack cinder-volume[84448]: DEBUG cinder.db.sqlalchemy.api [None req-6c8eb9d1-a5ed-4c60-9471-986bfe3f6e88 None None] Building query based on filter {{(pid=84448) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 29 15:03:21 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [None req-6c8eb9d1-a5ed-4c60-9471-986bfe3f6e88 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=84448) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 29 15:03:21 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-6c8eb9d1-a5ed-4c60-9471-986bfe3f6e88 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:03:21 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-6c8eb9d1-a5ed-4c60-9471-986bfe3f6e88 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:03:21 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-6c8eb9d1-a5ed-4c60-9471-986bfe3f6e88 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:03:21 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-6c8eb9d1-a5ed-4c60-9471-986bfe3f6e88 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:03:21 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-6c8eb9d1-a5ed-4c60-9471-986bfe3f6e88 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:03:21 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6c8eb9d1-a5ed-4c60-9471-986bfe3f6e88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:03:21 devstack cinder-volume[84448]: INFO cinder.keymgr.migration [None req-c34496ec-8f1f-4c73-ac83-cd86e71735da None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 29 15:03:21 devstack sudo[84454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:03:21 devstack sudo[84454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:03:21 devstack sudo[84454]: pam_unix(sudo:session): session closed for user root Apr 29 15:03:21 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6c8eb9d1-a5ed-4c60-9471-986bfe3f6e88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.567s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:03:21 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-6c8eb9d1-a5ed-4c60-9471-986bfe3f6e88 None None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:03:21 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-6c8eb9d1-a5ed-4c60-9471-986bfe3f6e88 None None] Driver initialization completed successfully. Apr 29 15:03:21 devstack cinder-volume[84448]: INFO cinder.manager [None req-6c8eb9d1-a5ed-4c60-9471-986bfe3f6e88 None None] Initiating service 3 cleanup Apr 29 15:03:21 devstack cinder-volume[84448]: INFO cinder.manager [None req-6c8eb9d1-a5ed-4c60-9471-986bfe3f6e88 None None] Service 3 cleanup completed. Apr 29 15:03:21 devstack cinder-volume[84448]: DEBUG cinder.service [None req-6c8eb9d1-a5ed-4c60-9471-986bfe3f6e88 None None] Creating RPC server for service cinder-volume {{(pid=84448) start /opt/stack/cinder/cinder/service.py:231}} Apr 29 15:03:21 devstack cinder-volume[84448]: DEBUG cinder.service [None req-6c8eb9d1-a5ed-4c60-9471-986bfe3f6e88 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=84448) start /opt/stack/cinder/cinder/service.py:237}} Apr 29 15:03:21 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-6c8eb9d1-a5ed-4c60-9471-986bfe3f6e88 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 29 15:03:21 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-6c8eb9d1-a5ed-4c60-9471-986bfe3f6e88 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:03:21 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-6c8eb9d1-a5ed-4c60-9471-986bfe3f6e88 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:03:21 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-6c8eb9d1-a5ed-4c60-9471-986bfe3f6e88 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:03:21 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-6c8eb9d1-a5ed-4c60-9471-986bfe3f6e88 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:03:21 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-6c8eb9d1-a5ed-4c60-9471-986bfe3f6e88 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:03:21 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6c8eb9d1-a5ed-4c60-9471-986bfe3f6e88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:03:21 devstack sudo[84459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:03:21 devstack sudo[84459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:03:22 devstack sudo[84459]: pam_unix(sudo:session): session closed for user root Apr 29 15:03:22 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6c8eb9d1-a5ed-4c60-9471-986bfe3f6e88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.585s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:03:22 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-6c8eb9d1-a5ed-4c60-9471-986bfe3f6e88 None None] Driver post RPC initialization completed successfully. Apr 29 15:03:30 devstack cinder-volume[84188]: DEBUG dbcounter [-] [84188] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=84188) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:03:31 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:SELECT=3 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:03:32 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:04:18 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ae479a3-d901-46b5-980f-e6a1b5fa730f tempest-TaggedBootDevicesTest-203877183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:04:18 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4ae479a3-d901-46b5-980f-e6a1b5fa730f tempest-TaggedBootDevicesTest-203877183 None] Flow 'volume_create_manager' (d04c8cdd-6eb8-4012-bf87-c8cebf62a51d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:04:18 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4ae479a3-d901-46b5-980f-e6a1b5fa730f tempest-TaggedBootDevicesTest-203877183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c567c96c-b175-4dc6-98b8-b5a9e0d0a900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:04:18 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4ae479a3-d901-46b5-980f-e6a1b5fa730f tempest-TaggedBootDevicesTest-203877183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c567c96c-b175-4dc6-98b8-b5a9e0d0a900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:04:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1966621783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3249b149-35ec-4604-a2c5-04dd4a504dc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f88d76e597ff45609108b0d6571b165a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:04:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:04:19Z,use_quota=True,user_id='3d34992abf2a4065b996657b51f11319',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:04:18 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4ae479a3-d901-46b5-980f-e6a1b5fa730f tempest-TaggedBootDevicesTest-203877183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2bfaec6-b54b-4618-babb-ebc145945f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:04:18 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4ae479a3-d901-46b5-980f-e6a1b5fa730f tempest-TaggedBootDevicesTest-203877183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2bfaec6-b54b-4618-babb-ebc145945f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:04:18 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4ae479a3-d901-46b5-980f-e6a1b5fa730f tempest-TaggedBootDevicesTest-203877183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69333efd-cb9e-4a57-ab4e-2d408b9edfed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:04:18 devstack cinder-volume[84448]: DEBUG cinder.image.glance [None req-4ae479a3-d901-46b5-980f-e6a1b5fa730f tempest-TaggedBootDevicesTest-203877183 None] Creating Keystone auth plugin from conf {{(pid=84448) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 29 15:04:18 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-d147b372-851c-42a4-a6a3-e2ab9b0c503f tempest-TaggedAttachmentsTest-450372533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:04:18 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-d147b372-851c-42a4-a6a3-e2ab9b0c503f tempest-TaggedAttachmentsTest-450372533 None] Flow 'volume_create_manager' (ae9f47fb-98f1-48b2-889a-de7457379a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:04:18 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-d147b372-851c-42a4-a6a3-e2ab9b0c503f tempest-TaggedAttachmentsTest-450372533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2410a64-c74c-42ac-894b-e63d3877fca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:04:18 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-d147b372-851c-42a4-a6a3-e2ab9b0c503f tempest-TaggedAttachmentsTest-450372533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2410a64-c74c-42ac-894b-e63d3877fca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:04:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-789600585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=406c0ce9-1031-4251-8aab-fc8ac1c94d10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79c23b35213c42bd8a7f2197991852eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:04:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:04:19Z,use_quota=True,user_id='07ddfc8668ae488c80909c732bcaccb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:04:18 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-d147b372-851c-42a4-a6a3-e2ab9b0c503f tempest-TaggedAttachmentsTest-450372533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c98e5cb-def8-477e-ae9a-b28ff440c94d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:04:18 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-d147b372-851c-42a4-a6a3-e2ab9b0c503f tempest-TaggedAttachmentsTest-450372533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c98e5cb-def8-477e-ae9a-b28ff440c94d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:04:18 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-d147b372-851c-42a4-a6a3-e2ab9b0c503f tempest-TaggedAttachmentsTest-450372533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4cb99f9-dc9d-4488-912a-70a3f97c8749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:04:18 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-d147b372-851c-42a4-a6a3-e2ab9b0c503f tempest-TaggedAttachmentsTest-450372533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4cb99f9-dc9d-4488-912a-70a3f97c8749) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '406c0ce9-1031-4251-8aab-fc8ac1c94d10', 'volume_name': 'volume-406c0ce9-1031-4251-8aab-fc8ac1c94d10', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:04:18 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-d147b372-851c-42a4-a6a3-e2ab9b0c503f tempest-TaggedAttachmentsTest-450372533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2720516-081d-4cdf-b7f2-eb889a34c50c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:04:18 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-d147b372-851c-42a4-a6a3-e2ab9b0c503f tempest-TaggedAttachmentsTest-450372533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2720516-081d-4cdf-b7f2-eb889a34c50c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:04:18 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-d147b372-851c-42a4-a6a3-e2ab9b0c503f tempest-TaggedAttachmentsTest-450372533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (503aeb56-47e6-4cc1-a8ca-ee7f151a64e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:04:18 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-d147b372-851c-42a4-a6a3-e2ab9b0c503f tempest-TaggedAttachmentsTest-450372533 None] Volume 406c0ce9-1031-4251-8aab-fc8ac1c94d10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-406c0ce9-1031-4251-8aab-fc8ac1c94d10', 'volume_size': 1} Apr 29 15:04:18 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-d147b372-851c-42a4-a6a3-e2ab9b0c503f tempest-TaggedAttachmentsTest-450372533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:04:18 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-d147b372-851c-42a4-a6a3-e2ab9b0c503f tempest-TaggedAttachmentsTest-450372533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:04:18 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-d147b372-851c-42a4-a6a3-e2ab9b0c503f tempest-TaggedAttachmentsTest-450372533 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:04:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-789600585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=406c0ce9-1031-4251-8aab-fc8ac1c94d10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79c23b35213c42bd8a7f2197991852eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:04:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:04:19Z,use_quota=True,user_id='07ddfc8668ae488c80909c732bcaccb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:04:18 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-d147b372-851c-42a4-a6a3-e2ab9b0c503f tempest-TaggedAttachmentsTest-450372533 None] Creating volume 406c0ce9-1031-4251-8aab-fc8ac1c94d10 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:04:18 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-d147b372-851c-42a4-a6a3-e2ab9b0c503f tempest-TaggedAttachmentsTest-450372533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:04:18 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-d147b372-851c-42a4-a6a3-e2ab9b0c503f tempest-TaggedAttachmentsTest-450372533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:04:18 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-d147b372-851c-42a4-a6a3-e2ab9b0c503f tempest-TaggedAttachmentsTest-450372533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:04:18 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-d147b372-851c-42a4-a6a3-e2ab9b0c503f tempest-TaggedAttachmentsTest-450372533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:04:18 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-d147b372-851c-42a4-a6a3-e2ab9b0c503f tempest-TaggedAttachmentsTest-450372533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:04:18 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-d147b372-851c-42a4-a6a3-e2ab9b0c503f tempest-TaggedAttachmentsTest-450372533 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:04:18 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-d147b372-851c-42a4-a6a3-e2ab9b0c503f tempest-TaggedAttachmentsTest-450372533 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:04:18 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-d147b372-851c-42a4-a6a3-e2ab9b0c503f tempest-TaggedAttachmentsTest-450372533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-406c0ce9-1031-4251-8aab-fc8ac1c94d10 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:04:18 devstack sudo[84566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-406c0ce9-1031-4251-8aab-fc8ac1c94d10 1073741824 Apr 29 15:04:18 devstack sudo[84566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:04:19 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4ae479a3-d901-46b5-980f-e6a1b5fa730f tempest-TaggedBootDevicesTest-203877183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69333efd-cb9e-4a57-ab4e-2d408b9edfed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3249b149-35ec-4604-a2c5-04dd4a504dc8', 'volume_name': 'volume-3249b149-35ec-4604-a2c5-04dd4a504dc8', 'volume_size': 1, 'image_id': 'ad86f424-7d2a-4f3b-9577-890075e7dc72', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ad86f424-7d2a-4f3b-9577-890075e7dc72', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '33db0ca5091747b1a3438d70bf53390c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ad86f424-7d2a-4f3b-9577-890075e7dc72', 'created_at': datetime.datetime(2026, 4, 29, 13, 0, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 13, 0, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ad86f424-7d2a-4f3b-9577-890075e7dc72/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:04:19 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4ae479a3-d901-46b5-980f-e6a1b5fa730f tempest-TaggedBootDevicesTest-203877183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (277b811c-505b-44c2-84e8-cccdbf31372a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:04:19 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4ae479a3-d901-46b5-980f-e6a1b5fa730f tempest-TaggedBootDevicesTest-203877183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (277b811c-505b-44c2-84e8-cccdbf31372a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:04:19 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4ae479a3-d901-46b5-980f-e6a1b5fa730f tempest-TaggedBootDevicesTest-203877183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (075a95e2-ce08-4e1e-bc55-1ae9aae01859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:04:19 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-4ae479a3-d901-46b5-980f-e6a1b5fa730f tempest-TaggedBootDevicesTest-203877183 None] Volume 3249b149-35ec-4604-a2c5-04dd4a504dc8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3249b149-35ec-4604-a2c5-04dd4a504dc8', 'volume_size': 1, 'image_id': 'ad86f424-7d2a-4f3b-9577-890075e7dc72', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ad86f424-7d2a-4f3b-9577-890075e7dc72', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '33db0ca5091747b1a3438d70bf53390c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ad86f424-7d2a-4f3b-9577-890075e7dc72', 'created_at': datetime.datetime(2026, 4, 29, 13, 0, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 13, 0, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ad86f424-7d2a-4f3b-9577-890075e7dc72/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 29 15:04:19 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ae479a3-d901-46b5-980f-e6a1b5fa730f tempest-TaggedBootDevicesTest-203877183 None] Trying to clone 3249b149-35ec-4604-a2c5-04dd4a504dc8 from image ad86f424-7d2a-4f3b-9577-890075e7dc72 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ad86f424-7d2a-4f3b-9577-890075e7dc72', 'metadata': {}}]). {{(pid=84448) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 29 15:04:20 devstack sudo[84566]: pam_unix(sudo:session): session closed for user root Apr 29 15:04:20 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-d147b372-851c-42a4-a6a3-e2ab9b0c503f tempest-TaggedAttachmentsTest-450372533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-406c0ce9-1031-4251-8aab-fc8ac1c94d10 1073741824" returned: 0 in 1.213s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:04:20 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-d147b372-851c-42a4-a6a3-e2ab9b0c503f tempest-TaggedAttachmentsTest-450372533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-406c0ce9-1031-4251-8aab-fc8ac1c94d10 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:04:20 devstack sudo[84904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-406c0ce9-1031-4251-8aab-fc8ac1c94d10 Apr 29 15:04:20 devstack sudo[84904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:04:20 devstack sudo[84904]: pam_unix(sudo:session): session closed for user root Apr 29 15:04:20 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-d147b372-851c-42a4-a6a3-e2ab9b0c503f tempest-TaggedAttachmentsTest-450372533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-406c0ce9-1031-4251-8aab-fc8ac1c94d10" returned: 0 in 0.758s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:04:20 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-d147b372-851c-42a4-a6a3-e2ab9b0c503f tempest-TaggedAttachmentsTest-450372533 None] <== create_volume: return (2041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:04:20 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-d147b372-851c-42a4-a6a3-e2ab9b0c503f tempest-TaggedAttachmentsTest-450372533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.044s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:04:21 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-d147b372-851c-42a4-a6a3-e2ab9b0c503f tempest-TaggedAttachmentsTest-450372533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (503aeb56-47e6-4cc1-a8ca-ee7f151a64e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-406c0ce9-1031-4251-8aab-fc8ac1c94d10', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:04:21 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-d147b372-851c-42a4-a6a3-e2ab9b0c503f tempest-TaggedAttachmentsTest-450372533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7502b6e6-47fc-4c84-9d01-53e74b178481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:04:21 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-d147b372-851c-42a4-a6a3-e2ab9b0c503f tempest-TaggedAttachmentsTest-450372533 None] Volume volume-406c0ce9-1031-4251-8aab-fc8ac1c94d10 (406c0ce9-1031-4251-8aab-fc8ac1c94d10): created successfully Apr 29 15:04:21 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-d147b372-851c-42a4-a6a3-e2ab9b0c503f tempest-TaggedAttachmentsTest-450372533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7502b6e6-47fc-4c84-9d01-53e74b178481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:04:21 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-d147b372-851c-42a4-a6a3-e2ab9b0c503f tempest-TaggedAttachmentsTest-450372533 None] Flow 'volume_create_manager' (ae9f47fb-98f1-48b2-889a-de7457379a7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:04:21 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-d147b372-851c-42a4-a6a3-e2ab9b0c503f tempest-TaggedAttachmentsTest-450372533 None] Created volume successfully. Apr 29 15:04:23 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [None req-4ae479a3-d901-46b5-980f-e6a1b5fa730f tempest-TaggedBootDevicesTest-203877183 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_74rqinl7devstack@QuobyteHD, size 20.69 MB, duration 4.30 sec {{(pid=84448) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 29 15:04:23 devstack cinder-volume[84448]: INFO cinder.image.image_utils [None req-4ae479a3-d901-46b5-980f-e6a1b5fa730f tempest-TaggedBootDevicesTest-203877183 None] Image download 20.69 MB at 4.81 MB/s Apr 29 15:04:23 devstack cinder-volume[84448]: INFO oslo.privsep.daemon [None req-4ae479a3-d901-46b5-980f-e6a1b5fa730f tempest-TaggedBootDevicesTest-203877183 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpn1f6f54b/privsep.sock'] Apr 29 15:04:23 devstack sudo[84908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpn1f6f54b/privsep.sock Apr 29 15:04:23 devstack sudo[84908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:04:25 devstack sudo[84908]: pam_unix(sudo:session): session closed for user root Apr 29 15:04:25 devstack cinder-volume[84448]: INFO oslo.privsep.daemon [None req-4ae479a3-d901-46b5-980f-e6a1b5fa730f tempest-TaggedBootDevicesTest-203877183 None] Spawned new privsep daemon via rootwrap Apr 29 15:04:25 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [None req-4ae479a3-d901-46b5-980f-e6a1b5fa730f tempest-TaggedBootDevicesTest-203877183 None] Accepted privsep connection to /tmp/tmpn1f6f54b/privsep.sock {{(pid=84448) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:418}} Apr 29 15:04:25 devstack cinder-volume[84448]: INFO oslo.privsep.daemon [-] privsep daemon starting Apr 29 15:04:25 devstack cinder-volume[84448]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Apr 29 15:04:25 devstack cinder-volume[84448]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Apr 29 15:04:25 devstack cinder-volume[84448]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84914 Apr 29 15:04:25 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[366da979-658a-4361-887c-7693d53383f8]: (2,) {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:04:25 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[a030489a-1248-4fc1-b608-ce08ab2fc3ed]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:04:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-4ae479a3-d901-46b5-980f-e6a1b5fa730f tempest-TaggedBootDevicesTest-203877183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_74rqinl7devstack@QuobyteHD {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:04:25 devstack sudo[84916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_74rqinl7devstack@QuobyteHD Apr 29 15:04:25 devstack sudo[84916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:04:25 devstack sudo[84916]: pam_unix(sudo:session): session closed for user root Apr 29 15:04:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-4ae479a3-d901-46b5-980f-e6a1b5fa730f tempest-TaggedBootDevicesTest-203877183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_74rqinl7devstack@QuobyteHD" returned: 0 in 0.716s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:04:25 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [None req-4ae479a3-d901-46b5-980f-e6a1b5fa730f tempest-TaggedBootDevicesTest-203877183 None] Temporary image ad86f424-7d2a-4f3b-9577-890075e7dc72 is fetched for user 3d34992abf2a4065b996657b51f11319. {{(pid=84448) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 29 15:04:26 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa73187-513a-44dd-b343-5c59ff632a72]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:04:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-4ae479a3-d901-46b5-980f-e6a1b5fa730f tempest-TaggedBootDevicesTest-203877183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_74rqinl7devstack@QuobyteHD {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:04:26 devstack sudo[84921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_74rqinl7devstack@QuobyteHD Apr 29 15:04:26 devstack sudo[84921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:04:27 devstack sudo[84921]: pam_unix(sudo:session): session closed for user root Apr 29 15:04:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-4ae479a3-d901-46b5-980f-e6a1b5fa730f tempest-TaggedBootDevicesTest-203877183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_74rqinl7devstack@QuobyteHD" returned: 0 in 0.982s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:04:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-4ae479a3-d901-46b5-980f-e6a1b5fa730f tempest-TaggedBootDevicesTest-203877183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:04:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-4ae479a3-d901-46b5-980f-e6a1b5fa730f tempest-TaggedBootDevicesTest-203877183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:04:27 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-4ae479a3-d901-46b5-980f-e6a1b5fa730f tempest-TaggedBootDevicesTest-203877183 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:04:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1966621783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3249b149-35ec-4604-a2c5-04dd4a504dc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f88d76e597ff45609108b0d6571b165a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:04:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:04:19Z,use_quota=True,user_id='3d34992abf2a4065b996657b51f11319',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:04:27 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-4ae479a3-d901-46b5-980f-e6a1b5fa730f tempest-TaggedBootDevicesTest-203877183 None] Creating volume 3249b149-35ec-4604-a2c5-04dd4a504dc8 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:04:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-4ae479a3-d901-46b5-980f-e6a1b5fa730f tempest-TaggedBootDevicesTest-203877183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:04:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-4ae479a3-d901-46b5-980f-e6a1b5fa730f tempest-TaggedBootDevicesTest-203877183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:04:27 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-4ae479a3-d901-46b5-980f-e6a1b5fa730f tempest-TaggedBootDevicesTest-203877183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:04:27 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-4ae479a3-d901-46b5-980f-e6a1b5fa730f tempest-TaggedBootDevicesTest-203877183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:04:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-4ae479a3-d901-46b5-980f-e6a1b5fa730f tempest-TaggedBootDevicesTest-203877183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:04:27 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-4ae479a3-d901-46b5-980f-e6a1b5fa730f tempest-TaggedBootDevicesTest-203877183 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:04:27 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-4ae479a3-d901-46b5-980f-e6a1b5fa730f tempest-TaggedBootDevicesTest-203877183 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:04:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-4ae479a3-d901-46b5-980f-e6a1b5fa730f tempest-TaggedBootDevicesTest-203877183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3249b149-35ec-4604-a2c5-04dd4a504dc8 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:04:27 devstack sudo[84928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3249b149-35ec-4604-a2c5-04dd4a504dc8 1073741824 Apr 29 15:04:27 devstack sudo[84928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:04:27 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-9117d650-ae30-45fc-a89e-4504559ac574 tempest-VolumesAssistedSnapshotsTest-664851138 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:04:27 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-9117d650-ae30-45fc-a89e-4504559ac574 tempest-VolumesAssistedSnapshotsTest-664851138 None] Flow 'volume_create_manager' (c1eaa25a-3e3a-4766-840c-e47f4c134382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:04:27 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-9117d650-ae30-45fc-a89e-4504559ac574 tempest-VolumesAssistedSnapshotsTest-664851138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (157e19b1-6d78-485d-990e-fe1f3ad40cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:04:27 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-9117d650-ae30-45fc-a89e-4504559ac574 tempest-VolumesAssistedSnapshotsTest-664851138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (157e19b1-6d78-485d-990e-fe1f3ad40cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:04:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAssistedSnapshotsTest-volume-1905212000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9891caf-32a1-406a-8542-724b3fef4df7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4acde8ca81a144239ecbdacb5da09a2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:04:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:04:28Z,use_quota=True,user_id='282d8791351c45b1a62e34dae09dce08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:04:27 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-9117d650-ae30-45fc-a89e-4504559ac574 tempest-VolumesAssistedSnapshotsTest-664851138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94e3ab21-2493-4b22-8278-027193a3374b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:04:27 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-9117d650-ae30-45fc-a89e-4504559ac574 tempest-VolumesAssistedSnapshotsTest-664851138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94e3ab21-2493-4b22-8278-027193a3374b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:04:27 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-9117d650-ae30-45fc-a89e-4504559ac574 tempest-VolumesAssistedSnapshotsTest-664851138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5211580-a8e4-4b0e-988a-a1ae63a33a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:04:27 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-9117d650-ae30-45fc-a89e-4504559ac574 tempest-VolumesAssistedSnapshotsTest-664851138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5211580-a8e4-4b0e-988a-a1ae63a33a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9891caf-32a1-406a-8542-724b3fef4df7', 'volume_name': 'volume-c9891caf-32a1-406a-8542-724b3fef4df7', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:04:27 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-9117d650-ae30-45fc-a89e-4504559ac574 tempest-VolumesAssistedSnapshotsTest-664851138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a56e9c3f-80d4-44b5-8238-d3f2fe948a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:04:27 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-9117d650-ae30-45fc-a89e-4504559ac574 tempest-VolumesAssistedSnapshotsTest-664851138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a56e9c3f-80d4-44b5-8238-d3f2fe948a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:04:27 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-9117d650-ae30-45fc-a89e-4504559ac574 tempest-VolumesAssistedSnapshotsTest-664851138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e22ac94-5aad-4723-bb61-7db9692c605b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:04:27 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-9117d650-ae30-45fc-a89e-4504559ac574 tempest-VolumesAssistedSnapshotsTest-664851138 None] Volume c9891caf-32a1-406a-8542-724b3fef4df7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9891caf-32a1-406a-8542-724b3fef4df7', 'volume_size': 1} Apr 29 15:04:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-9117d650-ae30-45fc-a89e-4504559ac574 tempest-VolumesAssistedSnapshotsTest-664851138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:04:28 devstack sudo[84928]: pam_unix(sudo:session): session closed for user root Apr 29 15:04:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-4ae479a3-d901-46b5-980f-e6a1b5fa730f tempest-TaggedBootDevicesTest-203877183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3249b149-35ec-4604-a2c5-04dd4a504dc8 1073741824" returned: 0 in 1.102s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:04:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-4ae479a3-d901-46b5-980f-e6a1b5fa730f tempest-TaggedBootDevicesTest-203877183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3249b149-35ec-4604-a2c5-04dd4a504dc8 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:04:28 devstack sudo[84934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3249b149-35ec-4604-a2c5-04dd4a504dc8 Apr 29 15:04:28 devstack sudo[84934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:04:28 devstack sudo[84934]: pam_unix(sudo:session): session closed for user root Apr 29 15:04:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-4ae479a3-d901-46b5-980f-e6a1b5fa730f tempest-TaggedBootDevicesTest-203877183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3249b149-35ec-4604-a2c5-04dd4a504dc8" returned: 0 in 0.632s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:04:28 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-4ae479a3-d901-46b5-980f-e6a1b5fa730f tempest-TaggedBootDevicesTest-203877183 None] <== create_volume: return (1795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:04:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-4ae479a3-d901-46b5-980f-e6a1b5fa730f tempest-TaggedBootDevicesTest-203877183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.802s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:04:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-9117d650-ae30-45fc-a89e-4504559ac574 tempest-VolumesAssistedSnapshotsTest-664851138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.011s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:04:28 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-9117d650-ae30-45fc-a89e-4504559ac574 tempest-VolumesAssistedSnapshotsTest-664851138 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:04:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAssistedSnapshotsTest-volume-1905212000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9891caf-32a1-406a-8542-724b3fef4df7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4acde8ca81a144239ecbdacb5da09a2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:04:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:04:28Z,use_quota=True,user_id='282d8791351c45b1a62e34dae09dce08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:04:28 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-9117d650-ae30-45fc-a89e-4504559ac574 tempest-VolumesAssistedSnapshotsTest-664851138 None] Creating volume c9891caf-32a1-406a-8542-724b3fef4df7 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:04:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-9117d650-ae30-45fc-a89e-4504559ac574 tempest-VolumesAssistedSnapshotsTest-664851138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:04:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-9117d650-ae30-45fc-a89e-4504559ac574 tempest-VolumesAssistedSnapshotsTest-664851138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:04:28 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-9117d650-ae30-45fc-a89e-4504559ac574 tempest-VolumesAssistedSnapshotsTest-664851138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:04:28 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-9117d650-ae30-45fc-a89e-4504559ac574 tempest-VolumesAssistedSnapshotsTest-664851138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:04:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-9117d650-ae30-45fc-a89e-4504559ac574 tempest-VolumesAssistedSnapshotsTest-664851138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:04:28 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-9117d650-ae30-45fc-a89e-4504559ac574 tempest-VolumesAssistedSnapshotsTest-664851138 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:04:28 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-9117d650-ae30-45fc-a89e-4504559ac574 tempest-VolumesAssistedSnapshotsTest-664851138 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:04:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-9117d650-ae30-45fc-a89e-4504559ac574 tempest-VolumesAssistedSnapshotsTest-664851138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c9891caf-32a1-406a-8542-724b3fef4df7 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:04:28 devstack sudo[84944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c9891caf-32a1-406a-8542-724b3fef4df7 1073741824 Apr 29 15:04:28 devstack sudo[84944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:04:28 devstack cinder-volume[84448]: DEBUG cinder.volume.volume_utils [None req-4ae479a3-d901-46b5-980f-e6a1b5fa730f tempest-TaggedBootDevicesTest-203877183 None] Attempting download of ad86f424-7d2a-4f3b-9577-890075e7dc72 ((None, [{'url': 'file:///opt/stack/data/glance/images/ad86f424-7d2a-4f3b-9577-890075e7dc72', 'metadata': {}}])) to volume 3249b149-35ec-4604-a2c5-04dd4a504dc8. {{(pid=84448) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 29 15:04:28 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[096911e7-cb2d-4392-9cc4-50701aa63f7c]: (4, 'raw') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:04:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-4ae479a3-d901-46b5-980f-e6a1b5fa730f tempest-TaggedBootDevicesTest-203877183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ad86f424-7d2a-4f3b-9577-890075e7dc72_un9o5qlp {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:04:29 devstack sudo[84946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ad86f424-7d2a-4f3b-9577-890075e7dc72_un9o5qlp Apr 29 15:04:29 devstack sudo[84946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:04:29 devstack sudo[84946]: pam_unix(sudo:session): session closed for user root Apr 29 15:04:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-4ae479a3-d901-46b5-980f-e6a1b5fa730f tempest-TaggedBootDevicesTest-203877183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ad86f424-7d2a-4f3b-9577-890075e7dc72_un9o5qlp" returned: 0 in 0.759s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:04:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-4ae479a3-d901-46b5-980f-e6a1b5fa730f tempest-TaggedBootDevicesTest-203877183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ad86f424-7d2a-4f3b-9577-890075e7dc72_un9o5qlp {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:04:29 devstack sudo[84957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ad86f424-7d2a-4f3b-9577-890075e7dc72_un9o5qlp Apr 29 15:04:29 devstack sudo[84957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:04:29 devstack sudo[84944]: pam_unix(sudo:session): session closed for user root Apr 29 15:04:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-9117d650-ae30-45fc-a89e-4504559ac574 tempest-VolumesAssistedSnapshotsTest-664851138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c9891caf-32a1-406a-8542-724b3fef4df7 1073741824" returned: 0 in 1.058s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:04:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-9117d650-ae30-45fc-a89e-4504559ac574 tempest-VolumesAssistedSnapshotsTest-664851138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c9891caf-32a1-406a-8542-724b3fef4df7 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:04:30 devstack sudo[84959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c9891caf-32a1-406a-8542-724b3fef4df7 Apr 29 15:04:30 devstack sudo[84959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:04:30 devstack cinder-volume[84448]: DEBUG oslo_service.periodic_task [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84448) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 15:04:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:04:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:04:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:04:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:04:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:04:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:04:30 devstack sudo[84961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:04:30 devstack sudo[84961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:04:30 devstack sudo[84957]: pam_unix(sudo:session): session closed for user root Apr 29 15:04:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-4ae479a3-d901-46b5-980f-e6a1b5fa730f tempest-TaggedBootDevicesTest-203877183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ad86f424-7d2a-4f3b-9577-890075e7dc72_un9o5qlp" returned: 1 in 0.932s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:04:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-4ae479a3-d901-46b5-980f-e6a1b5fa730f tempest-TaggedBootDevicesTest-203877183 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ad86f424-7d2a-4f3b-9577-890075e7dc72_un9o5qlp' failed. Not Retrying. {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 15:04:30 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff614c3-437c-4a16-87ab-a59bec480a53]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:04:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-4ae479a3-d901-46b5-980f-e6a1b5fa730f tempest-TaggedBootDevicesTest-203877183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_74rqinl7devstack@QuobyteHD {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:04:30 devstack sudo[84966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_74rqinl7devstack@QuobyteHD Apr 29 15:04:30 devstack sudo[84966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:04:30 devstack sudo[84959]: pam_unix(sudo:session): session closed for user root Apr 29 15:04:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-9117d650-ae30-45fc-a89e-4504559ac574 tempest-VolumesAssistedSnapshotsTest-664851138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c9891caf-32a1-406a-8542-724b3fef4df7" returned: 0 in 0.885s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:04:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-9117d650-ae30-45fc-a89e-4504559ac574 tempest-VolumesAssistedSnapshotsTest-664851138 None] <== create_volume: return (2040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:04:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-9117d650-ae30-45fc-a89e-4504559ac574 tempest-VolumesAssistedSnapshotsTest-664851138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.045s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:04:30 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-9117d650-ae30-45fc-a89e-4504559ac574 tempest-VolumesAssistedSnapshotsTest-664851138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e22ac94-5aad-4723-bb61-7db9692c605b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9891caf-32a1-406a-8542-724b3fef4df7', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:04:30 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-9117d650-ae30-45fc-a89e-4504559ac574 tempest-VolumesAssistedSnapshotsTest-664851138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (358827e2-a2b7-4644-b2f1-d497266fe4b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:04:30 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-9117d650-ae30-45fc-a89e-4504559ac574 tempest-VolumesAssistedSnapshotsTest-664851138 None] Volume volume-c9891caf-32a1-406a-8542-724b3fef4df7 (c9891caf-32a1-406a-8542-724b3fef4df7): created successfully Apr 29 15:04:30 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-9117d650-ae30-45fc-a89e-4504559ac574 tempest-VolumesAssistedSnapshotsTest-664851138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (358827e2-a2b7-4644-b2f1-d497266fe4b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:04:31 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-9117d650-ae30-45fc-a89e-4504559ac574 tempest-VolumesAssistedSnapshotsTest-664851138 None] Flow 'volume_create_manager' (c1eaa25a-3e3a-4766-840c-e47f4c134382) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:04:31 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-9117d650-ae30-45fc-a89e-4504559ac574 tempest-VolumesAssistedSnapshotsTest-664851138 None] Created volume successfully. Apr 29 15:04:31 devstack sudo[84961]: pam_unix(sudo:session): session closed for user root Apr 29 15:04:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.905s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:04:31 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:04:31 devstack sudo[84966]: pam_unix(sudo:session): session closed for user root Apr 29 15:04:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-4ae479a3-d901-46b5-980f-e6a1b5fa730f tempest-TaggedBootDevicesTest-203877183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_74rqinl7devstack@QuobyteHD" returned: 0 in 0.960s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:04:31 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [None req-4ae479a3-d901-46b5-980f-e6a1b5fa730f tempest-TaggedBootDevicesTest-203877183 None] ad86f424-7d2a-4f3b-9577-890075e7dc72 was qcow2, converting to raw {{(pid=84448) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 29 15:04:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-4ae479a3-d901-46b5-980f-e6a1b5fa730f tempest-TaggedBootDevicesTest-203877183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_74rqinl7devstack@QuobyteHD /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3249b149-35ec-4604-a2c5-04dd4a504dc8 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:04:31 devstack sudo[84977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_74rqinl7devstack@QuobyteHD /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3249b149-35ec-4604-a2c5-04dd4a504dc8 Apr 29 15:04:31 devstack sudo[84977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:04:34 devstack sudo[84977]: pam_unix(sudo:session): session closed for user root Apr 29 15:04:34 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-4ae479a3-d901-46b5-980f-e6a1b5fa730f tempest-TaggedBootDevicesTest-203877183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_74rqinl7devstack@QuobyteHD /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3249b149-35ec-4604-a2c5-04dd4a504dc8" returned: 0 in 2.535s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:04:34 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [None req-4ae479a3-d901-46b5-980f-e6a1b5fa730f tempest-TaggedBootDevicesTest-203877183 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_74rqinl7devstack@QuobyteHD, size 112.00 MB, duration 2.54 sec, destination /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3249b149-35ec-4604-a2c5-04dd4a504dc8 {{(pid=84448) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 15:04:34 devstack cinder-volume[84448]: INFO cinder.image.image_utils [None req-4ae479a3-d901-46b5-980f-e6a1b5fa730f tempest-TaggedBootDevicesTest-203877183 None] Converted 112.00 MB image at 44.15 MB/s Apr 29 15:04:34 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-4ae479a3-d901-46b5-980f-e6a1b5fa730f tempest-TaggedBootDevicesTest-203877183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3249b149-35ec-4604-a2c5-04dd4a504dc8 1G {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:04:34 devstack sudo[84995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3249b149-35ec-4604-a2c5-04dd4a504dc8 1G Apr 29 15:04:34 devstack sudo[84995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:04:34 devstack sudo[84995]: pam_unix(sudo:session): session closed for user root Apr 29 15:04:34 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-4ae479a3-d901-46b5-980f-e6a1b5fa730f tempest-TaggedBootDevicesTest-203877183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3249b149-35ec-4604-a2c5-04dd4a504dc8 1G" returned: 0 in 0.732s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:04:34 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9f8f81-efc1-45c0-aadf-bbd369fdb8ac]: (4, 'raw') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:04:34 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-4ae479a3-d901-46b5-980f-e6a1b5fa730f tempest-TaggedBootDevicesTest-203877183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3249b149-35ec-4604-a2c5-04dd4a504dc8 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:04:35 devstack sudo[85001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3249b149-35ec-4604-a2c5-04dd4a504dc8 Apr 29 15:04:35 devstack sudo[85001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:04:35 devstack sudo[85001]: pam_unix(sudo:session): session closed for user root Apr 29 15:04:35 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-4ae479a3-d901-46b5-980f-e6a1b5fa730f tempest-TaggedBootDevicesTest-203877183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3249b149-35ec-4604-a2c5-04dd4a504dc8" returned: 0 in 0.779s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:04:35 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-4ae479a3-d901-46b5-980f-e6a1b5fa730f tempest-TaggedBootDevicesTest-203877183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3249b149-35ec-4604-a2c5-04dd4a504dc8 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:04:35 devstack sudo[85008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3249b149-35ec-4604-a2c5-04dd4a504dc8 Apr 29 15:04:35 devstack sudo[85008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:04:36 devstack sudo[85008]: pam_unix(sudo:session): session closed for user root Apr 29 15:04:36 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-4ae479a3-d901-46b5-980f-e6a1b5fa730f tempest-TaggedBootDevicesTest-203877183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3249b149-35ec-4604-a2c5-04dd4a504dc8" returned: 1 in 0.980s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:04:36 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-4ae479a3-d901-46b5-980f-e6a1b5fa730f tempest-TaggedBootDevicesTest-203877183 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3249b149-35ec-4604-a2c5-04dd4a504dc8' failed. Not Retrying. {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 15:04:36 devstack cinder-volume[84448]: DEBUG cinder.volume.volume_utils [None req-4ae479a3-d901-46b5-980f-e6a1b5fa730f tempest-TaggedBootDevicesTest-203877183 None] Downloaded image ad86f424-7d2a-4f3b-9577-890075e7dc72 ((None, [{'url': 'file:///opt/stack/data/glance/images/ad86f424-7d2a-4f3b-9577-890075e7dc72', 'metadata': {}}])) to volume 3249b149-35ec-4604-a2c5-04dd4a504dc8 successfully. {{(pid=84448) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 29 15:04:36 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [None req-4ae479a3-d901-46b5-980f-e6a1b5fa730f tempest-TaggedBootDevicesTest-203877183 None] Temporary image ad86f424-7d2a-4f3b-9577-890075e7dc72 for user 3d34992abf2a4065b996657b51f11319 is deleted. {{(pid=84448) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 29 15:04:36 devstack cinder-volume[84448]: DEBUG cinder.volume.volume_utils [None req-4ae479a3-d901-46b5-980f-e6a1b5fa730f tempest-TaggedBootDevicesTest-203877183 None] Marking volume 3249b149-35ec-4604-a2c5-04dd4a504dc8 as bootable. {{(pid=84448) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 29 15:04:36 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ae479a3-d901-46b5-980f-e6a1b5fa730f tempest-TaggedBootDevicesTest-203877183 None] Copying metadata from image ad86f424-7d2a-4f3b-9577-890075e7dc72 to 3249b149-35ec-4604-a2c5-04dd4a504dc8. {{(pid=84448) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 29 15:04:36 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ae479a3-d901-46b5-980f-e6a1b5fa730f tempest-TaggedBootDevicesTest-203877183 None] Creating volume glance metadata for volume 3249b149-35ec-4604-a2c5-04dd4a504dc8 backed by image ad86f424-7d2a-4f3b-9577-890075e7dc72 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'ad86f424-7d2a-4f3b-9577-890075e7dc72', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84448) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 29 15:04:36 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4ae479a3-d901-46b5-980f-e6a1b5fa730f tempest-TaggedBootDevicesTest-203877183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (075a95e2-ce08-4e1e-bc55-1ae9aae01859) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3249b149-35ec-4604-a2c5-04dd4a504dc8', 'volume_size': 1, 'image_id': 'ad86f424-7d2a-4f3b-9577-890075e7dc72', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ad86f424-7d2a-4f3b-9577-890075e7dc72', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '33db0ca5091747b1a3438d70bf53390c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ad86f424-7d2a-4f3b-9577-890075e7dc72', 'created_at': datetime.datetime(2026, 4, 29, 13, 0, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 13, 0, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ad86f424-7d2a-4f3b-9577-890075e7dc72/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:04:36 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4ae479a3-d901-46b5-980f-e6a1b5fa730f tempest-TaggedBootDevicesTest-203877183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44d295d6-2dad-4890-89cb-f0b813f8262a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:04:36 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-4ae479a3-d901-46b5-980f-e6a1b5fa730f tempest-TaggedBootDevicesTest-203877183 None] Volume volume-3249b149-35ec-4604-a2c5-04dd4a504dc8 (3249b149-35ec-4604-a2c5-04dd4a504dc8): created successfully Apr 29 15:04:36 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4ae479a3-d901-46b5-980f-e6a1b5fa730f tempest-TaggedBootDevicesTest-203877183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44d295d6-2dad-4890-89cb-f0b813f8262a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:04:36 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4ae479a3-d901-46b5-980f-e6a1b5fa730f tempest-TaggedBootDevicesTest-203877183 None] Flow 'volume_create_manager' (d04c8cdd-6eb8-4012-bf87-c8cebf62a51d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:04:36 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-4ae479a3-d901-46b5-980f-e6a1b5fa730f tempest-TaggedBootDevicesTest-203877183 None] Created volume successfully. Apr 29 15:04:38 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-b116e9fd-6583-488e-81fb-d55e217b06da tempest-TaggedBootDevicesTest-203877183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:04:38 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b116e9fd-6583-488e-81fb-d55e217b06da tempest-TaggedBootDevicesTest-203877183 None] Flow 'volume_create_manager' (8f6eec01-2179-4f41-ae0c-d1b4a4b1e48c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:04:38 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b116e9fd-6583-488e-81fb-d55e217b06da tempest-TaggedBootDevicesTest-203877183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (257a400d-4b97-4b5e-a5ee-6627747bbe8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:04:38 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b116e9fd-6583-488e-81fb-d55e217b06da tempest-TaggedBootDevicesTest-203877183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (257a400d-4b97-4b5e-a5ee-6627747bbe8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:04:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-320959244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e8f035c-9d91-4672-bb45-150f615437e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f88d76e597ff45609108b0d6571b165a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:04:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:04:38Z,use_quota=True,user_id='3d34992abf2a4065b996657b51f11319',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:04:38 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b116e9fd-6583-488e-81fb-d55e217b06da tempest-TaggedBootDevicesTest-203877183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de672023-cf9a-4b1b-8b68-4064178af417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:04:38 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b116e9fd-6583-488e-81fb-d55e217b06da tempest-TaggedBootDevicesTest-203877183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de672023-cf9a-4b1b-8b68-4064178af417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:04:38 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b116e9fd-6583-488e-81fb-d55e217b06da tempest-TaggedBootDevicesTest-203877183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e4bd34a-ff93-4386-a19d-3e1616310b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:04:38 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b116e9fd-6583-488e-81fb-d55e217b06da tempest-TaggedBootDevicesTest-203877183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e4bd34a-ff93-4386-a19d-3e1616310b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e8f035c-9d91-4672-bb45-150f615437e1', 'volume_name': 'volume-1e8f035c-9d91-4672-bb45-150f615437e1', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:04:38 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b116e9fd-6583-488e-81fb-d55e217b06da tempest-TaggedBootDevicesTest-203877183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cf802b7-4c81-4dbf-816a-72cc07e0438c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:04:38 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b116e9fd-6583-488e-81fb-d55e217b06da tempest-TaggedBootDevicesTest-203877183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cf802b7-4c81-4dbf-816a-72cc07e0438c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:04:38 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b116e9fd-6583-488e-81fb-d55e217b06da tempest-TaggedBootDevicesTest-203877183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78aedd8c-9e48-40ca-92a5-388949e1a36e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:04:38 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-b116e9fd-6583-488e-81fb-d55e217b06da tempest-TaggedBootDevicesTest-203877183 None] Volume 1e8f035c-9d91-4672-bb45-150f615437e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e8f035c-9d91-4672-bb45-150f615437e1', 'volume_size': 1} Apr 29 15:04:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-b116e9fd-6583-488e-81fb-d55e217b06da tempest-TaggedBootDevicesTest-203877183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:04:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-b116e9fd-6583-488e-81fb-d55e217b06da tempest-TaggedBootDevicesTest-203877183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:04:38 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-b116e9fd-6583-488e-81fb-d55e217b06da tempest-TaggedBootDevicesTest-203877183 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:04:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-320959244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e8f035c-9d91-4672-bb45-150f615437e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f88d76e597ff45609108b0d6571b165a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:04:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:04:38Z,use_quota=True,user_id='3d34992abf2a4065b996657b51f11319',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:04:38 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-b116e9fd-6583-488e-81fb-d55e217b06da tempest-TaggedBootDevicesTest-203877183 None] Creating volume 1e8f035c-9d91-4672-bb45-150f615437e1 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:04:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-b116e9fd-6583-488e-81fb-d55e217b06da tempest-TaggedBootDevicesTest-203877183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:04:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-b116e9fd-6583-488e-81fb-d55e217b06da tempest-TaggedBootDevicesTest-203877183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:04:38 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-b116e9fd-6583-488e-81fb-d55e217b06da tempest-TaggedBootDevicesTest-203877183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:04:38 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-b116e9fd-6583-488e-81fb-d55e217b06da tempest-TaggedBootDevicesTest-203877183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:04:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-b116e9fd-6583-488e-81fb-d55e217b06da tempest-TaggedBootDevicesTest-203877183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:04:38 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-b116e9fd-6583-488e-81fb-d55e217b06da tempest-TaggedBootDevicesTest-203877183 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:04:38 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-b116e9fd-6583-488e-81fb-d55e217b06da tempest-TaggedBootDevicesTest-203877183 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:04:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-b116e9fd-6583-488e-81fb-d55e217b06da tempest-TaggedBootDevicesTest-203877183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1e8f035c-9d91-4672-bb45-150f615437e1 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:04:38 devstack sudo[85029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1e8f035c-9d91-4672-bb45-150f615437e1 1073741824 Apr 29 15:04:38 devstack sudo[85029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:04:39 devstack sudo[85029]: pam_unix(sudo:session): session closed for user root Apr 29 15:04:39 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-b116e9fd-6583-488e-81fb-d55e217b06da tempest-TaggedBootDevicesTest-203877183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1e8f035c-9d91-4672-bb45-150f615437e1 1073741824" returned: 0 in 1.245s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:04:39 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-b116e9fd-6583-488e-81fb-d55e217b06da tempest-TaggedBootDevicesTest-203877183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1e8f035c-9d91-4672-bb45-150f615437e1 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:04:39 devstack sudo[85037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1e8f035c-9d91-4672-bb45-150f615437e1 Apr 29 15:04:39 devstack sudo[85037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:04:40 devstack sudo[85037]: pam_unix(sudo:session): session closed for user root Apr 29 15:04:40 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-b116e9fd-6583-488e-81fb-d55e217b06da tempest-TaggedBootDevicesTest-203877183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1e8f035c-9d91-4672-bb45-150f615437e1" returned: 0 in 0.886s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:04:40 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-b116e9fd-6583-488e-81fb-d55e217b06da tempest-TaggedBootDevicesTest-203877183 None] <== create_volume: return (2192ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:04:40 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-b116e9fd-6583-488e-81fb-d55e217b06da tempest-TaggedBootDevicesTest-203877183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.195s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:04:40 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b116e9fd-6583-488e-81fb-d55e217b06da tempest-TaggedBootDevicesTest-203877183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78aedd8c-9e48-40ca-92a5-388949e1a36e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e8f035c-9d91-4672-bb45-150f615437e1', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:04:40 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b116e9fd-6583-488e-81fb-d55e217b06da tempest-TaggedBootDevicesTest-203877183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f55d4c5-72a7-4cfd-850e-80bf53626b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:04:40 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-b116e9fd-6583-488e-81fb-d55e217b06da tempest-TaggedBootDevicesTest-203877183 None] Volume volume-1e8f035c-9d91-4672-bb45-150f615437e1 (1e8f035c-9d91-4672-bb45-150f615437e1): created successfully Apr 29 15:04:40 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b116e9fd-6583-488e-81fb-d55e217b06da tempest-TaggedBootDevicesTest-203877183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f55d4c5-72a7-4cfd-850e-80bf53626b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:04:40 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b116e9fd-6583-488e-81fb-d55e217b06da tempest-TaggedBootDevicesTest-203877183 None] Flow 'volume_create_manager' (8f6eec01-2179-4f41-ae0c-d1b4a4b1e48c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:04:40 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-b116e9fd-6583-488e-81fb-d55e217b06da tempest-TaggedBootDevicesTest-203877183 None] Created volume successfully. Apr 29 15:04:41 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f201108-a8c7-43db-b49e-1045964681d5 tempest-TaggedBootDevicesTest-203877183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:04:41 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6f201108-a8c7-43db-b49e-1045964681d5 tempest-TaggedBootDevicesTest-203877183 None] Flow 'volume_create_manager' (7043716c-7f77-4227-8fea-ae0f5f10d884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:04:41 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6f201108-a8c7-43db-b49e-1045964681d5 tempest-TaggedBootDevicesTest-203877183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87d773a9-42dd-4fba-914d-d5841ab65017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:04:41 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6f201108-a8c7-43db-b49e-1045964681d5 tempest-TaggedBootDevicesTest-203877183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87d773a9-42dd-4fba-914d-d5841ab65017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:04:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1402183743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1ec5bc3-a39d-49e4-9d9a-fe3f0b8a44b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f88d76e597ff45609108b0d6571b165a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:04:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:04:42Z,use_quota=True,user_id='3d34992abf2a4065b996657b51f11319',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:04:41 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6f201108-a8c7-43db-b49e-1045964681d5 tempest-TaggedBootDevicesTest-203877183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8b8cb8e-3f81-4a73-8563-986ac83ab958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:04:41 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6f201108-a8c7-43db-b49e-1045964681d5 tempest-TaggedBootDevicesTest-203877183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8b8cb8e-3f81-4a73-8563-986ac83ab958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:04:41 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6f201108-a8c7-43db-b49e-1045964681d5 tempest-TaggedBootDevicesTest-203877183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84c84731-7fa9-496c-a4f3-91c8a7743a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:04:41 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6f201108-a8c7-43db-b49e-1045964681d5 tempest-TaggedBootDevicesTest-203877183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84c84731-7fa9-496c-a4f3-91c8a7743a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1ec5bc3-a39d-49e4-9d9a-fe3f0b8a44b8', 'volume_name': 'volume-d1ec5bc3-a39d-49e4-9d9a-fe3f0b8a44b8', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:04:41 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6f201108-a8c7-43db-b49e-1045964681d5 tempest-TaggedBootDevicesTest-203877183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9913a4e-1add-4104-bf87-cc8b4b68c268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:04:41 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6f201108-a8c7-43db-b49e-1045964681d5 tempest-TaggedBootDevicesTest-203877183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9913a4e-1add-4104-bf87-cc8b4b68c268) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:04:41 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6f201108-a8c7-43db-b49e-1045964681d5 tempest-TaggedBootDevicesTest-203877183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d816790a-b201-41ae-aa64-17d43134d6d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:04:42 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-6f201108-a8c7-43db-b49e-1045964681d5 tempest-TaggedBootDevicesTest-203877183 None] Volume d1ec5bc3-a39d-49e4-9d9a-fe3f0b8a44b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1ec5bc3-a39d-49e4-9d9a-fe3f0b8a44b8', 'volume_size': 1} Apr 29 15:04:42 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-6f201108-a8c7-43db-b49e-1045964681d5 tempest-TaggedBootDevicesTest-203877183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:04:42 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-6f201108-a8c7-43db-b49e-1045964681d5 tempest-TaggedBootDevicesTest-203877183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:04:42 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-6f201108-a8c7-43db-b49e-1045964681d5 tempest-TaggedBootDevicesTest-203877183 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:04:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1402183743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1ec5bc3-a39d-49e4-9d9a-fe3f0b8a44b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f88d76e597ff45609108b0d6571b165a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:04:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:04:42Z,use_quota=True,user_id='3d34992abf2a4065b996657b51f11319',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:04:42 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-6f201108-a8c7-43db-b49e-1045964681d5 tempest-TaggedBootDevicesTest-203877183 None] Creating volume d1ec5bc3-a39d-49e4-9d9a-fe3f0b8a44b8 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:04:42 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-6f201108-a8c7-43db-b49e-1045964681d5 tempest-TaggedBootDevicesTest-203877183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:04:42 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-6f201108-a8c7-43db-b49e-1045964681d5 tempest-TaggedBootDevicesTest-203877183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:04:42 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-6f201108-a8c7-43db-b49e-1045964681d5 tempest-TaggedBootDevicesTest-203877183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:04:42 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-6f201108-a8c7-43db-b49e-1045964681d5 tempest-TaggedBootDevicesTest-203877183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:04:42 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-6f201108-a8c7-43db-b49e-1045964681d5 tempest-TaggedBootDevicesTest-203877183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:04:42 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-6f201108-a8c7-43db-b49e-1045964681d5 tempest-TaggedBootDevicesTest-203877183 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:04:42 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-6f201108-a8c7-43db-b49e-1045964681d5 tempest-TaggedBootDevicesTest-203877183 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:04:42 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6f201108-a8c7-43db-b49e-1045964681d5 tempest-TaggedBootDevicesTest-203877183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d1ec5bc3-a39d-49e4-9d9a-fe3f0b8a44b8 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:04:42 devstack sudo[85066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d1ec5bc3-a39d-49e4-9d9a-fe3f0b8a44b8 1073741824 Apr 29 15:04:42 devstack sudo[85066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:04:42 devstack sudo[85066]: pam_unix(sudo:session): session closed for user root Apr 29 15:04:42 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6f201108-a8c7-43db-b49e-1045964681d5 tempest-TaggedBootDevicesTest-203877183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d1ec5bc3-a39d-49e4-9d9a-fe3f0b8a44b8 1073741824" returned: 0 in 0.939s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:04:42 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6f201108-a8c7-43db-b49e-1045964681d5 tempest-TaggedBootDevicesTest-203877183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d1ec5bc3-a39d-49e4-9d9a-fe3f0b8a44b8 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:04:43 devstack sudo[85090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d1ec5bc3-a39d-49e4-9d9a-fe3f0b8a44b8 Apr 29 15:04:43 devstack sudo[85090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:04:43 devstack sudo[85090]: pam_unix(sudo:session): session closed for user root Apr 29 15:04:43 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6f201108-a8c7-43db-b49e-1045964681d5 tempest-TaggedBootDevicesTest-203877183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d1ec5bc3-a39d-49e4-9d9a-fe3f0b8a44b8" returned: 0 in 0.772s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:04:43 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-6f201108-a8c7-43db-b49e-1045964681d5 tempest-TaggedBootDevicesTest-203877183 None] <== create_volume: return (1756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:04:43 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-6f201108-a8c7-43db-b49e-1045964681d5 tempest-TaggedBootDevicesTest-203877183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.759s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:04:43 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6f201108-a8c7-43db-b49e-1045964681d5 tempest-TaggedBootDevicesTest-203877183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d816790a-b201-41ae-aa64-17d43134d6d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1ec5bc3-a39d-49e4-9d9a-fe3f0b8a44b8', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:04:43 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6f201108-a8c7-43db-b49e-1045964681d5 tempest-TaggedBootDevicesTest-203877183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98e2eddf-dcf3-4fee-a8d3-9ec98cf5fb99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:04:43 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-6f201108-a8c7-43db-b49e-1045964681d5 tempest-TaggedBootDevicesTest-203877183 None] Volume volume-d1ec5bc3-a39d-49e4-9d9a-fe3f0b8a44b8 (d1ec5bc3-a39d-49e4-9d9a-fe3f0b8a44b8): created successfully Apr 29 15:04:43 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6f201108-a8c7-43db-b49e-1045964681d5 tempest-TaggedBootDevicesTest-203877183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98e2eddf-dcf3-4fee-a8d3-9ec98cf5fb99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:04:43 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6f201108-a8c7-43db-b49e-1045964681d5 tempest-TaggedBootDevicesTest-203877183 None] Flow 'volume_create_manager' (7043716c-7f77-4227-8fea-ae0f5f10d884) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:04:43 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-6f201108-a8c7-43db-b49e-1045964681d5 tempest-TaggedBootDevicesTest-203877183 None] Created volume successfully. Apr 29 15:04:53 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:UPDATE=17,cinder:SELECT=19,cinder:INSERT=8,cinder:DELETE=1 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:04:53 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:SELECT=16,cinder:UPDATE=16,cinder:INSERT=10,cinder:DELETE=4 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:05:19 devstack cinder-volume[84448]: WARNING py.warnings [req-7192e9ac-b475-48ce-bbc0-a0fc3babdad3 req-ffba9f2d-eae1-4aa9-baf6-c6dc9289d70f tempest-TaggedBootDevicesTest-203877183 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Apr 29 15:05:19 devstack cinder-volume[84448]: .first() Apr 29 15:05:19 devstack cinder-volume[84448]: Apr 29 15:05:19 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-7192e9ac-b475-48ce-bbc0-a0fc3babdad3 req-ffba9f2d-eae1-4aa9-baf6-c6dc9289d70f tempest-TaggedBootDevicesTest-203877183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:05:19 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-7192e9ac-b475-48ce-bbc0-a0fc3babdad3 req-ffba9f2d-eae1-4aa9-baf6-c6dc9289d70f tempest-TaggedBootDevicesTest-203877183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:05:20 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[31278279-0571-48a6-8ac9-dc490c974d01]: (4, 'raw') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:05:20 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-7192e9ac-b475-48ce-bbc0-a0fc3babdad3 req-ffba9f2d-eae1-4aa9-baf6-c6dc9289d70f tempest-TaggedBootDevicesTest-203877183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3249b149-35ec-4604-a2c5-04dd4a504dc8 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:05:20 devstack sudo[85415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3249b149-35ec-4604-a2c5-04dd4a504dc8 Apr 29 15:05:20 devstack sudo[85415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:05:21 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-84080784-5fcc-49ce-934e-bd21d2732fde req-4cc89d83-b23c-4755-a71b-27d79a9d2306 tempest-VolumesAssistedSnapshotsTest-664851138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:05:21 devstack sudo[85415]: pam_unix(sudo:session): session closed for user root Apr 29 15:05:21 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-7192e9ac-b475-48ce-bbc0-a0fc3babdad3 req-ffba9f2d-eae1-4aa9-baf6-c6dc9289d70f tempest-TaggedBootDevicesTest-203877183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3249b149-35ec-4604-a2c5-04dd4a504dc8" returned: 0 in 1.358s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:05:21 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-7192e9ac-b475-48ce-bbc0-a0fc3babdad3 req-ffba9f2d-eae1-4aa9-baf6-c6dc9289d70f tempest-TaggedBootDevicesTest-203877183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3249b149-35ec-4604-a2c5-04dd4a504dc8 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:05:21 devstack sudo[85433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3249b149-35ec-4604-a2c5-04dd4a504dc8 Apr 29 15:05:21 devstack sudo[85433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:05:22 devstack sudo[85433]: pam_unix(sudo:session): session closed for user root Apr 29 15:05:22 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-7192e9ac-b475-48ce-bbc0-a0fc3babdad3 req-ffba9f2d-eae1-4aa9-baf6-c6dc9289d70f tempest-TaggedBootDevicesTest-203877183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3249b149-35ec-4604-a2c5-04dd4a504dc8" returned: 1 in 0.763s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:05:22 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-7192e9ac-b475-48ce-bbc0-a0fc3babdad3 req-ffba9f2d-eae1-4aa9-baf6-c6dc9289d70f tempest-TaggedBootDevicesTest-203877183 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3249b149-35ec-4604-a2c5-04dd4a504dc8' failed. Not Retrying. {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 15:05:22 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-7192e9ac-b475-48ce-bbc0-a0fc3babdad3 req-ffba9f2d-eae1-4aa9-baf6-c6dc9289d70f tempest-TaggedBootDevicesTest-203877183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.231s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:05:22 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-84080784-5fcc-49ce-934e-bd21d2732fde req-4cc89d83-b23c-4755-a71b-27d79a9d2306 tempest-VolumesAssistedSnapshotsTest-664851138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.782s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:05:22 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[d723bbdd-0b90-488e-b572-aea357a0f075]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:05:22 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-84080784-5fcc-49ce-934e-bd21d2732fde req-4cc89d83-b23c-4755-a71b-27d79a9d2306 tempest-VolumesAssistedSnapshotsTest-664851138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c9891caf-32a1-406a-8542-724b3fef4df7 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:05:22 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-7192e9ac-b475-48ce-bbc0-a0fc3babdad3 req-ffba9f2d-eae1-4aa9-baf6-c6dc9289d70f tempest-TaggedBootDevicesTest-203877183 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a', 'name': 'volume-3249b149-35ec-4604-a2c5-04dd4a504dc8', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '70ff69e7-3fa5-405d-a606-6ef6695a965e', 'enforce_multipath': True} {{(pid=84448) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 15:05:22 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-7192e9ac-b475-48ce-bbc0-a0fc3babdad3 req-ffba9f2d-eae1-4aa9-baf6-c6dc9289d70f tempest-TaggedBootDevicesTest-203877183 None] attachment_update completed successfully. Apr 29 15:05:22 devstack sudo[85439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c9891caf-32a1-406a-8542-724b3fef4df7 Apr 29 15:05:22 devstack sudo[85439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:05:23 devstack sudo[85439]: pam_unix(sudo:session): session closed for user root Apr 29 15:05:23 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-84080784-5fcc-49ce-934e-bd21d2732fde req-4cc89d83-b23c-4755-a71b-27d79a9d2306 tempest-VolumesAssistedSnapshotsTest-664851138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c9891caf-32a1-406a-8542-724b3fef4df7" returned: 0 in 1.133s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:05:23 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-84080784-5fcc-49ce-934e-bd21d2732fde req-4cc89d83-b23c-4755-a71b-27d79a9d2306 tempest-VolumesAssistedSnapshotsTest-664851138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.172s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:05:23 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-84080784-5fcc-49ce-934e-bd21d2732fde req-4cc89d83-b23c-4755-a71b-27d79a9d2306 tempest-VolumesAssistedSnapshotsTest-664851138 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a', 'name': 'volume-c9891caf-32a1-406a-8542-724b3fef4df7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd31b4f4f-4c26-4045-b9fa-a1f956f0b819', 'enforce_multipath': True} {{(pid=84448) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 15:05:23 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-84080784-5fcc-49ce-934e-bd21d2732fde req-4cc89d83-b23c-4755-a71b-27d79a9d2306 tempest-VolumesAssistedSnapshotsTest-664851138 None] attachment_update completed successfully. Apr 29 15:05:24 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-7192e9ac-b475-48ce-bbc0-a0fc3babdad3 req-fa714fa7-1c88-420b-9cae-deafb10321c0 tempest-TaggedBootDevicesTest-203877183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:05:24 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-7192e9ac-b475-48ce-bbc0-a0fc3babdad3 req-fa714fa7-1c88-420b-9cae-deafb10321c0 tempest-TaggedBootDevicesTest-203877183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:05:24 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f7cfc89-8aae-42d4-80d0-0dbc4dfc0511]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:05:24 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-7192e9ac-b475-48ce-bbc0-a0fc3babdad3 req-fa714fa7-1c88-420b-9cae-deafb10321c0 tempest-TaggedBootDevicesTest-203877183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1e8f035c-9d91-4672-bb45-150f615437e1 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:05:24 devstack sudo[85467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1e8f035c-9d91-4672-bb45-150f615437e1 Apr 29 15:05:24 devstack sudo[85467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:05:25 devstack sudo[85467]: pam_unix(sudo:session): session closed for user root Apr 29 15:05:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-7192e9ac-b475-48ce-bbc0-a0fc3babdad3 req-fa714fa7-1c88-420b-9cae-deafb10321c0 tempest-TaggedBootDevicesTest-203877183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1e8f035c-9d91-4672-bb45-150f615437e1" returned: 0 in 1.016s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:05:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-7192e9ac-b475-48ce-bbc0-a0fc3babdad3 req-fa714fa7-1c88-420b-9cae-deafb10321c0 tempest-TaggedBootDevicesTest-203877183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.051s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:05:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-7192e9ac-b475-48ce-bbc0-a0fc3babdad3 req-fa714fa7-1c88-420b-9cae-deafb10321c0 tempest-TaggedBootDevicesTest-203877183 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a', 'name': 'volume-1e8f035c-9d91-4672-bb45-150f615437e1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '50021945-2ae3-4234-a5c3-f6c3bfe3dce1', 'enforce_multipath': True} {{(pid=84448) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 15:05:25 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-7192e9ac-b475-48ce-bbc0-a0fc3babdad3 req-fa714fa7-1c88-420b-9cae-deafb10321c0 tempest-TaggedBootDevicesTest-203877183 None] attachment_update completed successfully. Apr 29 15:05:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-7192e9ac-b475-48ce-bbc0-a0fc3babdad3 req-b14ce8a1-c70b-49c8-a38b-3b8abac001e9 tempest-TaggedBootDevicesTest-203877183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:05:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-7192e9ac-b475-48ce-bbc0-a0fc3babdad3 req-b14ce8a1-c70b-49c8-a38b-3b8abac001e9 tempest-TaggedBootDevicesTest-203877183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:05:27 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd6f97e-752c-45cd-a488-20be78f65a74]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:05:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-7192e9ac-b475-48ce-bbc0-a0fc3babdad3 req-b14ce8a1-c70b-49c8-a38b-3b8abac001e9 tempest-TaggedBootDevicesTest-203877183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d1ec5bc3-a39d-49e4-9d9a-fe3f0b8a44b8 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:05:27 devstack sudo[85865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d1ec5bc3-a39d-49e4-9d9a-fe3f0b8a44b8 Apr 29 15:05:27 devstack sudo[85865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:05:28 devstack sudo[85865]: pam_unix(sudo:session): session closed for user root Apr 29 15:05:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-7192e9ac-b475-48ce-bbc0-a0fc3babdad3 req-b14ce8a1-c70b-49c8-a38b-3b8abac001e9 tempest-TaggedBootDevicesTest-203877183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d1ec5bc3-a39d-49e4-9d9a-fe3f0b8a44b8" returned: 0 in 1.105s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:05:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-7192e9ac-b475-48ce-bbc0-a0fc3babdad3 req-b14ce8a1-c70b-49c8-a38b-3b8abac001e9 tempest-TaggedBootDevicesTest-203877183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.139s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:05:28 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-7192e9ac-b475-48ce-bbc0-a0fc3babdad3 req-b14ce8a1-c70b-49c8-a38b-3b8abac001e9 tempest-TaggedBootDevicesTest-203877183 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a', 'name': 'volume-d1ec5bc3-a39d-49e4-9d9a-fe3f0b8a44b8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f3cb6ebe-2cff-4f0a-8d80-ffd4acd5ae70', 'enforce_multipath': True} {{(pid=84448) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 15:05:28 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-7192e9ac-b475-48ce-bbc0-a0fc3babdad3 req-b14ce8a1-c70b-49c8-a38b-3b8abac001e9 tempest-TaggedBootDevicesTest-203877183 None] attachment_update completed successfully. Apr 29 15:05:30 devstack cinder-volume[84448]: DEBUG oslo_service.periodic_task [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84448) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 15:05:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:05:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:05:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:05:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:05:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:05:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:05:30 devstack sudo[85880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:05:30 devstack sudo[85880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:05:31 devstack sudo[85880]: pam_unix(sudo:session): session closed for user root Apr 29 15:05:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.653s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:05:31 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:05:33 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-ecfbbf86-8457-4101-8737-ca4805b8c6de req-22039dd2-8e09-424d-832f-0441e8592bf6 tempest-VolumesAssistedSnapshotsTest-664851138 None] Terminate volume connection completed successfully. Apr 29 15:05:33 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-ecfbbf86-8457-4101-8737-ca4805b8c6de req-22039dd2-8e09-424d-832f-0441e8592bf6 tempest-VolumesAssistedSnapshotsTest-664851138 None] Deleting attachment d31b4f4f-4c26-4045-b9fa-a1f956f0b819. {{(pid=84448) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 15:05:35 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-ae32afb6-e185-4fdc-a747-8518ee962777 tempest-VolumesAssistedSnapshotsTest-664851138 None] Acquiring lock "cinder-c9891caf-32a1-406a-8542-724b3fef4df7-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:05:35 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-ae32afb6-e185-4fdc-a747-8518ee962777 tempest-VolumesAssistedSnapshotsTest-664851138 None] Lock "cinder-c9891caf-32a1-406a-8542-724b3fef4df7-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:05:35 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-ae32afb6-e185-4fdc-a747-8518ee962777 tempest-VolumesAssistedSnapshotsTest-664851138 None] Acquiring lock "cinder-quobyte-c9891caf-32a1-406a-8542-724b3fef4df7" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:05:35 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-ae32afb6-e185-4fdc-a747-8518ee962777 tempest-VolumesAssistedSnapshotsTest-664851138 None] Lock "cinder-quobyte-c9891caf-32a1-406a-8542-724b3fef4df7" acquired by "delete_volume" :: waited 0.025s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:05:35 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a2c9dc-b1ce-4a93-bdce-a459bd6fe1a9]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:05:35 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ae32afb6-e185-4fdc-a747-8518ee962777 tempest-VolumesAssistedSnapshotsTest-664851138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c9891caf-32a1-406a-8542-724b3fef4df7 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:05:35 devstack sudo[85913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c9891caf-32a1-406a-8542-724b3fef4df7 Apr 29 15:05:35 devstack sudo[85913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:05:36 devstack sudo[85913]: pam_unix(sudo:session): session closed for user root Apr 29 15:05:36 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ae32afb6-e185-4fdc-a747-8518ee962777 tempest-VolumesAssistedSnapshotsTest-664851138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c9891caf-32a1-406a-8542-724b3fef4df7" returned: 0 in 0.924s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:05:36 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ae32afb6-e185-4fdc-a747-8518ee962777 tempest-VolumesAssistedSnapshotsTest-664851138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c9891caf-32a1-406a-8542-724b3fef4df7 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:05:36 devstack sudo[85923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c9891caf-32a1-406a-8542-724b3fef4df7 Apr 29 15:05:36 devstack sudo[85923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:05:37 devstack sudo[85923]: pam_unix(sudo:session): session closed for user root Apr 29 15:05:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ae32afb6-e185-4fdc-a747-8518ee962777 tempest-VolumesAssistedSnapshotsTest-664851138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c9891caf-32a1-406a-8542-724b3fef4df7" returned: 0 in 0.803s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:05:37 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-ae32afb6-e185-4fdc-a747-8518ee962777 tempest-VolumesAssistedSnapshotsTest-664851138 None] Lock "cinder-quobyte-c9891caf-32a1-406a-8542-724b3fef4df7" released by "delete_volume" :: held 1.783s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:05:37 devstack cinder-volume[84448]: WARNING cinder.quota [None req-ae32afb6-e185-4fdc-a747-8518ee962777 tempest-VolumesAssistedSnapshotsTest-664851138 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 29 15:05:37 devstack cinder-volume[84448]: WARNING cinder.quota [None req-ae32afb6-e185-4fdc-a747-8518ee962777 tempest-VolumesAssistedSnapshotsTest-664851138 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 29 15:05:37 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-ae32afb6-e185-4fdc-a747-8518ee962777 tempest-VolumesAssistedSnapshotsTest-664851138 None] Created reservations ['120b2f46-a469-4255-ad48-28b9041d3dfa', '28062306-4072-4671-a4ee-f9b27980d4b1', '2edfce9c-1322-47b1-ae63-956c64b03433', '54485a94-b099-47e6-8dac-91e199f8e70e'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:05:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-ae32afb6-e185-4fdc-a747-8518ee962777 tempest-VolumesAssistedSnapshotsTest-664851138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:05:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-ae32afb6-e185-4fdc-a747-8518ee962777 tempest-VolumesAssistedSnapshotsTest-664851138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:05:37 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-ae32afb6-e185-4fdc-a747-8518ee962777 tempest-VolumesAssistedSnapshotsTest-664851138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:05:37 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-ae32afb6-e185-4fdc-a747-8518ee962777 tempest-VolumesAssistedSnapshotsTest-664851138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:05:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-ae32afb6-e185-4fdc-a747-8518ee962777 tempest-VolumesAssistedSnapshotsTest-664851138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:05:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ae32afb6-e185-4fdc-a747-8518ee962777 tempest-VolumesAssistedSnapshotsTest-664851138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:05:37 devstack sudo[85926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:05:37 devstack sudo[85926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:05:38 devstack sudo[85926]: pam_unix(sudo:session): session closed for user root Apr 29 15:05:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ae32afb6-e185-4fdc-a747-8518ee962777 tempest-VolumesAssistedSnapshotsTest-664851138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.725s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:05:38 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-ae32afb6-e185-4fdc-a747-8518ee962777 tempest-VolumesAssistedSnapshotsTest-664851138 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:05:38 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-ae32afb6-e185-4fdc-a747-8518ee962777 tempest-VolumesAssistedSnapshotsTest-664851138 None] Deleted volume successfully. Apr 29 15:05:38 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-ae32afb6-e185-4fdc-a747-8518ee962777 tempest-VolumesAssistedSnapshotsTest-664851138 None] Lock "cinder-c9891caf-32a1-406a-8542-724b3fef4df7-delete_volume" released by "delete_volume" :: held 2.820s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:05:47 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:SELECT=24,cinder:UPDATE=18,cinder:INSERT=2 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:05:48 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:SELECT=33,cinder:UPDATE=11,cinder:INSERT=2,cinder:DELETE=1 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:05:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-ce655e9e-91df-47d3-b887-5c93bbfecb72 req-3515e82f-7b94-4b30-b2db-603686769fc6 tempest-TaggedAttachmentsTest-450372533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:05:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-ce655e9e-91df-47d3-b887-5c93bbfecb72 req-3515e82f-7b94-4b30-b2db-603686769fc6 tempest-TaggedAttachmentsTest-450372533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:05:50 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[e598dc26-7b45-4261-88af-3476f668df1c]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:05:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-ce655e9e-91df-47d3-b887-5c93bbfecb72 req-3515e82f-7b94-4b30-b2db-603686769fc6 tempest-TaggedAttachmentsTest-450372533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-406c0ce9-1031-4251-8aab-fc8ac1c94d10 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:05:50 devstack sudo[86343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-406c0ce9-1031-4251-8aab-fc8ac1c94d10 Apr 29 15:05:50 devstack sudo[86343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:05:52 devstack sudo[86343]: pam_unix(sudo:session): session closed for user root Apr 29 15:05:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-ce655e9e-91df-47d3-b887-5c93bbfecb72 req-3515e82f-7b94-4b30-b2db-603686769fc6 tempest-TaggedAttachmentsTest-450372533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-406c0ce9-1031-4251-8aab-fc8ac1c94d10" returned: 0 in 1.783s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:05:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-ce655e9e-91df-47d3-b887-5c93bbfecb72 req-3515e82f-7b94-4b30-b2db-603686769fc6 tempest-TaggedAttachmentsTest-450372533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.802s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:05:52 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-ce655e9e-91df-47d3-b887-5c93bbfecb72 req-3515e82f-7b94-4b30-b2db-603686769fc6 tempest-TaggedAttachmentsTest-450372533 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a', 'name': 'volume-406c0ce9-1031-4251-8aab-fc8ac1c94d10', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd01b1b6e-cd23-496d-a50a-a9a7aca26168', 'enforce_multipath': True} {{(pid=84448) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 15:05:52 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-ce655e9e-91df-47d3-b887-5c93bbfecb72 req-3515e82f-7b94-4b30-b2db-603686769fc6 tempest-TaggedAttachmentsTest-450372533 None] attachment_update completed successfully. Apr 29 15:05:54 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-04839f28-6066-4fa4-b270-4ff563c185f3 tempest-VolumesAdminNegativeTest-72462655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:05:54 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-04839f28-6066-4fa4-b270-4ff563c185f3 tempest-VolumesAdminNegativeTest-72462655 None] Flow 'volume_create_manager' (53de0a1d-2422-4401-9871-31d229e20254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:05:55 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-04839f28-6066-4fa4-b270-4ff563c185f3 tempest-VolumesAdminNegativeTest-72462655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3b5d756-2111-4567-973d-7615dad08de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:05:55 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-04839f28-6066-4fa4-b270-4ff563c185f3 tempest-VolumesAdminNegativeTest-72462655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3b5d756-2111-4567-973d-7615dad08de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:05:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1333098035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a702f92b-105f-4a6e-9c51-21a84d7c702f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e63595b8c8d34205b2a6c0f61f0e91be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:05:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:05:55Z,use_quota=True,user_id='7de171c7f5b54821be36db5f022f9ad4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:05:55 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-04839f28-6066-4fa4-b270-4ff563c185f3 tempest-VolumesAdminNegativeTest-72462655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f00e001-e40d-4bc1-b89d-373c206ed21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:05:55 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-04839f28-6066-4fa4-b270-4ff563c185f3 tempest-VolumesAdminNegativeTest-72462655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f00e001-e40d-4bc1-b89d-373c206ed21d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:05:55 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-04839f28-6066-4fa4-b270-4ff563c185f3 tempest-VolumesAdminNegativeTest-72462655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d09ce5da-58c2-48f5-98c6-0180a0711479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:05:55 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-04839f28-6066-4fa4-b270-4ff563c185f3 tempest-VolumesAdminNegativeTest-72462655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d09ce5da-58c2-48f5-98c6-0180a0711479) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a702f92b-105f-4a6e-9c51-21a84d7c702f', 'volume_name': 'volume-a702f92b-105f-4a6e-9c51-21a84d7c702f', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:05:55 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-04839f28-6066-4fa4-b270-4ff563c185f3 tempest-VolumesAdminNegativeTest-72462655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2194593-4ec3-416c-b6fc-7fc7bb74afcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:05:55 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-04839f28-6066-4fa4-b270-4ff563c185f3 tempest-VolumesAdminNegativeTest-72462655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2194593-4ec3-416c-b6fc-7fc7bb74afcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:05:55 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-04839f28-6066-4fa4-b270-4ff563c185f3 tempest-VolumesAdminNegativeTest-72462655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a24f3b46-419c-4fc4-acc3-4923cf95534f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:05:55 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-04839f28-6066-4fa4-b270-4ff563c185f3 tempest-VolumesAdminNegativeTest-72462655 None] Volume a702f92b-105f-4a6e-9c51-21a84d7c702f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a702f92b-105f-4a6e-9c51-21a84d7c702f', 'volume_size': 1} Apr 29 15:05:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-04839f28-6066-4fa4-b270-4ff563c185f3 tempest-VolumesAdminNegativeTest-72462655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:05:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-04839f28-6066-4fa4-b270-4ff563c185f3 tempest-VolumesAdminNegativeTest-72462655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:05:55 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-04839f28-6066-4fa4-b270-4ff563c185f3 tempest-VolumesAdminNegativeTest-72462655 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:05:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1333098035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a702f92b-105f-4a6e-9c51-21a84d7c702f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e63595b8c8d34205b2a6c0f61f0e91be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:05:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:05:55Z,use_quota=True,user_id='7de171c7f5b54821be36db5f022f9ad4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:05:55 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-04839f28-6066-4fa4-b270-4ff563c185f3 tempest-VolumesAdminNegativeTest-72462655 None] Creating volume a702f92b-105f-4a6e-9c51-21a84d7c702f {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:05:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-04839f28-6066-4fa4-b270-4ff563c185f3 tempest-VolumesAdminNegativeTest-72462655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:05:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-04839f28-6066-4fa4-b270-4ff563c185f3 tempest-VolumesAdminNegativeTest-72462655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:05:55 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-04839f28-6066-4fa4-b270-4ff563c185f3 tempest-VolumesAdminNegativeTest-72462655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:05:55 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-04839f28-6066-4fa4-b270-4ff563c185f3 tempest-VolumesAdminNegativeTest-72462655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:05:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-04839f28-6066-4fa4-b270-4ff563c185f3 tempest-VolumesAdminNegativeTest-72462655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:05:55 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-04839f28-6066-4fa4-b270-4ff563c185f3 tempest-VolumesAdminNegativeTest-72462655 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:05:55 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-04839f28-6066-4fa4-b270-4ff563c185f3 tempest-VolumesAdminNegativeTest-72462655 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:05:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-04839f28-6066-4fa4-b270-4ff563c185f3 tempest-VolumesAdminNegativeTest-72462655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a702f92b-105f-4a6e-9c51-21a84d7c702f 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:05:55 devstack sudo[86866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a702f92b-105f-4a6e-9c51-21a84d7c702f 1073741824 Apr 29 15:05:55 devstack sudo[86866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:05:57 devstack sudo[86866]: pam_unix(sudo:session): session closed for user root Apr 29 15:05:57 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-04839f28-6066-4fa4-b270-4ff563c185f3 tempest-VolumesAdminNegativeTest-72462655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a702f92b-105f-4a6e-9c51-21a84d7c702f 1073741824" returned: 0 in 1.935s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:05:57 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-04839f28-6066-4fa4-b270-4ff563c185f3 tempest-VolumesAdminNegativeTest-72462655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a702f92b-105f-4a6e-9c51-21a84d7c702f {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:05:57 devstack sudo[86919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a702f92b-105f-4a6e-9c51-21a84d7c702f Apr 29 15:05:57 devstack sudo[86919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:05:58 devstack sudo[86919]: pam_unix(sudo:session): session closed for user root Apr 29 15:05:58 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-04839f28-6066-4fa4-b270-4ff563c185f3 tempest-VolumesAdminNegativeTest-72462655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a702f92b-105f-4a6e-9c51-21a84d7c702f" returned: 0 in 1.158s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:05:58 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-04839f28-6066-4fa4-b270-4ff563c185f3 tempest-VolumesAdminNegativeTest-72462655 None] <== create_volume: return (3249ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:05:58 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-04839f28-6066-4fa4-b270-4ff563c185f3 tempest-VolumesAdminNegativeTest-72462655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.253s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:05:58 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-04839f28-6066-4fa4-b270-4ff563c185f3 tempest-VolumesAdminNegativeTest-72462655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a24f3b46-419c-4fc4-acc3-4923cf95534f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a702f92b-105f-4a6e-9c51-21a84d7c702f', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:05:58 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-04839f28-6066-4fa4-b270-4ff563c185f3 tempest-VolumesAdminNegativeTest-72462655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38db9db3-a52c-4faa-a3f4-37b60d978d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:05:58 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-04839f28-6066-4fa4-b270-4ff563c185f3 tempest-VolumesAdminNegativeTest-72462655 None] Volume volume-a702f92b-105f-4a6e-9c51-21a84d7c702f (a702f92b-105f-4a6e-9c51-21a84d7c702f): created successfully Apr 29 15:05:58 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-04839f28-6066-4fa4-b270-4ff563c185f3 tempest-VolumesAdminNegativeTest-72462655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38db9db3-a52c-4faa-a3f4-37b60d978d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:05:58 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-04839f28-6066-4fa4-b270-4ff563c185f3 tempest-VolumesAdminNegativeTest-72462655 None] Flow 'volume_create_manager' (53de0a1d-2422-4401-9871-31d229e20254) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:05:58 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-04839f28-6066-4fa4-b270-4ff563c185f3 tempest-VolumesAdminNegativeTest-72462655 None] Created volume successfully. Apr 29 15:05:59 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-faa4212c-626d-43dd-ac89-0dafb42247ca tempest-VolumesAdminNegativeTest-72462655 None] Acquiring lock "cinder-a702f92b-105f-4a6e-9c51-21a84d7c702f-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:05:59 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-faa4212c-626d-43dd-ac89-0dafb42247ca tempest-VolumesAdminNegativeTest-72462655 None] Lock "cinder-a702f92b-105f-4a6e-9c51-21a84d7c702f-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:06:00 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-faa4212c-626d-43dd-ac89-0dafb42247ca tempest-VolumesAdminNegativeTest-72462655 None] Acquiring lock "cinder-quobyte-a702f92b-105f-4a6e-9c51-21a84d7c702f" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:06:00 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-faa4212c-626d-43dd-ac89-0dafb42247ca tempest-VolumesAdminNegativeTest-72462655 None] Lock "cinder-quobyte-a702f92b-105f-4a6e-9c51-21a84d7c702f" acquired by "delete_volume" :: waited 0.043s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:06:00 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[80780747-3da9-4858-bc3d-59a447d1018f]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:06:00 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-faa4212c-626d-43dd-ac89-0dafb42247ca tempest-VolumesAdminNegativeTest-72462655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a702f92b-105f-4a6e-9c51-21a84d7c702f {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:06:00 devstack sudo[86945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a702f92b-105f-4a6e-9c51-21a84d7c702f Apr 29 15:06:00 devstack sudo[86945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:06:01 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-707e8962-8318-40cd-af5e-141ed1afb163 req-acc680ea-dddb-4b6c-a14d-d4555406eb1f tempest-TaggedAttachmentsTest-450372533 None] Terminate volume connection completed successfully. Apr 29 15:06:01 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-707e8962-8318-40cd-af5e-141ed1afb163 req-acc680ea-dddb-4b6c-a14d-d4555406eb1f tempest-TaggedAttachmentsTest-450372533 None] Deleting attachment d01b1b6e-cd23-496d-a50a-a9a7aca26168. {{(pid=84448) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 15:06:01 devstack sudo[86945]: pam_unix(sudo:session): session closed for user root Apr 29 15:06:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-faa4212c-626d-43dd-ac89-0dafb42247ca tempest-VolumesAdminNegativeTest-72462655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a702f92b-105f-4a6e-9c51-21a84d7c702f" returned: 0 in 1.534s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:06:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-faa4212c-626d-43dd-ac89-0dafb42247ca tempest-VolumesAdminNegativeTest-72462655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a702f92b-105f-4a6e-9c51-21a84d7c702f {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:06:01 devstack sudo[86953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a702f92b-105f-4a6e-9c51-21a84d7c702f Apr 29 15:06:01 devstack sudo[86953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:06:03 devstack sudo[86953]: pam_unix(sudo:session): session closed for user root Apr 29 15:06:03 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-faa4212c-626d-43dd-ac89-0dafb42247ca tempest-VolumesAdminNegativeTest-72462655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a702f92b-105f-4a6e-9c51-21a84d7c702f" returned: 0 in 1.515s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:06:03 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-faa4212c-626d-43dd-ac89-0dafb42247ca tempest-VolumesAdminNegativeTest-72462655 None] Lock "cinder-quobyte-a702f92b-105f-4a6e-9c51-21a84d7c702f" released by "delete_volume" :: held 3.141s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:06:03 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-faa4212c-626d-43dd-ac89-0dafb42247ca tempest-VolumesAdminNegativeTest-72462655 None] Created reservations ['07eb20e1-172b-47f6-bd3b-976673bb2f8e', 'e44c0983-781d-4acc-8640-6ef5bc41f960', 'b6a2c4fb-4b90-407f-8581-24f074a520fc', 'ccde72fa-030c-4c94-ad24-76b86c05a5b9'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:06:03 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-faa4212c-626d-43dd-ac89-0dafb42247ca tempest-VolumesAdminNegativeTest-72462655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:06:03 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-faa4212c-626d-43dd-ac89-0dafb42247ca tempest-VolumesAdminNegativeTest-72462655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:06:03 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-faa4212c-626d-43dd-ac89-0dafb42247ca tempest-VolumesAdminNegativeTest-72462655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:06:03 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-faa4212c-626d-43dd-ac89-0dafb42247ca tempest-VolumesAdminNegativeTest-72462655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:06:03 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-faa4212c-626d-43dd-ac89-0dafb42247ca tempest-VolumesAdminNegativeTest-72462655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:06:03 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-faa4212c-626d-43dd-ac89-0dafb42247ca tempest-VolumesAdminNegativeTest-72462655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:06:03 devstack sudo[86982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:06:03 devstack sudo[86982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:06:04 devstack sudo[86982]: pam_unix(sudo:session): session closed for user root Apr 29 15:06:04 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-faa4212c-626d-43dd-ac89-0dafb42247ca tempest-VolumesAdminNegativeTest-72462655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 1.224s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:06:04 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-faa4212c-626d-43dd-ac89-0dafb42247ca tempest-VolumesAdminNegativeTest-72462655 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:06:04 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-faa4212c-626d-43dd-ac89-0dafb42247ca tempest-VolumesAdminNegativeTest-72462655 None] Deleted volume successfully. Apr 29 15:06:04 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-faa4212c-626d-43dd-ac89-0dafb42247ca tempest-VolumesAdminNegativeTest-72462655 None] Lock "cinder-a702f92b-105f-4a6e-9c51-21a84d7c702f-delete_volume" released by "delete_volume" :: held 4.949s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:06:13 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:SELECT=19,cinder:UPDATE=10,cinder:DELETE=1,cinder:INSERT=3 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:06:14 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:SELECT=8,cinder:UPDATE=15,cinder:INSERT=2,cinder:DELETE=1 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:06:26 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a1e77fc9-f9be-46f7-a084-b0d33547df72 tempest-TaggedAttachmentsTest-450372533 None] Acquiring lock "cinder-406c0ce9-1031-4251-8aab-fc8ac1c94d10-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:06:27 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a1e77fc9-f9be-46f7-a084-b0d33547df72 tempest-TaggedAttachmentsTest-450372533 None] Lock "cinder-406c0ce9-1031-4251-8aab-fc8ac1c94d10-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:06:27 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a1e77fc9-f9be-46f7-a084-b0d33547df72 tempest-TaggedAttachmentsTest-450372533 None] Acquiring lock "cinder-quobyte-406c0ce9-1031-4251-8aab-fc8ac1c94d10" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:06:27 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a1e77fc9-f9be-46f7-a084-b0d33547df72 tempest-TaggedAttachmentsTest-450372533 None] Lock "cinder-quobyte-406c0ce9-1031-4251-8aab-fc8ac1c94d10" acquired by "delete_volume" :: waited 0.030s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:06:27 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d61345-f026-4ffb-aef7-a1ff993132e7]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:06:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a1e77fc9-f9be-46f7-a084-b0d33547df72 tempest-TaggedAttachmentsTest-450372533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-406c0ce9-1031-4251-8aab-fc8ac1c94d10 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:06:27 devstack sudo[87226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-406c0ce9-1031-4251-8aab-fc8ac1c94d10 Apr 29 15:06:27 devstack sudo[87226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:06:27 devstack sudo[87226]: pam_unix(sudo:session): session closed for user root Apr 29 15:06:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a1e77fc9-f9be-46f7-a084-b0d33547df72 tempest-TaggedAttachmentsTest-450372533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-406c0ce9-1031-4251-8aab-fc8ac1c94d10" returned: 0 in 0.849s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:06:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a1e77fc9-f9be-46f7-a084-b0d33547df72 tempest-TaggedAttachmentsTest-450372533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-406c0ce9-1031-4251-8aab-fc8ac1c94d10 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:06:28 devstack sudo[87232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-406c0ce9-1031-4251-8aab-fc8ac1c94d10 Apr 29 15:06:28 devstack sudo[87232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:06:28 devstack sudo[87232]: pam_unix(sudo:session): session closed for user root Apr 29 15:06:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a1e77fc9-f9be-46f7-a084-b0d33547df72 tempest-TaggedAttachmentsTest-450372533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-406c0ce9-1031-4251-8aab-fc8ac1c94d10" returned: 0 in 0.839s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:06:28 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a1e77fc9-f9be-46f7-a084-b0d33547df72 tempest-TaggedAttachmentsTest-450372533 None] Lock "cinder-quobyte-406c0ce9-1031-4251-8aab-fc8ac1c94d10" released by "delete_volume" :: held 1.748s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:06:28 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-a1e77fc9-f9be-46f7-a084-b0d33547df72 tempest-TaggedAttachmentsTest-450372533 None] Created reservations ['5b266eeb-1473-43b9-997e-8234c0001c08', '395011f0-5527-44ba-8e66-ba589d06f382', '13547136-1626-4b6b-9e71-96bd596e841a', 'ed0254f8-510f-4b27-a7ce-f4ee42412cd9'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:06:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-a1e77fc9-f9be-46f7-a084-b0d33547df72 tempest-TaggedAttachmentsTest-450372533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:06:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-a1e77fc9-f9be-46f7-a084-b0d33547df72 tempest-TaggedAttachmentsTest-450372533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:06:29 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-a1e77fc9-f9be-46f7-a084-b0d33547df72 tempest-TaggedAttachmentsTest-450372533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:06:29 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-a1e77fc9-f9be-46f7-a084-b0d33547df72 tempest-TaggedAttachmentsTest-450372533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:06:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-a1e77fc9-f9be-46f7-a084-b0d33547df72 tempest-TaggedAttachmentsTest-450372533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:06:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a1e77fc9-f9be-46f7-a084-b0d33547df72 tempest-TaggedAttachmentsTest-450372533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:06:29 devstack sudo[87242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:06:29 devstack sudo[87242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:06:29 devstack sudo[87242]: pam_unix(sudo:session): session closed for user root Apr 29 15:06:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a1e77fc9-f9be-46f7-a084-b0d33547df72 tempest-TaggedAttachmentsTest-450372533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.839s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:06:29 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-a1e77fc9-f9be-46f7-a084-b0d33547df72 tempest-TaggedAttachmentsTest-450372533 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:06:29 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-a1e77fc9-f9be-46f7-a084-b0d33547df72 tempest-TaggedAttachmentsTest-450372533 None] Deleted volume successfully. Apr 29 15:06:29 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a1e77fc9-f9be-46f7-a084-b0d33547df72 tempest-TaggedAttachmentsTest-450372533 None] Lock "cinder-406c0ce9-1031-4251-8aab-fc8ac1c94d10-delete_volume" released by "delete_volume" :: held 2.948s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:06:30 devstack cinder-volume[84448]: DEBUG oslo_service.periodic_task [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84448) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 15:06:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:06:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:06:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:06:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:06:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:06:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:06:30 devstack sudo[87246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:06:30 devstack sudo[87246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:06:31 devstack sudo[87246]: pam_unix(sudo:session): session closed for user root Apr 29 15:06:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.741s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:06:31 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:06:39 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=6 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:06:39 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:UPDATE=10,cinder:SELECT=4,cinder:INSERT=2,cinder:DELETE=1 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:07:03 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-2d2c3208-2327-4da8-9caa-21878a819e12 req-506461c6-e9b0-4aef-ad75-803ef81d7fc4 tempest-TaggedBootDevicesTest-203877183 None] Terminate volume connection completed successfully. Apr 29 15:07:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-2d2c3208-2327-4da8-9caa-21878a819e12 req-506461c6-e9b0-4aef-ad75-803ef81d7fc4 tempest-TaggedBootDevicesTest-203877183 None] Deleting attachment 70ff69e7-3fa5-405d-a606-6ef6695a965e. {{(pid=84448) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 15:07:03 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-2d2c3208-2327-4da8-9caa-21878a819e12 req-1c571d10-8a5f-48dd-8db9-21d81822621b tempest-TaggedBootDevicesTest-203877183 None] Terminate volume connection completed successfully. Apr 29 15:07:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-2d2c3208-2327-4da8-9caa-21878a819e12 req-1c571d10-8a5f-48dd-8db9-21d81822621b tempest-TaggedBootDevicesTest-203877183 None] Deleting attachment 50021945-2ae3-4234-a5c3-f6c3bfe3dce1. {{(pid=84448) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 15:07:04 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-2d2c3208-2327-4da8-9caa-21878a819e12 req-a43d3c9c-eabb-418a-a044-5c5683653238 tempest-TaggedBootDevicesTest-203877183 None] Terminate volume connection completed successfully. Apr 29 15:07:04 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-2d2c3208-2327-4da8-9caa-21878a819e12 req-a43d3c9c-eabb-418a-a044-5c5683653238 tempest-TaggedBootDevicesTest-203877183 None] Deleting attachment f3cb6ebe-2cff-4f0a-8d80-ffd4acd5ae70. {{(pid=84448) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 15:07:14 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:SELECT=3 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:07:14 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:SELECT=3 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:07:14 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-125802da-9d93-4f3e-9f7b-f9cbcbfc656a tempest-TaggedBootDevicesTest-203877183 None] Acquiring lock "cinder-d1ec5bc3-a39d-49e4-9d9a-fe3f0b8a44b8-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:07:14 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-125802da-9d93-4f3e-9f7b-f9cbcbfc656a tempest-TaggedBootDevicesTest-203877183 None] Lock "cinder-d1ec5bc3-a39d-49e4-9d9a-fe3f0b8a44b8-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:07:14 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-125802da-9d93-4f3e-9f7b-f9cbcbfc656a tempest-TaggedBootDevicesTest-203877183 None] Acquiring lock "cinder-quobyte-d1ec5bc3-a39d-49e4-9d9a-fe3f0b8a44b8" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:07:14 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-125802da-9d93-4f3e-9f7b-f9cbcbfc656a tempest-TaggedBootDevicesTest-203877183 None] Lock "cinder-quobyte-d1ec5bc3-a39d-49e4-9d9a-fe3f0b8a44b8" acquired by "delete_volume" :: waited 0.019s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:07:14 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a1eca7-77dc-4244-a440-5d5e0e32b70f]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:07:14 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-125802da-9d93-4f3e-9f7b-f9cbcbfc656a tempest-TaggedBootDevicesTest-203877183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d1ec5bc3-a39d-49e4-9d9a-fe3f0b8a44b8 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:07:14 devstack sudo[87718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d1ec5bc3-a39d-49e4-9d9a-fe3f0b8a44b8 Apr 29 15:07:14 devstack sudo[87718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:07:15 devstack sudo[87718]: pam_unix(sudo:session): session closed for user root Apr 29 15:07:15 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-125802da-9d93-4f3e-9f7b-f9cbcbfc656a tempest-TaggedBootDevicesTest-203877183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d1ec5bc3-a39d-49e4-9d9a-fe3f0b8a44b8" returned: 0 in 1.047s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:07:15 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-125802da-9d93-4f3e-9f7b-f9cbcbfc656a tempest-TaggedBootDevicesTest-203877183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d1ec5bc3-a39d-49e4-9d9a-fe3f0b8a44b8 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:07:15 devstack sudo[87823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d1ec5bc3-a39d-49e4-9d9a-fe3f0b8a44b8 Apr 29 15:07:15 devstack sudo[87823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:07:16 devstack sudo[87823]: pam_unix(sudo:session): session closed for user root Apr 29 15:07:16 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-125802da-9d93-4f3e-9f7b-f9cbcbfc656a tempest-TaggedBootDevicesTest-203877183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d1ec5bc3-a39d-49e4-9d9a-fe3f0b8a44b8" returned: 0 in 1.143s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:07:16 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-125802da-9d93-4f3e-9f7b-f9cbcbfc656a tempest-TaggedBootDevicesTest-203877183 None] Lock "cinder-quobyte-d1ec5bc3-a39d-49e4-9d9a-fe3f0b8a44b8" released by "delete_volume" :: held 2.239s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:07:16 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-125802da-9d93-4f3e-9f7b-f9cbcbfc656a tempest-TaggedBootDevicesTest-203877183 None] Created reservations ['fbe113be-e51b-417a-9a0d-5e539b612dad', '2a187dfa-23dd-4cbb-90a8-17f64ce24cf8', '4b33a814-5ab6-4a2c-8165-498f8e039727', '36d89702-87a2-440e-82a3-cd0feff4630a'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:07:17 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-125802da-9d93-4f3e-9f7b-f9cbcbfc656a tempest-TaggedBootDevicesTest-203877183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:07:17 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-125802da-9d93-4f3e-9f7b-f9cbcbfc656a tempest-TaggedBootDevicesTest-203877183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:07:17 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-125802da-9d93-4f3e-9f7b-f9cbcbfc656a tempest-TaggedBootDevicesTest-203877183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:07:17 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-125802da-9d93-4f3e-9f7b-f9cbcbfc656a tempest-TaggedBootDevicesTest-203877183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:07:17 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-125802da-9d93-4f3e-9f7b-f9cbcbfc656a tempest-TaggedBootDevicesTest-203877183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:07:17 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-125802da-9d93-4f3e-9f7b-f9cbcbfc656a tempest-TaggedBootDevicesTest-203877183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:07:17 devstack sudo[87851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:07:17 devstack sudo[87851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:07:18 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-3b51adc2-f143-41bb-b1d5-0761edc8d24c tempest-TaggedBootDevicesTest-203877183 None] Acquiring lock "cinder-1e8f035c-9d91-4672-bb45-150f615437e1-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:07:18 devstack sudo[87851]: pam_unix(sudo:session): session closed for user root Apr 29 15:07:18 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-3b51adc2-f143-41bb-b1d5-0761edc8d24c tempest-TaggedBootDevicesTest-203877183 None] Lock "cinder-1e8f035c-9d91-4672-bb45-150f615437e1-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:07:18 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-125802da-9d93-4f3e-9f7b-f9cbcbfc656a tempest-TaggedBootDevicesTest-203877183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 1.154s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:07:18 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-125802da-9d93-4f3e-9f7b-f9cbcbfc656a tempest-TaggedBootDevicesTest-203877183 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:07:18 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-125802da-9d93-4f3e-9f7b-f9cbcbfc656a tempest-TaggedBootDevicesTest-203877183 None] Deleted volume successfully. Apr 29 15:07:18 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-125802da-9d93-4f3e-9f7b-f9cbcbfc656a tempest-TaggedBootDevicesTest-203877183 None] Lock "cinder-d1ec5bc3-a39d-49e4-9d9a-fe3f0b8a44b8-delete_volume" released by "delete_volume" :: held 3.667s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:07:18 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-3b51adc2-f143-41bb-b1d5-0761edc8d24c tempest-TaggedBootDevicesTest-203877183 None] Acquiring lock "cinder-quobyte-1e8f035c-9d91-4672-bb45-150f615437e1" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:07:18 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-3b51adc2-f143-41bb-b1d5-0761edc8d24c tempest-TaggedBootDevicesTest-203877183 None] Lock "cinder-quobyte-1e8f035c-9d91-4672-bb45-150f615437e1" acquired by "delete_volume" :: waited 0.030s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:07:18 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d35c2f-7186-4720-a0f9-8baa19eb21ce]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:07:18 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-3b51adc2-f143-41bb-b1d5-0761edc8d24c tempest-TaggedBootDevicesTest-203877183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1e8f035c-9d91-4672-bb45-150f615437e1 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:07:18 devstack sudo[87906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1e8f035c-9d91-4672-bb45-150f615437e1 Apr 29 15:07:18 devstack sudo[87906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:07:19 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-443a3a2a-ef80-4019-9cf1-9860f9ab807e tempest-TaggedBootDevicesTest_v242-1336169590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:07:19 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-443a3a2a-ef80-4019-9cf1-9860f9ab807e tempest-TaggedBootDevicesTest_v242-1336169590 None] Flow 'volume_create_manager' (20f915cf-2df7-4100-957c-03f89e70ac0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:07:19 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-443a3a2a-ef80-4019-9cf1-9860f9ab807e tempest-TaggedBootDevicesTest_v242-1336169590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b7dea10-27c0-48ed-b3c5-a6160b8f91bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:07:19 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-443a3a2a-ef80-4019-9cf1-9860f9ab807e tempest-TaggedBootDevicesTest_v242-1336169590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b7dea10-27c0-48ed-b3c5-a6160b8f91bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:07:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-422781761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c3ebf48-e6c9-4ca7-8372-c5bcb99850ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50677cb3d8f04596997faaa9b2e03f77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:07:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:07:19Z,use_quota=True,user_id='f22207d509f548a582861eb4f325373a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:07:19 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-443a3a2a-ef80-4019-9cf1-9860f9ab807e tempest-TaggedBootDevicesTest_v242-1336169590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59073858-6f26-4129-bdea-90da4121c5cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:07:19 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-443a3a2a-ef80-4019-9cf1-9860f9ab807e tempest-TaggedBootDevicesTest_v242-1336169590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59073858-6f26-4129-bdea-90da4121c5cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:07:19 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-443a3a2a-ef80-4019-9cf1-9860f9ab807e tempest-TaggedBootDevicesTest_v242-1336169590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a18bc8e9-96e9-4fd7-aa3f-afb455b7d66a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:07:19 devstack cinder-volume[84448]: DEBUG cinder.image.glance [None req-443a3a2a-ef80-4019-9cf1-9860f9ab807e tempest-TaggedBootDevicesTest_v242-1336169590 None] Creating Keystone auth plugin from conf {{(pid=84448) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 29 15:07:19 devstack sudo[87906]: pam_unix(sudo:session): session closed for user root Apr 29 15:07:19 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-3b51adc2-f143-41bb-b1d5-0761edc8d24c tempest-TaggedBootDevicesTest-203877183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1e8f035c-9d91-4672-bb45-150f615437e1" returned: 0 in 1.098s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:07:19 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-3b51adc2-f143-41bb-b1d5-0761edc8d24c tempest-TaggedBootDevicesTest-203877183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1e8f035c-9d91-4672-bb45-150f615437e1 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:07:19 devstack sudo[87915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1e8f035c-9d91-4672-bb45-150f615437e1 Apr 29 15:07:19 devstack sudo[87915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:07:19 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-443a3a2a-ef80-4019-9cf1-9860f9ab807e tempest-TaggedBootDevicesTest_v242-1336169590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a18bc8e9-96e9-4fd7-aa3f-afb455b7d66a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0c3ebf48-e6c9-4ca7-8372-c5bcb99850ab', 'volume_name': 'volume-0c3ebf48-e6c9-4ca7-8372-c5bcb99850ab', 'volume_size': 1, 'image_id': 'ad86f424-7d2a-4f3b-9577-890075e7dc72', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ad86f424-7d2a-4f3b-9577-890075e7dc72', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '33db0ca5091747b1a3438d70bf53390c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ad86f424-7d2a-4f3b-9577-890075e7dc72', 'created_at': datetime.datetime(2026, 4, 29, 13, 0, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 13, 0, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ad86f424-7d2a-4f3b-9577-890075e7dc72/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:07:19 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-443a3a2a-ef80-4019-9cf1-9860f9ab807e tempest-TaggedBootDevicesTest_v242-1336169590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16e5ee18-4e4f-463e-b38e-f79879f2761c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:07:19 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-443a3a2a-ef80-4019-9cf1-9860f9ab807e tempest-TaggedBootDevicesTest_v242-1336169590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16e5ee18-4e4f-463e-b38e-f79879f2761c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:07:19 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-443a3a2a-ef80-4019-9cf1-9860f9ab807e tempest-TaggedBootDevicesTest_v242-1336169590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee6d1aab-8e55-46eb-9aa7-2fe4c3bbadf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:07:19 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-443a3a2a-ef80-4019-9cf1-9860f9ab807e tempest-TaggedBootDevicesTest_v242-1336169590 None] Volume 0c3ebf48-e6c9-4ca7-8372-c5bcb99850ab: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0c3ebf48-e6c9-4ca7-8372-c5bcb99850ab', 'volume_size': 1, 'image_id': 'ad86f424-7d2a-4f3b-9577-890075e7dc72', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ad86f424-7d2a-4f3b-9577-890075e7dc72', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '33db0ca5091747b1a3438d70bf53390c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ad86f424-7d2a-4f3b-9577-890075e7dc72', 'created_at': datetime.datetime(2026, 4, 29, 13, 0, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 13, 0, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ad86f424-7d2a-4f3b-9577-890075e7dc72/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 29 15:07:19 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-443a3a2a-ef80-4019-9cf1-9860f9ab807e tempest-TaggedBootDevicesTest_v242-1336169590 None] Trying to clone 0c3ebf48-e6c9-4ca7-8372-c5bcb99850ab from image ad86f424-7d2a-4f3b-9577-890075e7dc72 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ad86f424-7d2a-4f3b-9577-890075e7dc72', 'metadata': {}}]). {{(pid=84448) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 29 15:07:20 devstack sudo[87915]: pam_unix(sudo:session): session closed for user root Apr 29 15:07:20 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-3b51adc2-f143-41bb-b1d5-0761edc8d24c tempest-TaggedBootDevicesTest-203877183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1e8f035c-9d91-4672-bb45-150f615437e1" returned: 0 in 0.795s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:07:20 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-3b51adc2-f143-41bb-b1d5-0761edc8d24c tempest-TaggedBootDevicesTest-203877183 None] Lock "cinder-quobyte-1e8f035c-9d91-4672-bb45-150f615437e1" released by "delete_volume" :: held 1.955s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:07:20 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [None req-443a3a2a-ef80-4019-9cf1-9860f9ab807e tempest-TaggedBootDevicesTest_v242-1336169590 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_jfcd6ni0devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84448) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 29 15:07:20 devstack cinder-volume[84448]: INFO cinder.image.image_utils [None req-443a3a2a-ef80-4019-9cf1-9860f9ab807e tempest-TaggedBootDevicesTest_v242-1336169590 None] Image download 20.69 MB at 20.69 MB/s Apr 29 15:07:20 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-3b51adc2-f143-41bb-b1d5-0761edc8d24c tempest-TaggedBootDevicesTest-203877183 None] Created reservations ['68754d6a-fa4d-4e25-8acd-28a9ead24b74', '3e51b761-423f-4e8c-a2f9-3b0735416a96', '1422cf1d-b072-4816-84af-26dfa64e5b16', 'c0b3b429-a478-45dc-bd25-e33f4246b05f'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:07:20 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e0e722-ba8e-47d3-a2c7-06a225890066]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:07:20 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-443a3a2a-ef80-4019-9cf1-9860f9ab807e tempest-TaggedBootDevicesTest_v242-1336169590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_jfcd6ni0devstack@QuobyteHD {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:07:20 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-3b51adc2-f143-41bb-b1d5-0761edc8d24c tempest-TaggedBootDevicesTest-203877183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:07:20 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-3b51adc2-f143-41bb-b1d5-0761edc8d24c tempest-TaggedBootDevicesTest-203877183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:07:20 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-3b51adc2-f143-41bb-b1d5-0761edc8d24c tempest-TaggedBootDevicesTest-203877183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:07:20 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-3b51adc2-f143-41bb-b1d5-0761edc8d24c tempest-TaggedBootDevicesTest-203877183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:07:20 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-3b51adc2-f143-41bb-b1d5-0761edc8d24c tempest-TaggedBootDevicesTest-203877183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:07:20 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-3b51adc2-f143-41bb-b1d5-0761edc8d24c tempest-TaggedBootDevicesTest-203877183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:07:20 devstack sudo[87919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_jfcd6ni0devstack@QuobyteHD Apr 29 15:07:20 devstack sudo[87919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:07:20 devstack sudo[87920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:07:20 devstack sudo[87920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:07:21 devstack sudo[87920]: pam_unix(sudo:session): session closed for user root Apr 29 15:07:21 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-3b51adc2-f143-41bb-b1d5-0761edc8d24c tempest-TaggedBootDevicesTest-203877183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.730s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:07:21 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-3b51adc2-f143-41bb-b1d5-0761edc8d24c tempest-TaggedBootDevicesTest-203877183 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:07:21 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-3b51adc2-f143-41bb-b1d5-0761edc8d24c tempest-TaggedBootDevicesTest-203877183 None] Deleted volume successfully. Apr 29 15:07:21 devstack sudo[87919]: pam_unix(sudo:session): session closed for user root Apr 29 15:07:21 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-443a3a2a-ef80-4019-9cf1-9860f9ab807e tempest-TaggedBootDevicesTest_v242-1336169590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_jfcd6ni0devstack@QuobyteHD" returned: 0 in 0.871s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:07:21 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [None req-443a3a2a-ef80-4019-9cf1-9860f9ab807e tempest-TaggedBootDevicesTest_v242-1336169590 None] Temporary image ad86f424-7d2a-4f3b-9577-890075e7dc72 is fetched for user f22207d509f548a582861eb4f325373a. {{(pid=84448) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 29 15:07:21 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-3b51adc2-f143-41bb-b1d5-0761edc8d24c tempest-TaggedBootDevicesTest-203877183 None] Lock "cinder-1e8f035c-9d91-4672-bb45-150f615437e1-delete_volume" released by "delete_volume" :: held 3.179s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:07:21 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d81a337-e532-4a21-8dc3-424801f2dbfa]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:07:21 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-443a3a2a-ef80-4019-9cf1-9860f9ab807e tempest-TaggedBootDevicesTest_v242-1336169590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_jfcd6ni0devstack@QuobyteHD {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:07:21 devstack sudo[87928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_jfcd6ni0devstack@QuobyteHD Apr 29 15:07:21 devstack sudo[87928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:07:21 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-78fd32f1-b625-47b4-95b6-2503df0a10f4 tempest-TaggedBootDevicesTest-203877183 None] Acquiring lock "cinder-3249b149-35ec-4604-a2c5-04dd4a504dc8-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:07:21 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-78fd32f1-b625-47b4-95b6-2503df0a10f4 tempest-TaggedBootDevicesTest-203877183 None] Lock "cinder-3249b149-35ec-4604-a2c5-04dd4a504dc8-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:07:21 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-78fd32f1-b625-47b4-95b6-2503df0a10f4 tempest-TaggedBootDevicesTest-203877183 None] Acquiring lock "cinder-quobyte-3249b149-35ec-4604-a2c5-04dd4a504dc8" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:07:21 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-78fd32f1-b625-47b4-95b6-2503df0a10f4 tempest-TaggedBootDevicesTest-203877183 None] Lock "cinder-quobyte-3249b149-35ec-4604-a2c5-04dd4a504dc8" acquired by "delete_volume" :: waited 0.036s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:07:22 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[367028b2-146f-49f2-a5e4-fc0d72633cd5]: (4, 'raw') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:07:22 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-78fd32f1-b625-47b4-95b6-2503df0a10f4 tempest-TaggedBootDevicesTest-203877183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3249b149-35ec-4604-a2c5-04dd4a504dc8 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:07:22 devstack sudo[87932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3249b149-35ec-4604-a2c5-04dd4a504dc8 Apr 29 15:07:22 devstack sudo[87932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:07:22 devstack sudo[87928]: pam_unix(sudo:session): session closed for user root Apr 29 15:07:22 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-443a3a2a-ef80-4019-9cf1-9860f9ab807e tempest-TaggedBootDevicesTest_v242-1336169590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_jfcd6ni0devstack@QuobyteHD" returned: 0 in 1.452s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:07:22 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-443a3a2a-ef80-4019-9cf1-9860f9ab807e tempest-TaggedBootDevicesTest_v242-1336169590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:07:22 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-443a3a2a-ef80-4019-9cf1-9860f9ab807e tempest-TaggedBootDevicesTest_v242-1336169590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:07:22 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-443a3a2a-ef80-4019-9cf1-9860f9ab807e tempest-TaggedBootDevicesTest_v242-1336169590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:07:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-422781761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c3ebf48-e6c9-4ca7-8372-c5bcb99850ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50677cb3d8f04596997faaa9b2e03f77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:07:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:07:19Z,use_quota=True,user_id='f22207d509f548a582861eb4f325373a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:07:22 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-443a3a2a-ef80-4019-9cf1-9860f9ab807e tempest-TaggedBootDevicesTest_v242-1336169590 None] Creating volume 0c3ebf48-e6c9-4ca7-8372-c5bcb99850ab {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:07:22 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-443a3a2a-ef80-4019-9cf1-9860f9ab807e tempest-TaggedBootDevicesTest_v242-1336169590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:07:22 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-443a3a2a-ef80-4019-9cf1-9860f9ab807e tempest-TaggedBootDevicesTest_v242-1336169590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:07:22 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-443a3a2a-ef80-4019-9cf1-9860f9ab807e tempest-TaggedBootDevicesTest_v242-1336169590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:07:22 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-443a3a2a-ef80-4019-9cf1-9860f9ab807e tempest-TaggedBootDevicesTest_v242-1336169590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:07:22 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-443a3a2a-ef80-4019-9cf1-9860f9ab807e tempest-TaggedBootDevicesTest_v242-1336169590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:07:22 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-443a3a2a-ef80-4019-9cf1-9860f9ab807e tempest-TaggedBootDevicesTest_v242-1336169590 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:07:22 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-443a3a2a-ef80-4019-9cf1-9860f9ab807e tempest-TaggedBootDevicesTest_v242-1336169590 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:07:22 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-443a3a2a-ef80-4019-9cf1-9860f9ab807e tempest-TaggedBootDevicesTest_v242-1336169590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0c3ebf48-e6c9-4ca7-8372-c5bcb99850ab 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:07:23 devstack sudo[87937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0c3ebf48-e6c9-4ca7-8372-c5bcb99850ab 1073741824 Apr 29 15:07:23 devstack sudo[87937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:07:24 devstack sudo[87932]: pam_unix(sudo:session): session closed for user root Apr 29 15:07:24 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-78fd32f1-b625-47b4-95b6-2503df0a10f4 tempest-TaggedBootDevicesTest-203877183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3249b149-35ec-4604-a2c5-04dd4a504dc8" returned: 0 in 2.035s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:07:24 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-78fd32f1-b625-47b4-95b6-2503df0a10f4 tempest-TaggedBootDevicesTest-203877183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3249b149-35ec-4604-a2c5-04dd4a504dc8 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:07:24 devstack sudo[87944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3249b149-35ec-4604-a2c5-04dd4a504dc8 Apr 29 15:07:24 devstack sudo[87944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:07:25 devstack sudo[87937]: pam_unix(sudo:session): session closed for user root Apr 29 15:07:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-443a3a2a-ef80-4019-9cf1-9860f9ab807e tempest-TaggedBootDevicesTest_v242-1336169590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0c3ebf48-e6c9-4ca7-8372-c5bcb99850ab 1073741824" returned: 0 in 2.136s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:07:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-443a3a2a-ef80-4019-9cf1-9860f9ab807e tempest-TaggedBootDevicesTest_v242-1336169590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0c3ebf48-e6c9-4ca7-8372-c5bcb99850ab {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:07:25 devstack sudo[87967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0c3ebf48-e6c9-4ca7-8372-c5bcb99850ab Apr 29 15:07:25 devstack sudo[87967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:07:25 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-06d9f365-cf98-421c-9fb8-6ab97041bea6 tempest-DeleteServersTestJSON-857384166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:07:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-06d9f365-cf98-421c-9fb8-6ab97041bea6 tempest-DeleteServersTestJSON-857384166 None] Flow 'volume_create_manager' (15044b79-fa24-4019-8fe3-ab0b053e6b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:07:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-06d9f365-cf98-421c-9fb8-6ab97041bea6 tempest-DeleteServersTestJSON-857384166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1214b31-5085-483d-9243-97b8fd85d354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:07:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-06d9f365-cf98-421c-9fb8-6ab97041bea6 tempest-DeleteServersTestJSON-857384166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1214b31-5085-483d-9243-97b8fd85d354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:07:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-54118609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=276cf456-163d-41b3-9eda-69f682d7a43a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee9257f4aa1841b496f51049021e7db4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:07:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:07:25Z,use_quota=True,user_id='b3785d48d6e143ddac1df4bd1f407a58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:07:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-06d9f365-cf98-421c-9fb8-6ab97041bea6 tempest-DeleteServersTestJSON-857384166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6db7a910-b61c-4988-a935-142d5b72d770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:07:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-06d9f365-cf98-421c-9fb8-6ab97041bea6 tempest-DeleteServersTestJSON-857384166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6db7a910-b61c-4988-a935-142d5b72d770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:07:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-06d9f365-cf98-421c-9fb8-6ab97041bea6 tempest-DeleteServersTestJSON-857384166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16f36bcd-7a40-4157-a585-d04c24cce713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:07:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-06d9f365-cf98-421c-9fb8-6ab97041bea6 tempest-DeleteServersTestJSON-857384166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16f36bcd-7a40-4157-a585-d04c24cce713) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '276cf456-163d-41b3-9eda-69f682d7a43a', 'volume_name': 'volume-276cf456-163d-41b3-9eda-69f682d7a43a', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:07:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-06d9f365-cf98-421c-9fb8-6ab97041bea6 tempest-DeleteServersTestJSON-857384166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99954971-3acf-4fcd-93d1-e625ced7e928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:07:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-06d9f365-cf98-421c-9fb8-6ab97041bea6 tempest-DeleteServersTestJSON-857384166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99954971-3acf-4fcd-93d1-e625ced7e928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:07:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-06d9f365-cf98-421c-9fb8-6ab97041bea6 tempest-DeleteServersTestJSON-857384166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fc9270f-31eb-487c-8e82-e132c85243c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:07:25 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-06d9f365-cf98-421c-9fb8-6ab97041bea6 tempest-DeleteServersTestJSON-857384166 None] Volume 276cf456-163d-41b3-9eda-69f682d7a43a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-276cf456-163d-41b3-9eda-69f682d7a43a', 'volume_size': 1} Apr 29 15:07:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-06d9f365-cf98-421c-9fb8-6ab97041bea6 tempest-DeleteServersTestJSON-857384166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:07:25 devstack sudo[87944]: pam_unix(sudo:session): session closed for user root Apr 29 15:07:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-78fd32f1-b625-47b4-95b6-2503df0a10f4 tempest-TaggedBootDevicesTest-203877183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3249b149-35ec-4604-a2c5-04dd4a504dc8" returned: 1 in 1.758s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:07:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-78fd32f1-b625-47b4-95b6-2503df0a10f4 tempest-TaggedBootDevicesTest-203877183 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3249b149-35ec-4604-a2c5-04dd4a504dc8' failed. Not Retrying. {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 15:07:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-78fd32f1-b625-47b4-95b6-2503df0a10f4 tempest-TaggedBootDevicesTest-203877183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3249b149-35ec-4604-a2c5-04dd4a504dc8 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:07:25 devstack sudo[87972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3249b149-35ec-4604-a2c5-04dd4a504dc8 Apr 29 15:07:26 devstack sudo[87972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:07:26 devstack sudo[87967]: pam_unix(sudo:session): session closed for user root Apr 29 15:07:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-443a3a2a-ef80-4019-9cf1-9860f9ab807e tempest-TaggedBootDevicesTest_v242-1336169590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0c3ebf48-e6c9-4ca7-8372-c5bcb99850ab" returned: 0 in 1.112s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:07:26 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-443a3a2a-ef80-4019-9cf1-9860f9ab807e tempest-TaggedBootDevicesTest_v242-1336169590 None] <== create_volume: return (3376ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:07:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-443a3a2a-ef80-4019-9cf1-9860f9ab807e tempest-TaggedBootDevicesTest_v242-1336169590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.389s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:07:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-06d9f365-cf98-421c-9fb8-6ab97041bea6 tempest-DeleteServersTestJSON-857384166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.736s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:07:26 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-06d9f365-cf98-421c-9fb8-6ab97041bea6 tempest-DeleteServersTestJSON-857384166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:07:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-54118609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=276cf456-163d-41b3-9eda-69f682d7a43a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee9257f4aa1841b496f51049021e7db4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:07:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:07:25Z,use_quota=True,user_id='b3785d48d6e143ddac1df4bd1f407a58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:07:26 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-06d9f365-cf98-421c-9fb8-6ab97041bea6 tempest-DeleteServersTestJSON-857384166 None] Creating volume 276cf456-163d-41b3-9eda-69f682d7a43a {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:07:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-06d9f365-cf98-421c-9fb8-6ab97041bea6 tempest-DeleteServersTestJSON-857384166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:07:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-06d9f365-cf98-421c-9fb8-6ab97041bea6 tempest-DeleteServersTestJSON-857384166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:07:26 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-06d9f365-cf98-421c-9fb8-6ab97041bea6 tempest-DeleteServersTestJSON-857384166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:07:26 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-06d9f365-cf98-421c-9fb8-6ab97041bea6 tempest-DeleteServersTestJSON-857384166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:07:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-06d9f365-cf98-421c-9fb8-6ab97041bea6 tempest-DeleteServersTestJSON-857384166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:07:26 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-06d9f365-cf98-421c-9fb8-6ab97041bea6 tempest-DeleteServersTestJSON-857384166 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:07:26 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-06d9f365-cf98-421c-9fb8-6ab97041bea6 tempest-DeleteServersTestJSON-857384166 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:07:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-06d9f365-cf98-421c-9fb8-6ab97041bea6 tempest-DeleteServersTestJSON-857384166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-276cf456-163d-41b3-9eda-69f682d7a43a 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:07:26 devstack cinder-volume[84448]: DEBUG cinder.volume.volume_utils [None req-443a3a2a-ef80-4019-9cf1-9860f9ab807e tempest-TaggedBootDevicesTest_v242-1336169590 None] Attempting download of ad86f424-7d2a-4f3b-9577-890075e7dc72 ((None, [{'url': 'file:///opt/stack/data/glance/images/ad86f424-7d2a-4f3b-9577-890075e7dc72', 'metadata': {}}])) to volume 0c3ebf48-e6c9-4ca7-8372-c5bcb99850ab. {{(pid=84448) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 29 15:07:26 devstack sudo[87975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-276cf456-163d-41b3-9eda-69f682d7a43a 1073741824 Apr 29 15:07:26 devstack sudo[87975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:07:26 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a160c6-1f7c-4683-b198-0bda5c6990b7]: (4, 'raw') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:07:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-443a3a2a-ef80-4019-9cf1-9860f9ab807e tempest-TaggedBootDevicesTest_v242-1336169590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ad86f424-7d2a-4f3b-9577-890075e7dc72_tb4lreoz {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:07:26 devstack sudo[87977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ad86f424-7d2a-4f3b-9577-890075e7dc72_tb4lreoz Apr 29 15:07:26 devstack sudo[87977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:07:27 devstack sudo[87972]: pam_unix(sudo:session): session closed for user root Apr 29 15:07:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-78fd32f1-b625-47b4-95b6-2503df0a10f4 tempest-TaggedBootDevicesTest-203877183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3249b149-35ec-4604-a2c5-04dd4a504dc8" returned: 0 in 1.121s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:07:27 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-78fd32f1-b625-47b4-95b6-2503df0a10f4 tempest-TaggedBootDevicesTest-203877183 None] Lock "cinder-quobyte-3249b149-35ec-4604-a2c5-04dd4a504dc8" released by "delete_volume" :: held 5.096s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:07:27 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-78fd32f1-b625-47b4-95b6-2503df0a10f4 tempest-TaggedBootDevicesTest-203877183 None] Created reservations ['6279ded1-721b-4893-8094-30a47d1c7ec1', '47fce902-b62c-4a61-97fa-d0344b5e6465', 'bcb97133-ccdb-440a-b0af-ce3acbbce7c9', 'a3121e62-f7e4-4bd7-95f5-bd6b524bf89d'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:07:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-78fd32f1-b625-47b4-95b6-2503df0a10f4 tempest-TaggedBootDevicesTest-203877183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:07:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-78fd32f1-b625-47b4-95b6-2503df0a10f4 tempest-TaggedBootDevicesTest-203877183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:07:27 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-78fd32f1-b625-47b4-95b6-2503df0a10f4 tempest-TaggedBootDevicesTest-203877183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:07:27 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-78fd32f1-b625-47b4-95b6-2503df0a10f4 tempest-TaggedBootDevicesTest-203877183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:07:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-78fd32f1-b625-47b4-95b6-2503df0a10f4 tempest-TaggedBootDevicesTest-203877183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:07:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-78fd32f1-b625-47b4-95b6-2503df0a10f4 tempest-TaggedBootDevicesTest-203877183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:07:27 devstack sudo[87983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:07:27 devstack sudo[87983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:07:28 devstack sudo[87975]: pam_unix(sudo:session): session closed for user root Apr 29 15:07:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-06d9f365-cf98-421c-9fb8-6ab97041bea6 tempest-DeleteServersTestJSON-857384166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-276cf456-163d-41b3-9eda-69f682d7a43a 1073741824" returned: 0 in 1.929s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:07:28 devstack sudo[87977]: pam_unix(sudo:session): session closed for user root Apr 29 15:07:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-443a3a2a-ef80-4019-9cf1-9860f9ab807e tempest-TaggedBootDevicesTest_v242-1336169590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ad86f424-7d2a-4f3b-9577-890075e7dc72_tb4lreoz" returned: 0 in 1.823s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:07:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-443a3a2a-ef80-4019-9cf1-9860f9ab807e tempest-TaggedBootDevicesTest_v242-1336169590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ad86f424-7d2a-4f3b-9577-890075e7dc72_tb4lreoz {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:07:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-06d9f365-cf98-421c-9fb8-6ab97041bea6 tempest-DeleteServersTestJSON-857384166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-276cf456-163d-41b3-9eda-69f682d7a43a {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:07:28 devstack sudo[87990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-276cf456-163d-41b3-9eda-69f682d7a43a Apr 29 15:07:28 devstack sudo[87990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:07:28 devstack sudo[87989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ad86f424-7d2a-4f3b-9577-890075e7dc72_tb4lreoz Apr 29 15:07:28 devstack sudo[87989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:07:28 devstack sudo[87983]: pam_unix(sudo:session): session closed for user root Apr 29 15:07:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-78fd32f1-b625-47b4-95b6-2503df0a10f4 tempest-TaggedBootDevicesTest-203877183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 1.414s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:07:28 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-78fd32f1-b625-47b4-95b6-2503df0a10f4 tempest-TaggedBootDevicesTest-203877183 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:07:28 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-78fd32f1-b625-47b4-95b6-2503df0a10f4 tempest-TaggedBootDevicesTest-203877183 None] Deleted volume successfully. Apr 29 15:07:29 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-78fd32f1-b625-47b4-95b6-2503df0a10f4 tempest-TaggedBootDevicesTest-203877183 None] Lock "cinder-3249b149-35ec-4604-a2c5-04dd4a504dc8-delete_volume" released by "delete_volume" :: held 7.187s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:07:29 devstack sudo[87990]: pam_unix(sudo:session): session closed for user root Apr 29 15:07:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-06d9f365-cf98-421c-9fb8-6ab97041bea6 tempest-DeleteServersTestJSON-857384166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-276cf456-163d-41b3-9eda-69f682d7a43a" returned: 0 in 1.376s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:07:29 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-06d9f365-cf98-421c-9fb8-6ab97041bea6 tempest-DeleteServersTestJSON-857384166 None] <== create_volume: return (3502ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:07:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-06d9f365-cf98-421c-9fb8-6ab97041bea6 tempest-DeleteServersTestJSON-857384166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.514s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:07:29 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-06d9f365-cf98-421c-9fb8-6ab97041bea6 tempest-DeleteServersTestJSON-857384166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fc9270f-31eb-487c-8e82-e132c85243c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-276cf456-163d-41b3-9eda-69f682d7a43a', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:07:29 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-06d9f365-cf98-421c-9fb8-6ab97041bea6 tempest-DeleteServersTestJSON-857384166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbf97d5a-8936-4923-b682-d55aaa7ecd29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:07:29 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-06d9f365-cf98-421c-9fb8-6ab97041bea6 tempest-DeleteServersTestJSON-857384166 None] Volume volume-276cf456-163d-41b3-9eda-69f682d7a43a (276cf456-163d-41b3-9eda-69f682d7a43a): created successfully Apr 29 15:07:29 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-06d9f365-cf98-421c-9fb8-6ab97041bea6 tempest-DeleteServersTestJSON-857384166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbf97d5a-8936-4923-b682-d55aaa7ecd29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:07:29 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-06d9f365-cf98-421c-9fb8-6ab97041bea6 tempest-DeleteServersTestJSON-857384166 None] Flow 'volume_create_manager' (15044b79-fa24-4019-8fe3-ab0b053e6b23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:07:29 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-06d9f365-cf98-421c-9fb8-6ab97041bea6 tempest-DeleteServersTestJSON-857384166 None] Created volume successfully. Apr 29 15:07:30 devstack sudo[87989]: pam_unix(sudo:session): session closed for user root Apr 29 15:07:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-443a3a2a-ef80-4019-9cf1-9860f9ab807e tempest-TaggedBootDevicesTest_v242-1336169590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ad86f424-7d2a-4f3b-9577-890075e7dc72_tb4lreoz" returned: 1 in 1.674s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:07:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-443a3a2a-ef80-4019-9cf1-9860f9ab807e tempest-TaggedBootDevicesTest_v242-1336169590 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ad86f424-7d2a-4f3b-9577-890075e7dc72_tb4lreoz' failed. Not Retrying. {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 15:07:30 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1d4ffe-e5b0-40a4-b829-9962f05c29aa]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:07:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-443a3a2a-ef80-4019-9cf1-9860f9ab807e tempest-TaggedBootDevicesTest_v242-1336169590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_jfcd6ni0devstack@QuobyteHD {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:07:30 devstack sudo[88003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_jfcd6ni0devstack@QuobyteHD Apr 29 15:07:30 devstack sudo[88003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:07:30 devstack cinder-volume[84448]: DEBUG oslo_service.periodic_task [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84448) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 15:07:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:07:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:07:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:07:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:07:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:07:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:07:30 devstack sudo[88005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:07:30 devstack sudo[88005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:07:31 devstack sudo[88005]: pam_unix(sudo:session): session closed for user root Apr 29 15:07:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 1.085s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:07:31 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:07:31 devstack sudo[88003]: pam_unix(sudo:session): session closed for user root Apr 29 15:07:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-443a3a2a-ef80-4019-9cf1-9860f9ab807e tempest-TaggedBootDevicesTest_v242-1336169590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_jfcd6ni0devstack@QuobyteHD" returned: 0 in 1.496s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:07:31 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [None req-443a3a2a-ef80-4019-9cf1-9860f9ab807e tempest-TaggedBootDevicesTest_v242-1336169590 None] ad86f424-7d2a-4f3b-9577-890075e7dc72 was qcow2, converting to raw {{(pid=84448) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 29 15:07:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-443a3a2a-ef80-4019-9cf1-9860f9ab807e tempest-TaggedBootDevicesTest_v242-1336169590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_jfcd6ni0devstack@QuobyteHD /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0c3ebf48-e6c9-4ca7-8372-c5bcb99850ab {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:07:31 devstack sudo[88012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_jfcd6ni0devstack@QuobyteHD /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0c3ebf48-e6c9-4ca7-8372-c5bcb99850ab Apr 29 15:07:31 devstack sudo[88012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:07:34 devstack sudo[88012]: pam_unix(sudo:session): session closed for user root Apr 29 15:07:34 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-443a3a2a-ef80-4019-9cf1-9860f9ab807e tempest-TaggedBootDevicesTest_v242-1336169590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_jfcd6ni0devstack@QuobyteHD /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0c3ebf48-e6c9-4ca7-8372-c5bcb99850ab" returned: 0 in 2.640s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:07:34 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [None req-443a3a2a-ef80-4019-9cf1-9860f9ab807e tempest-TaggedBootDevicesTest_v242-1336169590 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_jfcd6ni0devstack@QuobyteHD, size 112.00 MB, duration 2.64 sec, destination /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0c3ebf48-e6c9-4ca7-8372-c5bcb99850ab {{(pid=84448) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 15:07:34 devstack cinder-volume[84448]: INFO cinder.image.image_utils [None req-443a3a2a-ef80-4019-9cf1-9860f9ab807e tempest-TaggedBootDevicesTest_v242-1336169590 None] Converted 112.00 MB image at 42.40 MB/s Apr 29 15:07:34 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-443a3a2a-ef80-4019-9cf1-9860f9ab807e tempest-TaggedBootDevicesTest_v242-1336169590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0c3ebf48-e6c9-4ca7-8372-c5bcb99850ab 1G {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:07:34 devstack sudo[88086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0c3ebf48-e6c9-4ca7-8372-c5bcb99850ab 1G Apr 29 15:07:34 devstack sudo[88086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:07:35 devstack sudo[88086]: pam_unix(sudo:session): session closed for user root Apr 29 15:07:35 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-443a3a2a-ef80-4019-9cf1-9860f9ab807e tempest-TaggedBootDevicesTest_v242-1336169590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0c3ebf48-e6c9-4ca7-8372-c5bcb99850ab 1G" returned: 0 in 0.880s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:07:35 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[613d92fb-fda8-47ea-a3a9-7abc43e1c9bf]: (4, 'raw') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:07:35 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-443a3a2a-ef80-4019-9cf1-9860f9ab807e tempest-TaggedBootDevicesTest_v242-1336169590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0c3ebf48-e6c9-4ca7-8372-c5bcb99850ab {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:07:35 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-796d0807-dbd1-433f-a383-ee3e94f877fd req-6935607c-7fbf-4163-a0da-772e6afde902 tempest-DeleteServersTestJSON-857384166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:07:35 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-796d0807-dbd1-433f-a383-ee3e94f877fd req-6935607c-7fbf-4163-a0da-772e6afde902 tempest-DeleteServersTestJSON-857384166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:07:35 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a612dcc-d4a1-4770-9e99-2c002002c329]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:07:35 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-796d0807-dbd1-433f-a383-ee3e94f877fd req-6935607c-7fbf-4163-a0da-772e6afde902 tempest-DeleteServersTestJSON-857384166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-276cf456-163d-41b3-9eda-69f682d7a43a {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:07:35 devstack sudo[88101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0c3ebf48-e6c9-4ca7-8372-c5bcb99850ab Apr 29 15:07:35 devstack sudo[88101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:07:35 devstack sudo[88102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-276cf456-163d-41b3-9eda-69f682d7a43a Apr 29 15:07:35 devstack sudo[88102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:07:36 devstack sudo[88101]: pam_unix(sudo:session): session closed for user root Apr 29 15:07:36 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-443a3a2a-ef80-4019-9cf1-9860f9ab807e tempest-TaggedBootDevicesTest_v242-1336169590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0c3ebf48-e6c9-4ca7-8372-c5bcb99850ab" returned: 0 in 0.952s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:07:36 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-443a3a2a-ef80-4019-9cf1-9860f9ab807e tempest-TaggedBootDevicesTest_v242-1336169590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0c3ebf48-e6c9-4ca7-8372-c5bcb99850ab {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:07:36 devstack sudo[88102]: pam_unix(sudo:session): session closed for user root Apr 29 15:07:36 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-796d0807-dbd1-433f-a383-ee3e94f877fd req-6935607c-7fbf-4163-a0da-772e6afde902 tempest-DeleteServersTestJSON-857384166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-276cf456-163d-41b3-9eda-69f682d7a43a" returned: 0 in 0.941s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:07:36 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-796d0807-dbd1-433f-a383-ee3e94f877fd req-6935607c-7fbf-4163-a0da-772e6afde902 tempest-DeleteServersTestJSON-857384166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.983s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:07:36 devstack sudo[88111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0c3ebf48-e6c9-4ca7-8372-c5bcb99850ab Apr 29 15:07:36 devstack sudo[88111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:07:36 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-796d0807-dbd1-433f-a383-ee3e94f877fd req-6935607c-7fbf-4163-a0da-772e6afde902 tempest-DeleteServersTestJSON-857384166 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a', 'name': 'volume-276cf456-163d-41b3-9eda-69f682d7a43a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd0d2edfe-09ee-4357-ab63-3be528d14af1', 'enforce_multipath': True} {{(pid=84448) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 15:07:36 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-796d0807-dbd1-433f-a383-ee3e94f877fd req-6935607c-7fbf-4163-a0da-772e6afde902 tempest-DeleteServersTestJSON-857384166 None] attachment_update completed successfully. Apr 29 15:07:37 devstack sudo[88111]: pam_unix(sudo:session): session closed for user root Apr 29 15:07:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-443a3a2a-ef80-4019-9cf1-9860f9ab807e tempest-TaggedBootDevicesTest_v242-1336169590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0c3ebf48-e6c9-4ca7-8372-c5bcb99850ab" returned: 1 in 0.953s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:07:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-443a3a2a-ef80-4019-9cf1-9860f9ab807e tempest-TaggedBootDevicesTest_v242-1336169590 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0c3ebf48-e6c9-4ca7-8372-c5bcb99850ab' failed. Not Retrying. {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 15:07:37 devstack cinder-volume[84448]: DEBUG cinder.volume.volume_utils [None req-443a3a2a-ef80-4019-9cf1-9860f9ab807e tempest-TaggedBootDevicesTest_v242-1336169590 None] Downloaded image ad86f424-7d2a-4f3b-9577-890075e7dc72 ((None, [{'url': 'file:///opt/stack/data/glance/images/ad86f424-7d2a-4f3b-9577-890075e7dc72', 'metadata': {}}])) to volume 0c3ebf48-e6c9-4ca7-8372-c5bcb99850ab successfully. {{(pid=84448) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 29 15:07:37 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [None req-443a3a2a-ef80-4019-9cf1-9860f9ab807e tempest-TaggedBootDevicesTest_v242-1336169590 None] Temporary image ad86f424-7d2a-4f3b-9577-890075e7dc72 for user f22207d509f548a582861eb4f325373a is deleted. {{(pid=84448) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 29 15:07:37 devstack cinder-volume[84448]: DEBUG cinder.volume.volume_utils [None req-443a3a2a-ef80-4019-9cf1-9860f9ab807e tempest-TaggedBootDevicesTest_v242-1336169590 None] Marking volume 0c3ebf48-e6c9-4ca7-8372-c5bcb99850ab as bootable. {{(pid=84448) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 29 15:07:37 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-443a3a2a-ef80-4019-9cf1-9860f9ab807e tempest-TaggedBootDevicesTest_v242-1336169590 None] Copying metadata from image ad86f424-7d2a-4f3b-9577-890075e7dc72 to 0c3ebf48-e6c9-4ca7-8372-c5bcb99850ab. {{(pid=84448) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 29 15:07:37 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-443a3a2a-ef80-4019-9cf1-9860f9ab807e tempest-TaggedBootDevicesTest_v242-1336169590 None] Creating volume glance metadata for volume 0c3ebf48-e6c9-4ca7-8372-c5bcb99850ab backed by image ad86f424-7d2a-4f3b-9577-890075e7dc72 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'ad86f424-7d2a-4f3b-9577-890075e7dc72', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84448) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 29 15:07:37 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-443a3a2a-ef80-4019-9cf1-9860f9ab807e tempest-TaggedBootDevicesTest_v242-1336169590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee6d1aab-8e55-46eb-9aa7-2fe4c3bbadf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c3ebf48-e6c9-4ca7-8372-c5bcb99850ab', 'volume_size': 1, 'image_id': 'ad86f424-7d2a-4f3b-9577-890075e7dc72', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ad86f424-7d2a-4f3b-9577-890075e7dc72', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '33db0ca5091747b1a3438d70bf53390c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ad86f424-7d2a-4f3b-9577-890075e7dc72', 'created_at': datetime.datetime(2026, 4, 29, 13, 0, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 13, 0, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ad86f424-7d2a-4f3b-9577-890075e7dc72/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:07:37 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-443a3a2a-ef80-4019-9cf1-9860f9ab807e tempest-TaggedBootDevicesTest_v242-1336169590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02b5a423-20aa-4eb8-a2fa-6ac880f519e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:07:37 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-443a3a2a-ef80-4019-9cf1-9860f9ab807e tempest-TaggedBootDevicesTest_v242-1336169590 None] Volume volume-0c3ebf48-e6c9-4ca7-8372-c5bcb99850ab (0c3ebf48-e6c9-4ca7-8372-c5bcb99850ab): created successfully Apr 29 15:07:37 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-443a3a2a-ef80-4019-9cf1-9860f9ab807e tempest-TaggedBootDevicesTest_v242-1336169590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02b5a423-20aa-4eb8-a2fa-6ac880f519e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:07:37 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-443a3a2a-ef80-4019-9cf1-9860f9ab807e tempest-TaggedBootDevicesTest_v242-1336169590 None] Flow 'volume_create_manager' (20f915cf-2df7-4100-957c-03f89e70ac0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:07:37 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-443a3a2a-ef80-4019-9cf1-9860f9ab807e tempest-TaggedBootDevicesTest_v242-1336169590 None] Created volume successfully. Apr 29 15:07:37 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc292620-aed9-4da7-a62c-be6540ed32ad tempest-TaggedBootDevicesTest_v242-1336169590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:07:37 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-fc292620-aed9-4da7-a62c-be6540ed32ad tempest-TaggedBootDevicesTest_v242-1336169590 None] Flow 'volume_create_manager' (3ad3f289-77ce-4699-8c02-805ff3080d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:07:37 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-fc292620-aed9-4da7-a62c-be6540ed32ad tempest-TaggedBootDevicesTest_v242-1336169590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c28276a7-0d99-4dc2-9597-50fd268ce29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:07:38 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-fc292620-aed9-4da7-a62c-be6540ed32ad tempest-TaggedBootDevicesTest_v242-1336169590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c28276a7-0d99-4dc2-9597-50fd268ce29d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:07:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1485376093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f103949c-247a-4a29-b7a0-0d60858e68a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50677cb3d8f04596997faaa9b2e03f77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:07:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:07:38Z,use_quota=True,user_id='f22207d509f548a582861eb4f325373a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:07:38 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-fc292620-aed9-4da7-a62c-be6540ed32ad tempest-TaggedBootDevicesTest_v242-1336169590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2835318-0d81-4637-987a-66e0aa280671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:07:38 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-fc292620-aed9-4da7-a62c-be6540ed32ad tempest-TaggedBootDevicesTest_v242-1336169590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2835318-0d81-4637-987a-66e0aa280671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:07:38 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-fc292620-aed9-4da7-a62c-be6540ed32ad tempest-TaggedBootDevicesTest_v242-1336169590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a3e2ca1-b9f5-49eb-8920-f51258aeaa47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:07:38 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-fc292620-aed9-4da7-a62c-be6540ed32ad tempest-TaggedBootDevicesTest_v242-1336169590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a3e2ca1-b9f5-49eb-8920-f51258aeaa47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f103949c-247a-4a29-b7a0-0d60858e68a0', 'volume_name': 'volume-f103949c-247a-4a29-b7a0-0d60858e68a0', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:07:38 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-fc292620-aed9-4da7-a62c-be6540ed32ad tempest-TaggedBootDevicesTest_v242-1336169590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4b5d7f7-e046-47dc-a81d-fd408e96a2fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:07:38 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-fc292620-aed9-4da7-a62c-be6540ed32ad tempest-TaggedBootDevicesTest_v242-1336169590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4b5d7f7-e046-47dc-a81d-fd408e96a2fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:07:38 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-fc292620-aed9-4da7-a62c-be6540ed32ad tempest-TaggedBootDevicesTest_v242-1336169590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (380eafd0-4e6f-40b8-a77e-b6ed50c5e05b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:07:38 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-fc292620-aed9-4da7-a62c-be6540ed32ad tempest-TaggedBootDevicesTest_v242-1336169590 None] Volume f103949c-247a-4a29-b7a0-0d60858e68a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f103949c-247a-4a29-b7a0-0d60858e68a0', 'volume_size': 1} Apr 29 15:07:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-fc292620-aed9-4da7-a62c-be6540ed32ad tempest-TaggedBootDevicesTest_v242-1336169590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:07:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-fc292620-aed9-4da7-a62c-be6540ed32ad tempest-TaggedBootDevicesTest_v242-1336169590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:07:38 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-fc292620-aed9-4da7-a62c-be6540ed32ad tempest-TaggedBootDevicesTest_v242-1336169590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:07:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1485376093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f103949c-247a-4a29-b7a0-0d60858e68a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50677cb3d8f04596997faaa9b2e03f77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:07:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:07:38Z,use_quota=True,user_id='f22207d509f548a582861eb4f325373a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:07:38 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-fc292620-aed9-4da7-a62c-be6540ed32ad tempest-TaggedBootDevicesTest_v242-1336169590 None] Creating volume f103949c-247a-4a29-b7a0-0d60858e68a0 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:07:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-fc292620-aed9-4da7-a62c-be6540ed32ad tempest-TaggedBootDevicesTest_v242-1336169590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:07:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-fc292620-aed9-4da7-a62c-be6540ed32ad tempest-TaggedBootDevicesTest_v242-1336169590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:07:38 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-fc292620-aed9-4da7-a62c-be6540ed32ad tempest-TaggedBootDevicesTest_v242-1336169590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:07:38 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-fc292620-aed9-4da7-a62c-be6540ed32ad tempest-TaggedBootDevicesTest_v242-1336169590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:07:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-fc292620-aed9-4da7-a62c-be6540ed32ad tempest-TaggedBootDevicesTest_v242-1336169590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:07:38 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-fc292620-aed9-4da7-a62c-be6540ed32ad tempest-TaggedBootDevicesTest_v242-1336169590 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:07:38 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-fc292620-aed9-4da7-a62c-be6540ed32ad tempest-TaggedBootDevicesTest_v242-1336169590 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:07:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-fc292620-aed9-4da7-a62c-be6540ed32ad tempest-TaggedBootDevicesTest_v242-1336169590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f103949c-247a-4a29-b7a0-0d60858e68a0 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:07:38 devstack sudo[88537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f103949c-247a-4a29-b7a0-0d60858e68a0 1073741824 Apr 29 15:07:38 devstack sudo[88537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:07:38 devstack sudo[88537]: pam_unix(sudo:session): session closed for user root Apr 29 15:07:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-fc292620-aed9-4da7-a62c-be6540ed32ad tempest-TaggedBootDevicesTest_v242-1336169590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f103949c-247a-4a29-b7a0-0d60858e68a0 1073741824" returned: 0 in 0.856s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:07:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-fc292620-aed9-4da7-a62c-be6540ed32ad tempest-TaggedBootDevicesTest_v242-1336169590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f103949c-247a-4a29-b7a0-0d60858e68a0 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:07:39 devstack sudo[88544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f103949c-247a-4a29-b7a0-0d60858e68a0 Apr 29 15:07:39 devstack sudo[88544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:07:39 devstack sudo[88544]: pam_unix(sudo:session): session closed for user root Apr 29 15:07:39 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-fc292620-aed9-4da7-a62c-be6540ed32ad tempest-TaggedBootDevicesTest_v242-1336169590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f103949c-247a-4a29-b7a0-0d60858e68a0" returned: 0 in 0.619s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:07:39 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-fc292620-aed9-4da7-a62c-be6540ed32ad tempest-TaggedBootDevicesTest_v242-1336169590 None] <== create_volume: return (1534ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:07:39 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-fc292620-aed9-4da7-a62c-be6540ed32ad tempest-TaggedBootDevicesTest_v242-1336169590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.537s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:07:39 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-fc292620-aed9-4da7-a62c-be6540ed32ad tempest-TaggedBootDevicesTest_v242-1336169590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (380eafd0-4e6f-40b8-a77e-b6ed50c5e05b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f103949c-247a-4a29-b7a0-0d60858e68a0', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:07:39 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-fc292620-aed9-4da7-a62c-be6540ed32ad tempest-TaggedBootDevicesTest_v242-1336169590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (422249b0-12e6-4586-9a5e-c456e6b9e6a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:07:39 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-fc292620-aed9-4da7-a62c-be6540ed32ad tempest-TaggedBootDevicesTest_v242-1336169590 None] Volume volume-f103949c-247a-4a29-b7a0-0d60858e68a0 (f103949c-247a-4a29-b7a0-0d60858e68a0): created successfully Apr 29 15:07:39 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-fc292620-aed9-4da7-a62c-be6540ed32ad tempest-TaggedBootDevicesTest_v242-1336169590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (422249b0-12e6-4586-9a5e-c456e6b9e6a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:07:39 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-fc292620-aed9-4da7-a62c-be6540ed32ad tempest-TaggedBootDevicesTest_v242-1336169590 None] Flow 'volume_create_manager' (3ad3f289-77ce-4699-8c02-805ff3080d3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:07:39 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-fc292620-aed9-4da7-a62c-be6540ed32ad tempest-TaggedBootDevicesTest_v242-1336169590 None] Created volume successfully. Apr 29 15:07:40 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-68b95c2b-ccff-4e2d-847f-70056fa8ebc2 tempest-TaggedBootDevicesTest_v242-1336169590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:07:40 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-68b95c2b-ccff-4e2d-847f-70056fa8ebc2 tempest-TaggedBootDevicesTest_v242-1336169590 None] Flow 'volume_create_manager' (8b69712a-214b-4123-92e1-07f7cced3aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:07:40 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-68b95c2b-ccff-4e2d-847f-70056fa8ebc2 tempest-TaggedBootDevicesTest_v242-1336169590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fe501f4-a093-4f16-bfba-4766e9aaded2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:07:40 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-68b95c2b-ccff-4e2d-847f-70056fa8ebc2 tempest-TaggedBootDevicesTest_v242-1336169590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fe501f4-a093-4f16-bfba-4766e9aaded2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:07:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1332402130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f91241d-022f-4a09-af85-c3aaa9d0c00f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50677cb3d8f04596997faaa9b2e03f77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:07:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:07:40Z,use_quota=True,user_id='f22207d509f548a582861eb4f325373a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:07:40 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-68b95c2b-ccff-4e2d-847f-70056fa8ebc2 tempest-TaggedBootDevicesTest_v242-1336169590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d6fcce9-83bb-42a5-a002-63731c01c38e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:07:40 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-68b95c2b-ccff-4e2d-847f-70056fa8ebc2 tempest-TaggedBootDevicesTest_v242-1336169590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d6fcce9-83bb-42a5-a002-63731c01c38e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:07:40 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-68b95c2b-ccff-4e2d-847f-70056fa8ebc2 tempest-TaggedBootDevicesTest_v242-1336169590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6917a8c-496d-41f7-a943-27dbb43856f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:07:40 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-68b95c2b-ccff-4e2d-847f-70056fa8ebc2 tempest-TaggedBootDevicesTest_v242-1336169590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6917a8c-496d-41f7-a943-27dbb43856f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f91241d-022f-4a09-af85-c3aaa9d0c00f', 'volume_name': 'volume-1f91241d-022f-4a09-af85-c3aaa9d0c00f', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:07:40 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-68b95c2b-ccff-4e2d-847f-70056fa8ebc2 tempest-TaggedBootDevicesTest_v242-1336169590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f511ffeb-e303-49f4-8c16-f3cd2d30fa4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:07:40 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-68b95c2b-ccff-4e2d-847f-70056fa8ebc2 tempest-TaggedBootDevicesTest_v242-1336169590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f511ffeb-e303-49f4-8c16-f3cd2d30fa4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:07:40 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-68b95c2b-ccff-4e2d-847f-70056fa8ebc2 tempest-TaggedBootDevicesTest_v242-1336169590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1daf2194-7d14-4651-9438-d39971346e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:07:40 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-68b95c2b-ccff-4e2d-847f-70056fa8ebc2 tempest-TaggedBootDevicesTest_v242-1336169590 None] Volume 1f91241d-022f-4a09-af85-c3aaa9d0c00f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f91241d-022f-4a09-af85-c3aaa9d0c00f', 'volume_size': 1} Apr 29 15:07:40 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-68b95c2b-ccff-4e2d-847f-70056fa8ebc2 tempest-TaggedBootDevicesTest_v242-1336169590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:07:40 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-68b95c2b-ccff-4e2d-847f-70056fa8ebc2 tempest-TaggedBootDevicesTest_v242-1336169590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:07:40 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-68b95c2b-ccff-4e2d-847f-70056fa8ebc2 tempest-TaggedBootDevicesTest_v242-1336169590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:07:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1332402130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f91241d-022f-4a09-af85-c3aaa9d0c00f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50677cb3d8f04596997faaa9b2e03f77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:07:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:07:40Z,use_quota=True,user_id='f22207d509f548a582861eb4f325373a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:07:40 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-68b95c2b-ccff-4e2d-847f-70056fa8ebc2 tempest-TaggedBootDevicesTest_v242-1336169590 None] Creating volume 1f91241d-022f-4a09-af85-c3aaa9d0c00f {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:07:40 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-68b95c2b-ccff-4e2d-847f-70056fa8ebc2 tempest-TaggedBootDevicesTest_v242-1336169590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:07:40 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-68b95c2b-ccff-4e2d-847f-70056fa8ebc2 tempest-TaggedBootDevicesTest_v242-1336169590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:07:40 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-68b95c2b-ccff-4e2d-847f-70056fa8ebc2 tempest-TaggedBootDevicesTest_v242-1336169590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:07:40 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-68b95c2b-ccff-4e2d-847f-70056fa8ebc2 tempest-TaggedBootDevicesTest_v242-1336169590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:07:40 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-68b95c2b-ccff-4e2d-847f-70056fa8ebc2 tempest-TaggedBootDevicesTest_v242-1336169590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:07:40 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-68b95c2b-ccff-4e2d-847f-70056fa8ebc2 tempest-TaggedBootDevicesTest_v242-1336169590 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:07:40 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-68b95c2b-ccff-4e2d-847f-70056fa8ebc2 tempest-TaggedBootDevicesTest_v242-1336169590 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:07:40 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-68b95c2b-ccff-4e2d-847f-70056fa8ebc2 tempest-TaggedBootDevicesTest_v242-1336169590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1f91241d-022f-4a09-af85-c3aaa9d0c00f 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:07:40 devstack sudo[88548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1f91241d-022f-4a09-af85-c3aaa9d0c00f 1073741824 Apr 29 15:07:40 devstack sudo[88548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:07:41 devstack sudo[88548]: pam_unix(sudo:session): session closed for user root Apr 29 15:07:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-68b95c2b-ccff-4e2d-847f-70056fa8ebc2 tempest-TaggedBootDevicesTest_v242-1336169590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1f91241d-022f-4a09-af85-c3aaa9d0c00f 1073741824" returned: 0 in 0.908s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:07:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-68b95c2b-ccff-4e2d-847f-70056fa8ebc2 tempest-TaggedBootDevicesTest_v242-1336169590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1f91241d-022f-4a09-af85-c3aaa9d0c00f {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:07:41 devstack sudo[88553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1f91241d-022f-4a09-af85-c3aaa9d0c00f Apr 29 15:07:41 devstack sudo[88553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:07:42 devstack sudo[88553]: pam_unix(sudo:session): session closed for user root Apr 29 15:07:42 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-68b95c2b-ccff-4e2d-847f-70056fa8ebc2 tempest-TaggedBootDevicesTest_v242-1336169590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1f91241d-022f-4a09-af85-c3aaa9d0c00f" returned: 0 in 0.709s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:07:42 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-68b95c2b-ccff-4e2d-847f-70056fa8ebc2 tempest-TaggedBootDevicesTest_v242-1336169590 None] <== create_volume: return (1703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:07:42 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-68b95c2b-ccff-4e2d-847f-70056fa8ebc2 tempest-TaggedBootDevicesTest_v242-1336169590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.706s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:07:42 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-68b95c2b-ccff-4e2d-847f-70056fa8ebc2 tempest-TaggedBootDevicesTest_v242-1336169590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1daf2194-7d14-4651-9438-d39971346e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f91241d-022f-4a09-af85-c3aaa9d0c00f', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:07:42 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-68b95c2b-ccff-4e2d-847f-70056fa8ebc2 tempest-TaggedBootDevicesTest_v242-1336169590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa0cfb40-29c7-4570-9bf2-4a5d9d152406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:07:42 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-68b95c2b-ccff-4e2d-847f-70056fa8ebc2 tempest-TaggedBootDevicesTest_v242-1336169590 None] Volume volume-1f91241d-022f-4a09-af85-c3aaa9d0c00f (1f91241d-022f-4a09-af85-c3aaa9d0c00f): created successfully Apr 29 15:07:42 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-68b95c2b-ccff-4e2d-847f-70056fa8ebc2 tempest-TaggedBootDevicesTest_v242-1336169590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa0cfb40-29c7-4570-9bf2-4a5d9d152406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:07:42 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-68b95c2b-ccff-4e2d-847f-70056fa8ebc2 tempest-TaggedBootDevicesTest_v242-1336169590 None] Flow 'volume_create_manager' (8b69712a-214b-4123-92e1-07f7cced3aa5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:07:42 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-68b95c2b-ccff-4e2d-847f-70056fa8ebc2 tempest-TaggedBootDevicesTest_v242-1336169590 None] Created volume successfully. Apr 29 15:07:44 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6ab3157-73a7-4138-9c92-04b0283f3dcf tempest-AttachSCSIVolumeTestJSON-113804343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:07:45 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c6ab3157-73a7-4138-9c92-04b0283f3dcf tempest-AttachSCSIVolumeTestJSON-113804343 None] Flow 'volume_create_manager' (44fe6a2a-91f5-4c28-be08-e003324afc1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:07:45 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c6ab3157-73a7-4138-9c92-04b0283f3dcf tempest-AttachSCSIVolumeTestJSON-113804343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd02afae-20cd-4552-94b1-e7e237eaca6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:07:45 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c6ab3157-73a7-4138-9c92-04b0283f3dcf tempest-AttachSCSIVolumeTestJSON-113804343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd02afae-20cd-4552-94b1-e7e237eaca6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:07:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-1176852894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7415280-cfc3-4b14-9be0-1f436e32f249,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eaa748edcc943949b66033d521debac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:07:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:07:45Z,use_quota=True,user_id='d6c156bad231494397beab44dec37227',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:07:45 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c6ab3157-73a7-4138-9c92-04b0283f3dcf tempest-AttachSCSIVolumeTestJSON-113804343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3201fc25-80a8-47cf-bd43-905ce45db676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:07:45 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c6ab3157-73a7-4138-9c92-04b0283f3dcf tempest-AttachSCSIVolumeTestJSON-113804343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3201fc25-80a8-47cf-bd43-905ce45db676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:07:45 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c6ab3157-73a7-4138-9c92-04b0283f3dcf tempest-AttachSCSIVolumeTestJSON-113804343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7d0edd5-5a4d-4fec-a254-bf1c6354243e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:07:45 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c6ab3157-73a7-4138-9c92-04b0283f3dcf tempest-AttachSCSIVolumeTestJSON-113804343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7d0edd5-5a4d-4fec-a254-bf1c6354243e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7415280-cfc3-4b14-9be0-1f436e32f249', 'volume_name': 'volume-b7415280-cfc3-4b14-9be0-1f436e32f249', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:07:45 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c6ab3157-73a7-4138-9c92-04b0283f3dcf tempest-AttachSCSIVolumeTestJSON-113804343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b7bc043-ebc2-482b-9bf5-33760e5708b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:07:45 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c6ab3157-73a7-4138-9c92-04b0283f3dcf tempest-AttachSCSIVolumeTestJSON-113804343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b7bc043-ebc2-482b-9bf5-33760e5708b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:07:45 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c6ab3157-73a7-4138-9c92-04b0283f3dcf tempest-AttachSCSIVolumeTestJSON-113804343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13f88de4-0e00-4928-9fd2-d3cad006d7a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:07:45 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-c6ab3157-73a7-4138-9c92-04b0283f3dcf tempest-AttachSCSIVolumeTestJSON-113804343 None] Volume b7415280-cfc3-4b14-9be0-1f436e32f249: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7415280-cfc3-4b14-9be0-1f436e32f249', 'volume_size': 1} Apr 29 15:07:45 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-c6ab3157-73a7-4138-9c92-04b0283f3dcf tempest-AttachSCSIVolumeTestJSON-113804343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:07:45 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-c6ab3157-73a7-4138-9c92-04b0283f3dcf tempest-AttachSCSIVolumeTestJSON-113804343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:07:45 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-c6ab3157-73a7-4138-9c92-04b0283f3dcf tempest-AttachSCSIVolumeTestJSON-113804343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:07:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-1176852894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7415280-cfc3-4b14-9be0-1f436e32f249,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eaa748edcc943949b66033d521debac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:07:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:07:45Z,use_quota=True,user_id='d6c156bad231494397beab44dec37227',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:07:45 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-c6ab3157-73a7-4138-9c92-04b0283f3dcf tempest-AttachSCSIVolumeTestJSON-113804343 None] Creating volume b7415280-cfc3-4b14-9be0-1f436e32f249 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:07:45 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-c6ab3157-73a7-4138-9c92-04b0283f3dcf tempest-AttachSCSIVolumeTestJSON-113804343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:07:45 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-c6ab3157-73a7-4138-9c92-04b0283f3dcf tempest-AttachSCSIVolumeTestJSON-113804343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:07:45 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-c6ab3157-73a7-4138-9c92-04b0283f3dcf tempest-AttachSCSIVolumeTestJSON-113804343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:07:45 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-c6ab3157-73a7-4138-9c92-04b0283f3dcf tempest-AttachSCSIVolumeTestJSON-113804343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:07:45 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-c6ab3157-73a7-4138-9c92-04b0283f3dcf tempest-AttachSCSIVolumeTestJSON-113804343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:07:45 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-c6ab3157-73a7-4138-9c92-04b0283f3dcf tempest-AttachSCSIVolumeTestJSON-113804343 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:07:45 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-c6ab3157-73a7-4138-9c92-04b0283f3dcf tempest-AttachSCSIVolumeTestJSON-113804343 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:07:45 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c6ab3157-73a7-4138-9c92-04b0283f3dcf tempest-AttachSCSIVolumeTestJSON-113804343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-b7415280-cfc3-4b14-9be0-1f436e32f249 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:07:45 devstack sudo[88623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-b7415280-cfc3-4b14-9be0-1f436e32f249 1073741824 Apr 29 15:07:45 devstack sudo[88623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:07:46 devstack sudo[88623]: pam_unix(sudo:session): session closed for user root Apr 29 15:07:46 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c6ab3157-73a7-4138-9c92-04b0283f3dcf tempest-AttachSCSIVolumeTestJSON-113804343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-b7415280-cfc3-4b14-9be0-1f436e32f249 1073741824" returned: 0 in 0.986s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:07:46 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c6ab3157-73a7-4138-9c92-04b0283f3dcf tempest-AttachSCSIVolumeTestJSON-113804343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-b7415280-cfc3-4b14-9be0-1f436e32f249 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:07:46 devstack sudo[88630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-b7415280-cfc3-4b14-9be0-1f436e32f249 Apr 29 15:07:46 devstack sudo[88630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:07:46 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-21c3ff84-b7ed-4d34-bc58-e6352944a1a4 req-a0a04adc-9f5c-4cc0-89ad-1ceef9118174 tempest-DeleteServersTestJSON-857384166 None] Terminate volume connection completed successfully. Apr 29 15:07:46 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-21c3ff84-b7ed-4d34-bc58-e6352944a1a4 req-a0a04adc-9f5c-4cc0-89ad-1ceef9118174 tempest-DeleteServersTestJSON-857384166 None] Deleting attachment d0d2edfe-09ee-4357-ab63-3be528d14af1. {{(pid=84448) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 15:07:46 devstack sudo[88630]: pam_unix(sudo:session): session closed for user root Apr 29 15:07:46 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c6ab3157-73a7-4138-9c92-04b0283f3dcf tempest-AttachSCSIVolumeTestJSON-113804343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-b7415280-cfc3-4b14-9be0-1f436e32f249" returned: 0 in 0.684s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:07:46 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-c6ab3157-73a7-4138-9c92-04b0283f3dcf tempest-AttachSCSIVolumeTestJSON-113804343 None] <== create_volume: return (1733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:07:46 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-c6ab3157-73a7-4138-9c92-04b0283f3dcf tempest-AttachSCSIVolumeTestJSON-113804343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.739s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:07:46 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c6ab3157-73a7-4138-9c92-04b0283f3dcf tempest-AttachSCSIVolumeTestJSON-113804343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13f88de4-0e00-4928-9fd2-d3cad006d7a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7415280-cfc3-4b14-9be0-1f436e32f249', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:07:46 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c6ab3157-73a7-4138-9c92-04b0283f3dcf tempest-AttachSCSIVolumeTestJSON-113804343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa39f187-34b7-4fd9-ae96-8631da8afcdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:07:46 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-c6ab3157-73a7-4138-9c92-04b0283f3dcf tempest-AttachSCSIVolumeTestJSON-113804343 None] Volume volume-b7415280-cfc3-4b14-9be0-1f436e32f249 (b7415280-cfc3-4b14-9be0-1f436e32f249): created successfully Apr 29 15:07:46 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c6ab3157-73a7-4138-9c92-04b0283f3dcf tempest-AttachSCSIVolumeTestJSON-113804343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa39f187-34b7-4fd9-ae96-8631da8afcdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:07:46 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c6ab3157-73a7-4138-9c92-04b0283f3dcf tempest-AttachSCSIVolumeTestJSON-113804343 None] Flow 'volume_create_manager' (44fe6a2a-91f5-4c28-be08-e003324afc1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:07:46 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-c6ab3157-73a7-4138-9c92-04b0283f3dcf tempest-AttachSCSIVolumeTestJSON-113804343 None] Created volume successfully. Apr 29 15:07:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-1ddfa35f-37b4-4c4d-909f-33751d86a124 req-26efd2ec-6d67-4b87-9698-f7431de72c24 tempest-AttachSCSIVolumeTestJSON-113804343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:07:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-1ddfa35f-37b4-4c4d-909f-33751d86a124 req-26efd2ec-6d67-4b87-9698-f7431de72c24 tempest-AttachSCSIVolumeTestJSON-113804343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:07:50 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9b1cd8-9ae2-4f23-b839-b8888b781b45]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:07:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-1ddfa35f-37b4-4c4d-909f-33751d86a124 req-26efd2ec-6d67-4b87-9698-f7431de72c24 tempest-AttachSCSIVolumeTestJSON-113804343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-b7415280-cfc3-4b14-9be0-1f436e32f249 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:07:50 devstack sudo[88645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-b7415280-cfc3-4b14-9be0-1f436e32f249 Apr 29 15:07:50 devstack sudo[88645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:07:51 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-78f35668-e7e2-4669-b88c-69f7e5186711 tempest-DeleteServersTestJSON-857384166 None] Acquiring lock "cinder-276cf456-163d-41b3-9eda-69f682d7a43a-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:07:51 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-78f35668-e7e2-4669-b88c-69f7e5186711 tempest-DeleteServersTestJSON-857384166 None] Lock "cinder-276cf456-163d-41b3-9eda-69f682d7a43a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:07:51 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-78f35668-e7e2-4669-b88c-69f7e5186711 tempest-DeleteServersTestJSON-857384166 None] Acquiring lock "cinder-quobyte-276cf456-163d-41b3-9eda-69f682d7a43a" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:07:51 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-78f35668-e7e2-4669-b88c-69f7e5186711 tempest-DeleteServersTestJSON-857384166 None] Lock "cinder-quobyte-276cf456-163d-41b3-9eda-69f682d7a43a" acquired by "delete_volume" :: waited 0.024s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:07:51 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d58951-1759-4a24-b118-bab620992011]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:07:51 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-78f35668-e7e2-4669-b88c-69f7e5186711 tempest-DeleteServersTestJSON-857384166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-276cf456-163d-41b3-9eda-69f682d7a43a {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:07:51 devstack sudo[88645]: pam_unix(sudo:session): session closed for user root Apr 29 15:07:51 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-1ddfa35f-37b4-4c4d-909f-33751d86a124 req-26efd2ec-6d67-4b87-9698-f7431de72c24 tempest-AttachSCSIVolumeTestJSON-113804343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-b7415280-cfc3-4b14-9be0-1f436e32f249" returned: 0 in 1.044s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:07:51 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-1ddfa35f-37b4-4c4d-909f-33751d86a124 req-26efd2ec-6d67-4b87-9698-f7431de72c24 tempest-AttachSCSIVolumeTestJSON-113804343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.069s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:07:51 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-1ddfa35f-37b4-4c4d-909f-33751d86a124 req-26efd2ec-6d67-4b87-9698-f7431de72c24 tempest-AttachSCSIVolumeTestJSON-113804343 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a', 'name': 'volume-b7415280-cfc3-4b14-9be0-1f436e32f249', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '72843648-e256-465c-b131-d5feedcf3b2e', 'enforce_multipath': True} {{(pid=84448) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 15:07:51 devstack sudo[88650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-276cf456-163d-41b3-9eda-69f682d7a43a Apr 29 15:07:51 devstack sudo[88650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:07:51 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-1ddfa35f-37b4-4c4d-909f-33751d86a124 req-26efd2ec-6d67-4b87-9698-f7431de72c24 tempest-AttachSCSIVolumeTestJSON-113804343 None] attachment_update completed successfully. Apr 29 15:07:52 devstack sudo[88650]: pam_unix(sudo:session): session closed for user root Apr 29 15:07:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-78f35668-e7e2-4669-b88c-69f7e5186711 tempest-DeleteServersTestJSON-857384166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-276cf456-163d-41b3-9eda-69f682d7a43a" returned: 0 in 0.896s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:07:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-78f35668-e7e2-4669-b88c-69f7e5186711 tempest-DeleteServersTestJSON-857384166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-276cf456-163d-41b3-9eda-69f682d7a43a {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:07:52 devstack sudo[88722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-276cf456-163d-41b3-9eda-69f682d7a43a Apr 29 15:07:52 devstack sudo[88722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:07:52 devstack sudo[88722]: pam_unix(sudo:session): session closed for user root Apr 29 15:07:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-78f35668-e7e2-4669-b88c-69f7e5186711 tempest-DeleteServersTestJSON-857384166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-276cf456-163d-41b3-9eda-69f682d7a43a" returned: 0 in 0.677s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:07:52 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-78f35668-e7e2-4669-b88c-69f7e5186711 tempest-DeleteServersTestJSON-857384166 None] Lock "cinder-quobyte-276cf456-163d-41b3-9eda-69f682d7a43a" released by "delete_volume" :: held 1.640s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:07:52 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-78f35668-e7e2-4669-b88c-69f7e5186711 tempest-DeleteServersTestJSON-857384166 None] Created reservations ['45c782e9-071f-4f00-83dd-cd134e28c6f7', '8df7d505-52fe-4c9c-8bcd-5e38b725e54d', '6ea397c4-fb94-4acf-8e60-225358df1661', '9616138e-d12a-4239-ba58-1ab67882cb54'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:07:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-78f35668-e7e2-4669-b88c-69f7e5186711 tempest-DeleteServersTestJSON-857384166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:07:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-78f35668-e7e2-4669-b88c-69f7e5186711 tempest-DeleteServersTestJSON-857384166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:07:53 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-78f35668-e7e2-4669-b88c-69f7e5186711 tempest-DeleteServersTestJSON-857384166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:07:53 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-78f35668-e7e2-4669-b88c-69f7e5186711 tempest-DeleteServersTestJSON-857384166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:07:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-78f35668-e7e2-4669-b88c-69f7e5186711 tempest-DeleteServersTestJSON-857384166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:07:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-78f35668-e7e2-4669-b88c-69f7e5186711 tempest-DeleteServersTestJSON-857384166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:07:53 devstack sudo[89041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:07:53 devstack sudo[89041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:07:53 devstack sudo[89041]: pam_unix(sudo:session): session closed for user root Apr 29 15:07:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-78f35668-e7e2-4669-b88c-69f7e5186711 tempest-DeleteServersTestJSON-857384166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.672s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:07:53 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-78f35668-e7e2-4669-b88c-69f7e5186711 tempest-DeleteServersTestJSON-857384166 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:07:53 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-78f35668-e7e2-4669-b88c-69f7e5186711 tempest-DeleteServersTestJSON-857384166 None] Deleted volume successfully. Apr 29 15:07:53 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-78f35668-e7e2-4669-b88c-69f7e5186711 tempest-DeleteServersTestJSON-857384166 None] Lock "cinder-276cf456-163d-41b3-9eda-69f682d7a43a-delete_volume" released by "delete_volume" :: held 2.664s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:07:58 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-d2474732-b499-41b8-8445-347e96557433 req-c43644d2-bfe6-443c-a873-7c39fa6e3dbf tempest-AttachSCSIVolumeTestJSON-113804343 None] Terminate volume connection completed successfully. Apr 29 15:07:58 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-d2474732-b499-41b8-8445-347e96557433 req-c43644d2-bfe6-443c-a873-7c39fa6e3dbf tempest-AttachSCSIVolumeTestJSON-113804343 None] Deleting attachment 72843648-e256-465c-b131-d5feedcf3b2e. {{(pid=84448) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 15:08:05 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-b1f7f415-6a3f-4974-bd06-5b2ba36fe701 req-26d2abfb-eca0-4bc3-a85c-4f984dd3569c tempest-TaggedBootDevicesTest_v242-1336169590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:08:05 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-b1f7f415-6a3f-4974-bd06-5b2ba36fe701 req-26d2abfb-eca0-4bc3-a85c-4f984dd3569c tempest-TaggedBootDevicesTest_v242-1336169590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:08:05 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2966a77-cf4a-4176-a62d-0185c38bf9d1]: (4, 'raw') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:08:05 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-b1f7f415-6a3f-4974-bd06-5b2ba36fe701 req-26d2abfb-eca0-4bc3-a85c-4f984dd3569c tempest-TaggedBootDevicesTest_v242-1336169590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0c3ebf48-e6c9-4ca7-8372-c5bcb99850ab {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:08:05 devstack sudo[89129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0c3ebf48-e6c9-4ca7-8372-c5bcb99850ab Apr 29 15:08:05 devstack sudo[89129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:08:06 devstack sudo[89129]: pam_unix(sudo:session): session closed for user root Apr 29 15:08:06 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-b1f7f415-6a3f-4974-bd06-5b2ba36fe701 req-26d2abfb-eca0-4bc3-a85c-4f984dd3569c tempest-TaggedBootDevicesTest_v242-1336169590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0c3ebf48-e6c9-4ca7-8372-c5bcb99850ab" returned: 0 in 0.756s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:08:06 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-b1f7f415-6a3f-4974-bd06-5b2ba36fe701 req-26d2abfb-eca0-4bc3-a85c-4f984dd3569c tempest-TaggedBootDevicesTest_v242-1336169590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0c3ebf48-e6c9-4ca7-8372-c5bcb99850ab {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:08:06 devstack sudo[89134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0c3ebf48-e6c9-4ca7-8372-c5bcb99850ab Apr 29 15:08:06 devstack sudo[89134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:08:07 devstack sudo[89134]: pam_unix(sudo:session): session closed for user root Apr 29 15:08:07 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-b1f7f415-6a3f-4974-bd06-5b2ba36fe701 req-26d2abfb-eca0-4bc3-a85c-4f984dd3569c tempest-TaggedBootDevicesTest_v242-1336169590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0c3ebf48-e6c9-4ca7-8372-c5bcb99850ab" returned: 1 in 1.067s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:08:07 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-b1f7f415-6a3f-4974-bd06-5b2ba36fe701 req-26d2abfb-eca0-4bc3-a85c-4f984dd3569c tempest-TaggedBootDevicesTest_v242-1336169590 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0c3ebf48-e6c9-4ca7-8372-c5bcb99850ab' failed. Not Retrying. {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 15:08:07 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-b1f7f415-6a3f-4974-bd06-5b2ba36fe701 req-26d2abfb-eca0-4bc3-a85c-4f984dd3569c tempest-TaggedBootDevicesTest_v242-1336169590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.872s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:08:07 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-b1f7f415-6a3f-4974-bd06-5b2ba36fe701 req-26d2abfb-eca0-4bc3-a85c-4f984dd3569c tempest-TaggedBootDevicesTest_v242-1336169590 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a', 'name': 'volume-0c3ebf48-e6c9-4ca7-8372-c5bcb99850ab', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0f1916ff-44ee-41d2-bc61-cf7e543c9ce6', 'enforce_multipath': True} {{(pid=84448) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 15:08:07 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-b1f7f415-6a3f-4974-bd06-5b2ba36fe701 req-26d2abfb-eca0-4bc3-a85c-4f984dd3569c tempest-TaggedBootDevicesTest_v242-1336169590 None] attachment_update completed successfully. Apr 29 15:08:09 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-b1f7f415-6a3f-4974-bd06-5b2ba36fe701 req-ac9f8714-a8a5-405b-8c21-35083b3917a9 tempest-TaggedBootDevicesTest_v242-1336169590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:08:09 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-b1f7f415-6a3f-4974-bd06-5b2ba36fe701 req-ac9f8714-a8a5-405b-8c21-35083b3917a9 tempest-TaggedBootDevicesTest_v242-1336169590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:08:09 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[b42f156c-fa89-40ce-8eb3-bd1a46048913]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:08:09 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-b1f7f415-6a3f-4974-bd06-5b2ba36fe701 req-ac9f8714-a8a5-405b-8c21-35083b3917a9 tempest-TaggedBootDevicesTest_v242-1336169590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f103949c-247a-4a29-b7a0-0d60858e68a0 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:08:09 devstack sudo[89166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f103949c-247a-4a29-b7a0-0d60858e68a0 Apr 29 15:08:09 devstack sudo[89166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:08:10 devstack sudo[89166]: pam_unix(sudo:session): session closed for user root Apr 29 15:08:10 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-b1f7f415-6a3f-4974-bd06-5b2ba36fe701 req-ac9f8714-a8a5-405b-8c21-35083b3917a9 tempest-TaggedBootDevicesTest_v242-1336169590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f103949c-247a-4a29-b7a0-0d60858e68a0" returned: 0 in 0.834s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:08:10 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-b1f7f415-6a3f-4974-bd06-5b2ba36fe701 req-ac9f8714-a8a5-405b-8c21-35083b3917a9 tempest-TaggedBootDevicesTest_v242-1336169590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.859s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:08:10 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-b1f7f415-6a3f-4974-bd06-5b2ba36fe701 req-ac9f8714-a8a5-405b-8c21-35083b3917a9 tempest-TaggedBootDevicesTest_v242-1336169590 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a', 'name': 'volume-f103949c-247a-4a29-b7a0-0d60858e68a0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0b128d8d-ff35-4cad-ae83-f1e241cce98d', 'enforce_multipath': True} {{(pid=84448) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 15:08:10 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-b1f7f415-6a3f-4974-bd06-5b2ba36fe701 req-ac9f8714-a8a5-405b-8c21-35083b3917a9 tempest-TaggedBootDevicesTest_v242-1336169590 None] attachment_update completed successfully. Apr 29 15:08:12 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-b1f7f415-6a3f-4974-bd06-5b2ba36fe701 req-150a5d50-5f05-46cb-8dd1-b52cbf5d844a tempest-TaggedBootDevicesTest_v242-1336169590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:08:12 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-b1f7f415-6a3f-4974-bd06-5b2ba36fe701 req-150a5d50-5f05-46cb-8dd1-b52cbf5d844a tempest-TaggedBootDevicesTest_v242-1336169590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:08:12 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd0b4e1-dab7-41b2-a04b-616e810edbdd]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:08:12 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-b1f7f415-6a3f-4974-bd06-5b2ba36fe701 req-150a5d50-5f05-46cb-8dd1-b52cbf5d844a tempest-TaggedBootDevicesTest_v242-1336169590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1f91241d-022f-4a09-af85-c3aaa9d0c00f {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:08:12 devstack sudo[89180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1f91241d-022f-4a09-af85-c3aaa9d0c00f Apr 29 15:08:12 devstack sudo[89180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:08:13 devstack sudo[89180]: pam_unix(sudo:session): session closed for user root Apr 29 15:08:13 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-b1f7f415-6a3f-4974-bd06-5b2ba36fe701 req-150a5d50-5f05-46cb-8dd1-b52cbf5d844a tempest-TaggedBootDevicesTest_v242-1336169590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1f91241d-022f-4a09-af85-c3aaa9d0c00f" returned: 0 in 1.025s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:08:13 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-b1f7f415-6a3f-4974-bd06-5b2ba36fe701 req-150a5d50-5f05-46cb-8dd1-b52cbf5d844a tempest-TaggedBootDevicesTest_v242-1336169590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.048s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:08:13 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-b1f7f415-6a3f-4974-bd06-5b2ba36fe701 req-150a5d50-5f05-46cb-8dd1-b52cbf5d844a tempest-TaggedBootDevicesTest_v242-1336169590 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a', 'name': 'volume-1f91241d-022f-4a09-af85-c3aaa9d0c00f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '393cd447-7597-42ad-9dca-486d8c3db4f0', 'enforce_multipath': True} {{(pid=84448) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 15:08:13 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-b1f7f415-6a3f-4974-bd06-5b2ba36fe701 req-150a5d50-5f05-46cb-8dd1-b52cbf5d844a tempest-TaggedBootDevicesTest_v242-1336169590 None] attachment_update completed successfully. Apr 29 15:08:14 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-b00935fc-8502-46c1-98c8-140e5661c34f tempest-AttachSCSIVolumeTestJSON-113804343 None] Acquiring lock "cinder-b7415280-cfc3-4b14-9be0-1f436e32f249-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:08:14 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-b00935fc-8502-46c1-98c8-140e5661c34f tempest-AttachSCSIVolumeTestJSON-113804343 None] Lock "cinder-b7415280-cfc3-4b14-9be0-1f436e32f249-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:08:14 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:SELECT=63,cinder:INSERT=16,cinder:UPDATE=64,cinder:DELETE=4 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:08:14 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:SELECT=73,cinder:UPDATE=50,cinder:INSERT=18,cinder:DELETE=5 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:08:14 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-b00935fc-8502-46c1-98c8-140e5661c34f tempest-AttachSCSIVolumeTestJSON-113804343 None] Acquiring lock "cinder-quobyte-b7415280-cfc3-4b14-9be0-1f436e32f249" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:08:14 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-b00935fc-8502-46c1-98c8-140e5661c34f tempest-AttachSCSIVolumeTestJSON-113804343 None] Lock "cinder-quobyte-b7415280-cfc3-4b14-9be0-1f436e32f249" acquired by "delete_volume" :: waited 0.028s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:08:14 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b0e9a5a-4015-499b-93f2-a35344ae4ef1]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:08:14 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-b00935fc-8502-46c1-98c8-140e5661c34f tempest-AttachSCSIVolumeTestJSON-113804343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-b7415280-cfc3-4b14-9be0-1f436e32f249 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:08:15 devstack sudo[89188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-b7415280-cfc3-4b14-9be0-1f436e32f249 Apr 29 15:08:15 devstack sudo[89188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:08:15 devstack sudo[89188]: pam_unix(sudo:session): session closed for user root Apr 29 15:08:15 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-b00935fc-8502-46c1-98c8-140e5661c34f tempest-AttachSCSIVolumeTestJSON-113804343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-b7415280-cfc3-4b14-9be0-1f436e32f249" returned: 0 in 0.841s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:08:15 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-b00935fc-8502-46c1-98c8-140e5661c34f tempest-AttachSCSIVolumeTestJSON-113804343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-b7415280-cfc3-4b14-9be0-1f436e32f249 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:08:15 devstack sudo[89228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-b7415280-cfc3-4b14-9be0-1f436e32f249 Apr 29 15:08:15 devstack sudo[89228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:08:16 devstack sudo[89228]: pam_unix(sudo:session): session closed for user root Apr 29 15:08:16 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-b00935fc-8502-46c1-98c8-140e5661c34f tempest-AttachSCSIVolumeTestJSON-113804343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-b7415280-cfc3-4b14-9be0-1f436e32f249" returned: 0 in 0.772s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:08:16 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-b00935fc-8502-46c1-98c8-140e5661c34f tempest-AttachSCSIVolumeTestJSON-113804343 None] Lock "cinder-quobyte-b7415280-cfc3-4b14-9be0-1f436e32f249" released by "delete_volume" :: held 1.668s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:08:16 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-b00935fc-8502-46c1-98c8-140e5661c34f tempest-AttachSCSIVolumeTestJSON-113804343 None] Created reservations ['9ff914bf-d2dc-404a-8315-627fff1c1086', 'a97a8cce-b73c-4b0a-b27a-9ed2189b05a3', '4e235f27-7cfa-4bf2-a1f0-c496acaff4f7', 'c6003226-c9b5-43a8-bb6c-db19b03c84d0'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:08:16 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-b00935fc-8502-46c1-98c8-140e5661c34f tempest-AttachSCSIVolumeTestJSON-113804343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:08:16 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-b00935fc-8502-46c1-98c8-140e5661c34f tempest-AttachSCSIVolumeTestJSON-113804343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:08:16 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-b00935fc-8502-46c1-98c8-140e5661c34f tempest-AttachSCSIVolumeTestJSON-113804343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:08:16 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-b00935fc-8502-46c1-98c8-140e5661c34f tempest-AttachSCSIVolumeTestJSON-113804343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:08:16 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-b00935fc-8502-46c1-98c8-140e5661c34f tempest-AttachSCSIVolumeTestJSON-113804343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:08:16 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-b00935fc-8502-46c1-98c8-140e5661c34f tempest-AttachSCSIVolumeTestJSON-113804343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:08:16 devstack sudo[89234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:08:16 devstack sudo[89234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:08:17 devstack sudo[89234]: pam_unix(sudo:session): session closed for user root Apr 29 15:08:17 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-b00935fc-8502-46c1-98c8-140e5661c34f tempest-AttachSCSIVolumeTestJSON-113804343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.785s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:08:17 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-b00935fc-8502-46c1-98c8-140e5661c34f tempest-AttachSCSIVolumeTestJSON-113804343 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:08:17 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-b00935fc-8502-46c1-98c8-140e5661c34f tempest-AttachSCSIVolumeTestJSON-113804343 None] Deleted volume successfully. Apr 29 15:08:17 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-b00935fc-8502-46c1-98c8-140e5661c34f tempest-AttachSCSIVolumeTestJSON-113804343 None] Lock "cinder-b7415280-cfc3-4b14-9be0-1f436e32f249-delete_volume" released by "delete_volume" :: held 2.725s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:08:26 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:SELECT=4,cinder:INSERT=2,cinder:UPDATE=9 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:08:27 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:SELECT=5,cinder:INSERT=2,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:08:30 devstack cinder-volume[84448]: DEBUG oslo_service.periodic_task [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84448) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 15:08:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:08:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:08:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:08:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:08:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:08:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:08:30 devstack sudo[89354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:08:30 devstack sudo[89354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:08:31 devstack sudo[89354]: pam_unix(sudo:session): session closed for user root Apr 29 15:08:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.775s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:08:31 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:08:52 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd483790-9ad7-44da-9aab-1d9414616ffa tempest-AttachVolumeShelveTestJSON-435060681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:08:52 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cd483790-9ad7-44da-9aab-1d9414616ffa tempest-AttachVolumeShelveTestJSON-435060681 None] Flow 'volume_create_manager' (095d7f4e-9a9b-44fd-bb5d-d739faf5e720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:08:52 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cd483790-9ad7-44da-9aab-1d9414616ffa tempest-AttachVolumeShelveTestJSON-435060681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e3df2e0-2555-4ed1-a323-a55f55f5db24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:08:52 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cd483790-9ad7-44da-9aab-1d9414616ffa tempest-AttachVolumeShelveTestJSON-435060681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e3df2e0-2555-4ed1-a323-a55f55f5db24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:08:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1108845922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56dd9f10-c9a3-4ce2-8eba-ef7db03d376f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98c13fc024f349db8ef55acfa3176fec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:08:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:08:52Z,use_quota=True,user_id='13bfd745ee9647e9b1c7d032f3b49857',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:08:52 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cd483790-9ad7-44da-9aab-1d9414616ffa tempest-AttachVolumeShelveTestJSON-435060681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a370034f-f06f-4b8e-a177-5cfcb7938fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:08:52 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cd483790-9ad7-44da-9aab-1d9414616ffa tempest-AttachVolumeShelveTestJSON-435060681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a370034f-f06f-4b8e-a177-5cfcb7938fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:08:52 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cd483790-9ad7-44da-9aab-1d9414616ffa tempest-AttachVolumeShelveTestJSON-435060681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93995270-922a-44fd-8ab6-017b771cfcc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:08:52 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cd483790-9ad7-44da-9aab-1d9414616ffa tempest-AttachVolumeShelveTestJSON-435060681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93995270-922a-44fd-8ab6-017b771cfcc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56dd9f10-c9a3-4ce2-8eba-ef7db03d376f', 'volume_name': 'volume-56dd9f10-c9a3-4ce2-8eba-ef7db03d376f', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:08:52 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cd483790-9ad7-44da-9aab-1d9414616ffa tempest-AttachVolumeShelveTestJSON-435060681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c14f9d4-97b2-4ecc-b0c7-33efc94f0d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:08:52 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cd483790-9ad7-44da-9aab-1d9414616ffa tempest-AttachVolumeShelveTestJSON-435060681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c14f9d4-97b2-4ecc-b0c7-33efc94f0d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:08:52 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cd483790-9ad7-44da-9aab-1d9414616ffa tempest-AttachVolumeShelveTestJSON-435060681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fb93605-42ee-444d-b584-0279af967563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:08:52 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-cd483790-9ad7-44da-9aab-1d9414616ffa tempest-AttachVolumeShelveTestJSON-435060681 None] Volume 56dd9f10-c9a3-4ce2-8eba-ef7db03d376f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56dd9f10-c9a3-4ce2-8eba-ef7db03d376f', 'volume_size': 1} Apr 29 15:08:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-cd483790-9ad7-44da-9aab-1d9414616ffa tempest-AttachVolumeShelveTestJSON-435060681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:08:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-cd483790-9ad7-44da-9aab-1d9414616ffa tempest-AttachVolumeShelveTestJSON-435060681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:08:52 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-cd483790-9ad7-44da-9aab-1d9414616ffa tempest-AttachVolumeShelveTestJSON-435060681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:08:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1108845922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56dd9f10-c9a3-4ce2-8eba-ef7db03d376f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98c13fc024f349db8ef55acfa3176fec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:08:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:08:52Z,use_quota=True,user_id='13bfd745ee9647e9b1c7d032f3b49857',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:08:52 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-cd483790-9ad7-44da-9aab-1d9414616ffa tempest-AttachVolumeShelveTestJSON-435060681 None] Creating volume 56dd9f10-c9a3-4ce2-8eba-ef7db03d376f {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:08:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-cd483790-9ad7-44da-9aab-1d9414616ffa tempest-AttachVolumeShelveTestJSON-435060681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:08:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-cd483790-9ad7-44da-9aab-1d9414616ffa tempest-AttachVolumeShelveTestJSON-435060681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:08:52 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-cd483790-9ad7-44da-9aab-1d9414616ffa tempest-AttachVolumeShelveTestJSON-435060681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:08:52 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-cd483790-9ad7-44da-9aab-1d9414616ffa tempest-AttachVolumeShelveTestJSON-435060681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:08:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-cd483790-9ad7-44da-9aab-1d9414616ffa tempest-AttachVolumeShelveTestJSON-435060681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:08:52 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-cd483790-9ad7-44da-9aab-1d9414616ffa tempest-AttachVolumeShelveTestJSON-435060681 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:08:52 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-cd483790-9ad7-44da-9aab-1d9414616ffa tempest-AttachVolumeShelveTestJSON-435060681 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:08:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cd483790-9ad7-44da-9aab-1d9414616ffa tempest-AttachVolumeShelveTestJSON-435060681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-56dd9f10-c9a3-4ce2-8eba-ef7db03d376f 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:08:52 devstack sudo[90200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-56dd9f10-c9a3-4ce2-8eba-ef7db03d376f 1073741824 Apr 29 15:08:52 devstack sudo[90200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:08:53 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-e04e7eac-f5df-42a3-b799-4d7b86221e1a tempest-ServerActionsV293TestJSON-1649971535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:08:53 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e04e7eac-f5df-42a3-b799-4d7b86221e1a tempest-ServerActionsV293TestJSON-1649971535 None] Flow 'volume_create_manager' (5c00cbd8-e302-4f75-be72-2fca6eba313f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:08:53 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e04e7eac-f5df-42a3-b799-4d7b86221e1a tempest-ServerActionsV293TestJSON-1649971535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2c3a8e6-0b52-4f17-9d1a-d28cc516cc62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:08:53 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e04e7eac-f5df-42a3-b799-4d7b86221e1a tempest-ServerActionsV293TestJSON-1649971535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2c3a8e6-0b52-4f17-9d1a-d28cc516cc62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:08:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-750798504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d573566a-71f4-4dcd-b754-90e0377c7b3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21498c4979154ef9bf0bc2e260359429',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:08:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:08:53Z,use_quota=True,user_id='0310e644e6af43aeb8db4864a57c9015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:08:53 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e04e7eac-f5df-42a3-b799-4d7b86221e1a tempest-ServerActionsV293TestJSON-1649971535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5025ce28-0287-4a27-a6c4-6b2b5b8db9f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:08:53 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e04e7eac-f5df-42a3-b799-4d7b86221e1a tempest-ServerActionsV293TestJSON-1649971535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5025ce28-0287-4a27-a6c4-6b2b5b8db9f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:08:53 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e04e7eac-f5df-42a3-b799-4d7b86221e1a tempest-ServerActionsV293TestJSON-1649971535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d44452d-a491-464b-b70b-86078358be51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:08:53 devstack cinder-volume[84448]: DEBUG cinder.image.glance [None req-e04e7eac-f5df-42a3-b799-4d7b86221e1a tempest-ServerActionsV293TestJSON-1649971535 None] Creating Keystone auth plugin from conf {{(pid=84448) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 29 15:08:53 devstack sudo[90200]: pam_unix(sudo:session): session closed for user root Apr 29 15:08:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cd483790-9ad7-44da-9aab-1d9414616ffa tempest-AttachVolumeShelveTestJSON-435060681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-56dd9f10-c9a3-4ce2-8eba-ef7db03d376f 1073741824" returned: 0 in 0.802s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:08:53 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e04e7eac-f5df-42a3-b799-4d7b86221e1a tempest-ServerActionsV293TestJSON-1649971535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d44452d-a491-464b-b70b-86078358be51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd573566a-71f4-4dcd-b754-90e0377c7b3a', 'volume_name': 'volume-d573566a-71f4-4dcd-b754-90e0377c7b3a', 'volume_size': 1, 'image_id': 'ad86f424-7d2a-4f3b-9577-890075e7dc72', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ad86f424-7d2a-4f3b-9577-890075e7dc72', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '33db0ca5091747b1a3438d70bf53390c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ad86f424-7d2a-4f3b-9577-890075e7dc72', 'created_at': datetime.datetime(2026, 4, 29, 13, 0, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 13, 0, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ad86f424-7d2a-4f3b-9577-890075e7dc72/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:08:53 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e04e7eac-f5df-42a3-b799-4d7b86221e1a tempest-ServerActionsV293TestJSON-1649971535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e93d7ea9-86e6-40aa-881d-dde21bcf8f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:08:53 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e04e7eac-f5df-42a3-b799-4d7b86221e1a tempest-ServerActionsV293TestJSON-1649971535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e93d7ea9-86e6-40aa-881d-dde21bcf8f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:08:53 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e04e7eac-f5df-42a3-b799-4d7b86221e1a tempest-ServerActionsV293TestJSON-1649971535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aad625d9-b747-43a3-a6a9-a882dba6bf64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:08:53 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-e04e7eac-f5df-42a3-b799-4d7b86221e1a tempest-ServerActionsV293TestJSON-1649971535 None] Volume d573566a-71f4-4dcd-b754-90e0377c7b3a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d573566a-71f4-4dcd-b754-90e0377c7b3a', 'volume_size': 1, 'image_id': 'ad86f424-7d2a-4f3b-9577-890075e7dc72', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ad86f424-7d2a-4f3b-9577-890075e7dc72', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '33db0ca5091747b1a3438d70bf53390c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ad86f424-7d2a-4f3b-9577-890075e7dc72', 'created_at': datetime.datetime(2026, 4, 29, 13, 0, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 13, 0, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ad86f424-7d2a-4f3b-9577-890075e7dc72/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 29 15:08:53 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-e04e7eac-f5df-42a3-b799-4d7b86221e1a tempest-ServerActionsV293TestJSON-1649971535 None] Trying to clone d573566a-71f4-4dcd-b754-90e0377c7b3a from image ad86f424-7d2a-4f3b-9577-890075e7dc72 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ad86f424-7d2a-4f3b-9577-890075e7dc72', 'metadata': {}}]). {{(pid=84448) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 29 15:08:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cd483790-9ad7-44da-9aab-1d9414616ffa tempest-AttachVolumeShelveTestJSON-435060681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-56dd9f10-c9a3-4ce2-8eba-ef7db03d376f {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:08:53 devstack sudo[90206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-56dd9f10-c9a3-4ce2-8eba-ef7db03d376f Apr 29 15:08:53 devstack sudo[90206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:08:53 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [None req-e04e7eac-f5df-42a3-b799-4d7b86221e1a tempest-ServerActionsV293TestJSON-1649971535 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_melkvrgzdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84448) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 29 15:08:53 devstack cinder-volume[84448]: INFO cinder.image.image_utils [None req-e04e7eac-f5df-42a3-b799-4d7b86221e1a tempest-ServerActionsV293TestJSON-1649971535 None] Image download 20.69 MB at 20.69 MB/s Apr 29 15:08:53 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[0664d949-bfb9-46fa-a9be-740e232376a3]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:08:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-e04e7eac-f5df-42a3-b799-4d7b86221e1a tempest-ServerActionsV293TestJSON-1649971535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_melkvrgzdevstack@QuobyteHD {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:08:53 devstack sudo[90209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_melkvrgzdevstack@QuobyteHD Apr 29 15:08:53 devstack sudo[90209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:08:54 devstack sudo[90206]: pam_unix(sudo:session): session closed for user root Apr 29 15:08:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cd483790-9ad7-44da-9aab-1d9414616ffa tempest-AttachVolumeShelveTestJSON-435060681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-56dd9f10-c9a3-4ce2-8eba-ef7db03d376f" returned: 0 in 0.658s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:08:54 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-cd483790-9ad7-44da-9aab-1d9414616ffa tempest-AttachVolumeShelveTestJSON-435060681 None] <== create_volume: return (1537ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:08:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-cd483790-9ad7-44da-9aab-1d9414616ffa tempest-AttachVolumeShelveTestJSON-435060681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.541s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:08:54 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cd483790-9ad7-44da-9aab-1d9414616ffa tempest-AttachVolumeShelveTestJSON-435060681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fb93605-42ee-444d-b584-0279af967563) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56dd9f10-c9a3-4ce2-8eba-ef7db03d376f', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:08:54 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cd483790-9ad7-44da-9aab-1d9414616ffa tempest-AttachVolumeShelveTestJSON-435060681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69f67a23-eaac-4357-a5b1-cbfc156d1fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:08:54 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-cd483790-9ad7-44da-9aab-1d9414616ffa tempest-AttachVolumeShelveTestJSON-435060681 None] Volume volume-56dd9f10-c9a3-4ce2-8eba-ef7db03d376f (56dd9f10-c9a3-4ce2-8eba-ef7db03d376f): created successfully Apr 29 15:08:54 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cd483790-9ad7-44da-9aab-1d9414616ffa tempest-AttachVolumeShelveTestJSON-435060681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69f67a23-eaac-4357-a5b1-cbfc156d1fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:08:54 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cd483790-9ad7-44da-9aab-1d9414616ffa tempest-AttachVolumeShelveTestJSON-435060681 None] Flow 'volume_create_manager' (095d7f4e-9a9b-44fd-bb5d-d739faf5e720) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:08:54 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-cd483790-9ad7-44da-9aab-1d9414616ffa tempest-AttachVolumeShelveTestJSON-435060681 None] Created volume successfully. Apr 29 15:08:54 devstack sudo[90209]: pam_unix(sudo:session): session closed for user root Apr 29 15:08:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-e04e7eac-f5df-42a3-b799-4d7b86221e1a tempest-ServerActionsV293TestJSON-1649971535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_melkvrgzdevstack@QuobyteHD" returned: 0 in 0.655s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:08:54 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [None req-e04e7eac-f5df-42a3-b799-4d7b86221e1a tempest-ServerActionsV293TestJSON-1649971535 None] Temporary image ad86f424-7d2a-4f3b-9577-890075e7dc72 is fetched for user 0310e644e6af43aeb8db4864a57c9015. {{(pid=84448) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 29 15:08:54 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[7518f2ef-57eb-41cb-bb0b-4f2765349e97]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:08:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-e04e7eac-f5df-42a3-b799-4d7b86221e1a tempest-ServerActionsV293TestJSON-1649971535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_melkvrgzdevstack@QuobyteHD {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:08:54 devstack sudo[90216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_melkvrgzdevstack@QuobyteHD Apr 29 15:08:54 devstack sudo[90216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:08:55 devstack sudo[90216]: pam_unix(sudo:session): session closed for user root Apr 29 15:08:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-e04e7eac-f5df-42a3-b799-4d7b86221e1a tempest-ServerActionsV293TestJSON-1649971535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_melkvrgzdevstack@QuobyteHD" returned: 0 in 0.764s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:08:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-e04e7eac-f5df-42a3-b799-4d7b86221e1a tempest-ServerActionsV293TestJSON-1649971535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:08:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-e04e7eac-f5df-42a3-b799-4d7b86221e1a tempest-ServerActionsV293TestJSON-1649971535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:08:55 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-e04e7eac-f5df-42a3-b799-4d7b86221e1a tempest-ServerActionsV293TestJSON-1649971535 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:08:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-750798504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d573566a-71f4-4dcd-b754-90e0377c7b3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21498c4979154ef9bf0bc2e260359429',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:08:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:08:53Z,use_quota=True,user_id='0310e644e6af43aeb8db4864a57c9015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:08:55 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-e04e7eac-f5df-42a3-b799-4d7b86221e1a tempest-ServerActionsV293TestJSON-1649971535 None] Creating volume d573566a-71f4-4dcd-b754-90e0377c7b3a {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:08:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-e04e7eac-f5df-42a3-b799-4d7b86221e1a tempest-ServerActionsV293TestJSON-1649971535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:08:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-e04e7eac-f5df-42a3-b799-4d7b86221e1a tempest-ServerActionsV293TestJSON-1649971535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:08:55 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-e04e7eac-f5df-42a3-b799-4d7b86221e1a tempest-ServerActionsV293TestJSON-1649971535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:08:55 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-e04e7eac-f5df-42a3-b799-4d7b86221e1a tempest-ServerActionsV293TestJSON-1649971535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:08:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-e04e7eac-f5df-42a3-b799-4d7b86221e1a tempest-ServerActionsV293TestJSON-1649971535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:08:55 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-e04e7eac-f5df-42a3-b799-4d7b86221e1a tempest-ServerActionsV293TestJSON-1649971535 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:08:55 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-e04e7eac-f5df-42a3-b799-4d7b86221e1a tempest-ServerActionsV293TestJSON-1649971535 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:08:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-e04e7eac-f5df-42a3-b799-4d7b86221e1a tempest-ServerActionsV293TestJSON-1649971535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d573566a-71f4-4dcd-b754-90e0377c7b3a 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:08:55 devstack sudo[90228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d573566a-71f4-4dcd-b754-90e0377c7b3a 1073741824 Apr 29 15:08:55 devstack sudo[90228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:08:56 devstack sudo[90228]: pam_unix(sudo:session): session closed for user root Apr 29 15:08:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-e04e7eac-f5df-42a3-b799-4d7b86221e1a tempest-ServerActionsV293TestJSON-1649971535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d573566a-71f4-4dcd-b754-90e0377c7b3a 1073741824" returned: 0 in 0.950s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:08:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-e04e7eac-f5df-42a3-b799-4d7b86221e1a tempest-ServerActionsV293TestJSON-1649971535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d573566a-71f4-4dcd-b754-90e0377c7b3a {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:08:56 devstack sudo[90237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d573566a-71f4-4dcd-b754-90e0377c7b3a Apr 29 15:08:56 devstack sudo[90237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:08:57 devstack sudo[90237]: pam_unix(sudo:session): session closed for user root Apr 29 15:08:57 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-e04e7eac-f5df-42a3-b799-4d7b86221e1a tempest-ServerActionsV293TestJSON-1649971535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d573566a-71f4-4dcd-b754-90e0377c7b3a" returned: 0 in 0.713s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:08:57 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-e04e7eac-f5df-42a3-b799-4d7b86221e1a tempest-ServerActionsV293TestJSON-1649971535 None] <== create_volume: return (1736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:08:57 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-e04e7eac-f5df-42a3-b799-4d7b86221e1a tempest-ServerActionsV293TestJSON-1649971535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.739s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:08:57 devstack cinder-volume[84448]: DEBUG cinder.volume.volume_utils [None req-e04e7eac-f5df-42a3-b799-4d7b86221e1a tempest-ServerActionsV293TestJSON-1649971535 None] Attempting download of ad86f424-7d2a-4f3b-9577-890075e7dc72 ((None, [{'url': 'file:///opt/stack/data/glance/images/ad86f424-7d2a-4f3b-9577-890075e7dc72', 'metadata': {}}])) to volume d573566a-71f4-4dcd-b754-90e0377c7b3a. {{(pid=84448) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 29 15:08:57 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf7d7d4-90b6-487d-8dba-38c94981f231]: (4, 'raw') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:08:57 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-e04e7eac-f5df-42a3-b799-4d7b86221e1a tempest-ServerActionsV293TestJSON-1649971535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ad86f424-7d2a-4f3b-9577-890075e7dc72_bf80ncd8 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:08:57 devstack sudo[90243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ad86f424-7d2a-4f3b-9577-890075e7dc72_bf80ncd8 Apr 29 15:08:57 devstack sudo[90243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:08:58 devstack sudo[90243]: pam_unix(sudo:session): session closed for user root Apr 29 15:08:58 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-e04e7eac-f5df-42a3-b799-4d7b86221e1a tempest-ServerActionsV293TestJSON-1649971535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ad86f424-7d2a-4f3b-9577-890075e7dc72_bf80ncd8" returned: 0 in 1.502s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:08:58 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-e04e7eac-f5df-42a3-b799-4d7b86221e1a tempest-ServerActionsV293TestJSON-1649971535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ad86f424-7d2a-4f3b-9577-890075e7dc72_bf80ncd8 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:08:58 devstack sudo[90287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ad86f424-7d2a-4f3b-9577-890075e7dc72_bf80ncd8 Apr 29 15:08:58 devstack sudo[90287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:08:59 devstack sudo[90287]: pam_unix(sudo:session): session closed for user root Apr 29 15:08:59 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-e04e7eac-f5df-42a3-b799-4d7b86221e1a tempest-ServerActionsV293TestJSON-1649971535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ad86f424-7d2a-4f3b-9577-890075e7dc72_bf80ncd8" returned: 1 in 0.885s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:08:59 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-e04e7eac-f5df-42a3-b799-4d7b86221e1a tempest-ServerActionsV293TestJSON-1649971535 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ad86f424-7d2a-4f3b-9577-890075e7dc72_bf80ncd8' failed. Not Retrying. {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 15:08:59 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c21c2b5-d27f-4c40-8b8e-88e65958989b]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:08:59 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-e04e7eac-f5df-42a3-b799-4d7b86221e1a tempest-ServerActionsV293TestJSON-1649971535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_melkvrgzdevstack@QuobyteHD {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:08:59 devstack sudo[90316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_melkvrgzdevstack@QuobyteHD Apr 29 15:08:59 devstack sudo[90316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:09:00 devstack sudo[90316]: pam_unix(sudo:session): session closed for user root Apr 29 15:09:00 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-e04e7eac-f5df-42a3-b799-4d7b86221e1a tempest-ServerActionsV293TestJSON-1649971535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_melkvrgzdevstack@QuobyteHD" returned: 0 in 0.765s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:09:00 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [None req-e04e7eac-f5df-42a3-b799-4d7b86221e1a tempest-ServerActionsV293TestJSON-1649971535 None] ad86f424-7d2a-4f3b-9577-890075e7dc72 was qcow2, converting to raw {{(pid=84448) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 29 15:09:00 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-e04e7eac-f5df-42a3-b799-4d7b86221e1a tempest-ServerActionsV293TestJSON-1649971535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_melkvrgzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d573566a-71f4-4dcd-b754-90e0377c7b3a {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:09:00 devstack sudo[90328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_melkvrgzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d573566a-71f4-4dcd-b754-90e0377c7b3a Apr 29 15:09:00 devstack sudo[90328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:09:03 devstack sudo[90328]: pam_unix(sudo:session): session closed for user root Apr 29 15:09:03 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-e04e7eac-f5df-42a3-b799-4d7b86221e1a tempest-ServerActionsV293TestJSON-1649971535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_melkvrgzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d573566a-71f4-4dcd-b754-90e0377c7b3a" returned: 0 in 2.985s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:09:03 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [None req-e04e7eac-f5df-42a3-b799-4d7b86221e1a tempest-ServerActionsV293TestJSON-1649971535 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_melkvrgzdevstack@QuobyteHD, size 112.00 MB, duration 2.99 sec, destination /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d573566a-71f4-4dcd-b754-90e0377c7b3a {{(pid=84448) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 15:09:03 devstack cinder-volume[84448]: INFO cinder.image.image_utils [None req-e04e7eac-f5df-42a3-b799-4d7b86221e1a tempest-ServerActionsV293TestJSON-1649971535 None] Converted 112.00 MB image at 37.50 MB/s Apr 29 15:09:03 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-e04e7eac-f5df-42a3-b799-4d7b86221e1a tempest-ServerActionsV293TestJSON-1649971535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d573566a-71f4-4dcd-b754-90e0377c7b3a 1G {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:09:03 devstack sudo[90342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d573566a-71f4-4dcd-b754-90e0377c7b3a 1G Apr 29 15:09:03 devstack sudo[90342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:09:03 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1c076cb-0618-4d68-a250-6fb4adeda005 tempest-ServerActionsTestOtherA-411716500 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:09:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b1c076cb-0618-4d68-a250-6fb4adeda005 tempest-ServerActionsTestOtherA-411716500 None] Flow 'volume_create_manager' (4df9c05d-51ad-4d8d-b374-88794950ce4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:09:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b1c076cb-0618-4d68-a250-6fb4adeda005 tempest-ServerActionsTestOtherA-411716500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (527fff14-ecbd-4df1-8f93-e06474692c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:09:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b1c076cb-0618-4d68-a250-6fb4adeda005 tempest-ServerActionsTestOtherA-411716500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (527fff14-ecbd-4df1-8f93-e06474692c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:09:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-384046123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed99b35b-7068-4ab5-8cde-7f4a5efce0cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24a3f3475021401f819fc925be784957',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:09:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:09:04Z,use_quota=True,user_id='bc41387fff914ec89773ece9f3dbf150',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:09:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b1c076cb-0618-4d68-a250-6fb4adeda005 tempest-ServerActionsTestOtherA-411716500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4b54448-825b-4ec9-94d3-22d0a30160a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:09:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b1c076cb-0618-4d68-a250-6fb4adeda005 tempest-ServerActionsTestOtherA-411716500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4b54448-825b-4ec9-94d3-22d0a30160a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:09:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b1c076cb-0618-4d68-a250-6fb4adeda005 tempest-ServerActionsTestOtherA-411716500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96c49780-584e-49eb-8d97-c4498394d35d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:09:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b1c076cb-0618-4d68-a250-6fb4adeda005 tempest-ServerActionsTestOtherA-411716500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96c49780-584e-49eb-8d97-c4498394d35d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed99b35b-7068-4ab5-8cde-7f4a5efce0cb', 'volume_name': 'volume-ed99b35b-7068-4ab5-8cde-7f4a5efce0cb', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:09:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b1c076cb-0618-4d68-a250-6fb4adeda005 tempest-ServerActionsTestOtherA-411716500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cab7923-745e-4fce-b49b-51513b08792c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:09:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b1c076cb-0618-4d68-a250-6fb4adeda005 tempest-ServerActionsTestOtherA-411716500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cab7923-745e-4fce-b49b-51513b08792c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:09:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b1c076cb-0618-4d68-a250-6fb4adeda005 tempest-ServerActionsTestOtherA-411716500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c80e3b84-78e0-414e-867f-d5d52aa2f7b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:09:03 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-b1c076cb-0618-4d68-a250-6fb4adeda005 tempest-ServerActionsTestOtherA-411716500 None] Volume ed99b35b-7068-4ab5-8cde-7f4a5efce0cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed99b35b-7068-4ab5-8cde-7f4a5efce0cb', 'volume_size': 1} Apr 29 15:09:03 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-b1c076cb-0618-4d68-a250-6fb4adeda005 tempest-ServerActionsTestOtherA-411716500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:09:03 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-b1c076cb-0618-4d68-a250-6fb4adeda005 tempest-ServerActionsTestOtherA-411716500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:09:03 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-b1c076cb-0618-4d68-a250-6fb4adeda005 tempest-ServerActionsTestOtherA-411716500 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:09:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-384046123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed99b35b-7068-4ab5-8cde-7f4a5efce0cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24a3f3475021401f819fc925be784957',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:09:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:09:04Z,use_quota=True,user_id='bc41387fff914ec89773ece9f3dbf150',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:09:03 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-b1c076cb-0618-4d68-a250-6fb4adeda005 tempest-ServerActionsTestOtherA-411716500 None] Creating volume ed99b35b-7068-4ab5-8cde-7f4a5efce0cb {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:09:03 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-b1c076cb-0618-4d68-a250-6fb4adeda005 tempest-ServerActionsTestOtherA-411716500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:09:03 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-b1c076cb-0618-4d68-a250-6fb4adeda005 tempest-ServerActionsTestOtherA-411716500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:09:03 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-b1c076cb-0618-4d68-a250-6fb4adeda005 tempest-ServerActionsTestOtherA-411716500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:09:03 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-b1c076cb-0618-4d68-a250-6fb4adeda005 tempest-ServerActionsTestOtherA-411716500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:09:03 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-b1c076cb-0618-4d68-a250-6fb4adeda005 tempest-ServerActionsTestOtherA-411716500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:09:03 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-b1c076cb-0618-4d68-a250-6fb4adeda005 tempest-ServerActionsTestOtherA-411716500 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:09:03 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-b1c076cb-0618-4d68-a250-6fb4adeda005 tempest-ServerActionsTestOtherA-411716500 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:09:03 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-b1c076cb-0618-4d68-a250-6fb4adeda005 tempest-ServerActionsTestOtherA-411716500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ed99b35b-7068-4ab5-8cde-7f4a5efce0cb 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:09:04 devstack sudo[90344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ed99b35b-7068-4ab5-8cde-7f4a5efce0cb 1073741824 Apr 29 15:09:04 devstack sudo[90344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:09:04 devstack sudo[90342]: pam_unix(sudo:session): session closed for user root Apr 29 15:09:04 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-e04e7eac-f5df-42a3-b799-4d7b86221e1a tempest-ServerActionsV293TestJSON-1649971535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d573566a-71f4-4dcd-b754-90e0377c7b3a 1G" returned: 0 in 1.575s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:09:04 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab024e81-f52f-4e08-87e9-d4986a97d692]: (4, 'raw') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:09:04 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-e04e7eac-f5df-42a3-b799-4d7b86221e1a tempest-ServerActionsV293TestJSON-1649971535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d573566a-71f4-4dcd-b754-90e0377c7b3a {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:09:05 devstack sudo[90344]: pam_unix(sudo:session): session closed for user root Apr 29 15:09:05 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-b1c076cb-0618-4d68-a250-6fb4adeda005 tempest-ServerActionsTestOtherA-411716500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ed99b35b-7068-4ab5-8cde-7f4a5efce0cb 1073741824" returned: 0 in 1.238s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:09:05 devstack sudo[90355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d573566a-71f4-4dcd-b754-90e0377c7b3a Apr 29 15:09:05 devstack sudo[90355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:09:05 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-b1c076cb-0618-4d68-a250-6fb4adeda005 tempest-ServerActionsTestOtherA-411716500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ed99b35b-7068-4ab5-8cde-7f4a5efce0cb {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:09:05 devstack sudo[90357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ed99b35b-7068-4ab5-8cde-7f4a5efce0cb Apr 29 15:09:05 devstack sudo[90357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:09:06 devstack sudo[90355]: pam_unix(sudo:session): session closed for user root Apr 29 15:09:06 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-e04e7eac-f5df-42a3-b799-4d7b86221e1a tempest-ServerActionsV293TestJSON-1649971535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d573566a-71f4-4dcd-b754-90e0377c7b3a" returned: 0 in 1.360s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:09:06 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-e04e7eac-f5df-42a3-b799-4d7b86221e1a tempest-ServerActionsV293TestJSON-1649971535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d573566a-71f4-4dcd-b754-90e0377c7b3a {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:09:06 devstack sudo[90357]: pam_unix(sudo:session): session closed for user root Apr 29 15:09:06 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-b1c076cb-0618-4d68-a250-6fb4adeda005 tempest-ServerActionsTestOtherA-411716500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ed99b35b-7068-4ab5-8cde-7f4a5efce0cb" returned: 0 in 1.054s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:09:06 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-b1c076cb-0618-4d68-a250-6fb4adeda005 tempest-ServerActionsTestOtherA-411716500 None] <== create_volume: return (2417ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:09:06 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-b1c076cb-0618-4d68-a250-6fb4adeda005 tempest-ServerActionsTestOtherA-411716500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.420s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:09:06 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b1c076cb-0618-4d68-a250-6fb4adeda005 tempest-ServerActionsTestOtherA-411716500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c80e3b84-78e0-414e-867f-d5d52aa2f7b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed99b35b-7068-4ab5-8cde-7f4a5efce0cb', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:09:06 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b1c076cb-0618-4d68-a250-6fb4adeda005 tempest-ServerActionsTestOtherA-411716500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d2aae4d-4390-48a4-8dc9-56e7a60afb89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:09:06 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-b1c076cb-0618-4d68-a250-6fb4adeda005 tempest-ServerActionsTestOtherA-411716500 None] Volume volume-ed99b35b-7068-4ab5-8cde-7f4a5efce0cb (ed99b35b-7068-4ab5-8cde-7f4a5efce0cb): created successfully Apr 29 15:09:06 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b1c076cb-0618-4d68-a250-6fb4adeda005 tempest-ServerActionsTestOtherA-411716500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d2aae4d-4390-48a4-8dc9-56e7a60afb89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:09:06 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b1c076cb-0618-4d68-a250-6fb4adeda005 tempest-ServerActionsTestOtherA-411716500 None] Flow 'volume_create_manager' (4df9c05d-51ad-4d8d-b374-88794950ce4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:09:06 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-b1c076cb-0618-4d68-a250-6fb4adeda005 tempest-ServerActionsTestOtherA-411716500 None] Created volume successfully. Apr 29 15:09:06 devstack sudo[90362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d573566a-71f4-4dcd-b754-90e0377c7b3a Apr 29 15:09:06 devstack sudo[90362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:09:07 devstack sudo[90362]: pam_unix(sudo:session): session closed for user root Apr 29 15:09:07 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-e04e7eac-f5df-42a3-b799-4d7b86221e1a tempest-ServerActionsV293TestJSON-1649971535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d573566a-71f4-4dcd-b754-90e0377c7b3a" returned: 1 in 0.830s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:09:07 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-e04e7eac-f5df-42a3-b799-4d7b86221e1a tempest-ServerActionsV293TestJSON-1649971535 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d573566a-71f4-4dcd-b754-90e0377c7b3a' failed. Not Retrying. {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 15:09:07 devstack cinder-volume[84448]: DEBUG cinder.volume.volume_utils [None req-e04e7eac-f5df-42a3-b799-4d7b86221e1a tempest-ServerActionsV293TestJSON-1649971535 None] Downloaded image ad86f424-7d2a-4f3b-9577-890075e7dc72 ((None, [{'url': 'file:///opt/stack/data/glance/images/ad86f424-7d2a-4f3b-9577-890075e7dc72', 'metadata': {}}])) to volume d573566a-71f4-4dcd-b754-90e0377c7b3a successfully. {{(pid=84448) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 29 15:09:07 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [None req-e04e7eac-f5df-42a3-b799-4d7b86221e1a tempest-ServerActionsV293TestJSON-1649971535 None] Temporary image ad86f424-7d2a-4f3b-9577-890075e7dc72 for user 0310e644e6af43aeb8db4864a57c9015 is deleted. {{(pid=84448) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 29 15:09:07 devstack cinder-volume[84448]: DEBUG cinder.volume.volume_utils [None req-e04e7eac-f5df-42a3-b799-4d7b86221e1a tempest-ServerActionsV293TestJSON-1649971535 None] Marking volume d573566a-71f4-4dcd-b754-90e0377c7b3a as bootable. {{(pid=84448) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 29 15:09:07 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-e04e7eac-f5df-42a3-b799-4d7b86221e1a tempest-ServerActionsV293TestJSON-1649971535 None] Copying metadata from image ad86f424-7d2a-4f3b-9577-890075e7dc72 to d573566a-71f4-4dcd-b754-90e0377c7b3a. {{(pid=84448) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 29 15:09:07 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-e04e7eac-f5df-42a3-b799-4d7b86221e1a tempest-ServerActionsV293TestJSON-1649971535 None] Creating volume glance metadata for volume d573566a-71f4-4dcd-b754-90e0377c7b3a backed by image ad86f424-7d2a-4f3b-9577-890075e7dc72 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'ad86f424-7d2a-4f3b-9577-890075e7dc72', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84448) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 29 15:09:07 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e04e7eac-f5df-42a3-b799-4d7b86221e1a tempest-ServerActionsV293TestJSON-1649971535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aad625d9-b747-43a3-a6a9-a882dba6bf64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d573566a-71f4-4dcd-b754-90e0377c7b3a', 'volume_size': 1, 'image_id': 'ad86f424-7d2a-4f3b-9577-890075e7dc72', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ad86f424-7d2a-4f3b-9577-890075e7dc72', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '33db0ca5091747b1a3438d70bf53390c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ad86f424-7d2a-4f3b-9577-890075e7dc72', 'created_at': datetime.datetime(2026, 4, 29, 13, 0, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 13, 0, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ad86f424-7d2a-4f3b-9577-890075e7dc72/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:09:07 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e04e7eac-f5df-42a3-b799-4d7b86221e1a tempest-ServerActionsV293TestJSON-1649971535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df4ed201-0ff8-47eb-a88f-afc27c0440f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:09:07 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-e04e7eac-f5df-42a3-b799-4d7b86221e1a tempest-ServerActionsV293TestJSON-1649971535 None] Volume volume-d573566a-71f4-4dcd-b754-90e0377c7b3a (d573566a-71f4-4dcd-b754-90e0377c7b3a): created successfully Apr 29 15:09:07 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e04e7eac-f5df-42a3-b799-4d7b86221e1a tempest-ServerActionsV293TestJSON-1649971535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df4ed201-0ff8-47eb-a88f-afc27c0440f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:09:07 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e04e7eac-f5df-42a3-b799-4d7b86221e1a tempest-ServerActionsV293TestJSON-1649971535 None] Flow 'volume_create_manager' (5c00cbd8-e302-4f75-be72-2fca6eba313f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:09:07 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-e04e7eac-f5df-42a3-b799-4d7b86221e1a tempest-ServerActionsV293TestJSON-1649971535 None] Created volume successfully. Apr 29 15:09:17 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-590a1b24-ae3c-4f45-a89e-fc2347ab32a7 req-6bb28167-acfa-48fd-8019-ded9651bc0d4 tempest-ServerActionsV293TestJSON-1649971535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:09:17 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-590a1b24-ae3c-4f45-a89e-fc2347ab32a7 req-6bb28167-acfa-48fd-8019-ded9651bc0d4 tempest-ServerActionsV293TestJSON-1649971535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:09:17 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[473b5b64-233e-4a89-90de-8b96649f40b5]: (4, 'raw') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:09:17 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-590a1b24-ae3c-4f45-a89e-fc2347ab32a7 req-6bb28167-acfa-48fd-8019-ded9651bc0d4 tempest-ServerActionsV293TestJSON-1649971535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d573566a-71f4-4dcd-b754-90e0377c7b3a {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:09:17 devstack sudo[90522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d573566a-71f4-4dcd-b754-90e0377c7b3a Apr 29 15:09:17 devstack sudo[90522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:09:18 devstack sudo[90522]: pam_unix(sudo:session): session closed for user root Apr 29 15:09:18 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-590a1b24-ae3c-4f45-a89e-fc2347ab32a7 req-6bb28167-acfa-48fd-8019-ded9651bc0d4 tempest-ServerActionsV293TestJSON-1649971535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d573566a-71f4-4dcd-b754-90e0377c7b3a" returned: 0 in 0.956s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:09:18 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-590a1b24-ae3c-4f45-a89e-fc2347ab32a7 req-6bb28167-acfa-48fd-8019-ded9651bc0d4 tempest-ServerActionsV293TestJSON-1649971535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d573566a-71f4-4dcd-b754-90e0377c7b3a {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:09:18 devstack sudo[90527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d573566a-71f4-4dcd-b754-90e0377c7b3a Apr 29 15:09:18 devstack sudo[90527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:09:18 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-d87ff190-9360-48e5-8671-e4b485062a32 req-c79e5005-e9ae-49ef-8738-288d1af18ea6 tempest-AttachVolumeShelveTestJSON-435060681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:09:19 devstack sudo[90527]: pam_unix(sudo:session): session closed for user root Apr 29 15:09:19 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-590a1b24-ae3c-4f45-a89e-fc2347ab32a7 req-6bb28167-acfa-48fd-8019-ded9651bc0d4 tempest-ServerActionsV293TestJSON-1649971535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d573566a-71f4-4dcd-b754-90e0377c7b3a" returned: 1 in 0.858s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:09:19 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-590a1b24-ae3c-4f45-a89e-fc2347ab32a7 req-6bb28167-acfa-48fd-8019-ded9651bc0d4 tempest-ServerActionsV293TestJSON-1649971535 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d573566a-71f4-4dcd-b754-90e0377c7b3a' failed. Not Retrying. {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 15:09:19 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-590a1b24-ae3c-4f45-a89e-fc2347ab32a7 req-6bb28167-acfa-48fd-8019-ded9651bc0d4 tempest-ServerActionsV293TestJSON-1649971535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.903s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:09:19 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-d87ff190-9360-48e5-8671-e4b485062a32 req-c79e5005-e9ae-49ef-8738-288d1af18ea6 tempest-AttachVolumeShelveTestJSON-435060681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.514s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:09:19 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[f348ef4f-cefa-49cf-a88c-c1fe63aaa8e8]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:09:19 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-d87ff190-9360-48e5-8671-e4b485062a32 req-c79e5005-e9ae-49ef-8738-288d1af18ea6 tempest-AttachVolumeShelveTestJSON-435060681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-56dd9f10-c9a3-4ce2-8eba-ef7db03d376f {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:09:19 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-590a1b24-ae3c-4f45-a89e-fc2347ab32a7 req-6bb28167-acfa-48fd-8019-ded9651bc0d4 tempest-ServerActionsV293TestJSON-1649971535 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a', 'name': 'volume-d573566a-71f4-4dcd-b754-90e0377c7b3a', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f6f0ce55-540e-4e4d-8715-84ea4e222164', 'enforce_multipath': True} {{(pid=84448) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 15:09:19 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-590a1b24-ae3c-4f45-a89e-fc2347ab32a7 req-6bb28167-acfa-48fd-8019-ded9651bc0d4 tempest-ServerActionsV293TestJSON-1649971535 None] attachment_update completed successfully. Apr 29 15:09:19 devstack sudo[90540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-56dd9f10-c9a3-4ce2-8eba-ef7db03d376f Apr 29 15:09:19 devstack sudo[90540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:09:20 devstack sudo[90540]: pam_unix(sudo:session): session closed for user root Apr 29 15:09:20 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-d87ff190-9360-48e5-8671-e4b485062a32 req-c79e5005-e9ae-49ef-8738-288d1af18ea6 tempest-AttachVolumeShelveTestJSON-435060681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-56dd9f10-c9a3-4ce2-8eba-ef7db03d376f" returned: 0 in 0.772s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:09:20 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-d87ff190-9360-48e5-8671-e4b485062a32 req-c79e5005-e9ae-49ef-8738-288d1af18ea6 tempest-AttachVolumeShelveTestJSON-435060681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.793s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:09:20 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-d87ff190-9360-48e5-8671-e4b485062a32 req-c79e5005-e9ae-49ef-8738-288d1af18ea6 tempest-AttachVolumeShelveTestJSON-435060681 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a', 'name': 'volume-56dd9f10-c9a3-4ce2-8eba-ef7db03d376f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c06ad96c-d9b7-455b-aef9-99d5863ae811', 'enforce_multipath': True} {{(pid=84448) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 15:09:20 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-d87ff190-9360-48e5-8671-e4b485062a32 req-c79e5005-e9ae-49ef-8738-288d1af18ea6 tempest-AttachVolumeShelveTestJSON-435060681 None] attachment_update completed successfully. Apr 29 15:09:30 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:SELECT=24,cinder:UPDATE=15,cinder:INSERT=8,cinder:DELETE=1 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:09:30 devstack cinder-volume[84448]: DEBUG oslo_service.periodic_task [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84448) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 15:09:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:09:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:09:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:09:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:09:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:09:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:09:30 devstack sudo[90681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:09:30 devstack sudo[90681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:09:32 devstack sudo[90681]: pam_unix(sudo:session): session closed for user root Apr 29 15:09:32 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 1.871s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:09:32 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:09:32 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:SELECT=26,cinder:UPDATE=13,cinder:INSERT=8,cinder:DELETE=2 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:09:53 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-0195047d-d4f6-4db0-9c81-a45fb5952639 req-f2673ab8-db35-4ba5-919a-1d10eafc6942 tempest-TaggedBootDevicesTest_v242-1336169590 None] Terminate volume connection completed successfully. Apr 29 15:09:53 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-0195047d-d4f6-4db0-9c81-a45fb5952639 req-f2673ab8-db35-4ba5-919a-1d10eafc6942 tempest-TaggedBootDevicesTest_v242-1336169590 None] Deleting attachment 0f1916ff-44ee-41d2-bc61-cf7e543c9ce6. {{(pid=84448) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 15:09:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-877337fa-14a4-4933-a379-1b628e6c93d3 req-65776ed3-7cfb-4e9d-96e9-7bd706ee3e3d tempest-ServerActionsTestOtherA-411716500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:09:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-877337fa-14a4-4933-a379-1b628e6c93d3 req-65776ed3-7cfb-4e9d-96e9-7bd706ee3e3d tempest-ServerActionsTestOtherA-411716500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:09:53 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4438e70-e349-41f1-bffe-e9229cc39740]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:09:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-877337fa-14a4-4933-a379-1b628e6c93d3 req-65776ed3-7cfb-4e9d-96e9-7bd706ee3e3d tempest-ServerActionsTestOtherA-411716500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ed99b35b-7068-4ab5-8cde-7f4a5efce0cb {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:09:53 devstack sudo[91241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ed99b35b-7068-4ab5-8cde-7f4a5efce0cb Apr 29 15:09:53 devstack sudo[91241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:09:53 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-0195047d-d4f6-4db0-9c81-a45fb5952639 req-b68571eb-491c-40c8-b386-c7cc0c46a89c tempest-TaggedBootDevicesTest_v242-1336169590 None] Terminate volume connection completed successfully. Apr 29 15:09:53 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-0195047d-d4f6-4db0-9c81-a45fb5952639 req-b68571eb-491c-40c8-b386-c7cc0c46a89c tempest-TaggedBootDevicesTest_v242-1336169590 None] Deleting attachment 0b128d8d-ff35-4cad-ae83-f1e241cce98d. {{(pid=84448) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 15:09:54 devstack sudo[91241]: pam_unix(sudo:session): session closed for user root Apr 29 15:09:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-877337fa-14a4-4933-a379-1b628e6c93d3 req-65776ed3-7cfb-4e9d-96e9-7bd706ee3e3d tempest-ServerActionsTestOtherA-411716500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ed99b35b-7068-4ab5-8cde-7f4a5efce0cb" returned: 0 in 0.768s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:09:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-877337fa-14a4-4933-a379-1b628e6c93d3 req-65776ed3-7cfb-4e9d-96e9-7bd706ee3e3d tempest-ServerActionsTestOtherA-411716500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.787s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:09:54 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-877337fa-14a4-4933-a379-1b628e6c93d3 req-65776ed3-7cfb-4e9d-96e9-7bd706ee3e3d tempest-ServerActionsTestOtherA-411716500 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a', 'name': 'volume-ed99b35b-7068-4ab5-8cde-7f4a5efce0cb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b761c343-0c4e-42e4-8dc3-9117f1384919', 'enforce_multipath': True} {{(pid=84448) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 15:09:54 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-877337fa-14a4-4933-a379-1b628e6c93d3 req-65776ed3-7cfb-4e9d-96e9-7bd706ee3e3d tempest-ServerActionsTestOtherA-411716500 None] attachment_update completed successfully. Apr 29 15:09:54 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-0195047d-d4f6-4db0-9c81-a45fb5952639 req-fe4da0fb-8834-4fed-9fc7-4526863276ac tempest-TaggedBootDevicesTest_v242-1336169590 None] Terminate volume connection completed successfully. Apr 29 15:09:54 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-0195047d-d4f6-4db0-9c81-a45fb5952639 req-fe4da0fb-8834-4fed-9fc7-4526863276ac tempest-TaggedBootDevicesTest_v242-1336169590 None] Deleting attachment 393cd447-7597-42ad-9dca-486d8c3db4f0. {{(pid=84448) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 15:10:01 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-8f2a6e20-f60b-49bf-a91c-98fa552cfd35 tempest-TaggedBootDevicesTest_v242-1336169590 None] Acquiring lock "cinder-1f91241d-022f-4a09-af85-c3aaa9d0c00f-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:10:01 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-8f2a6e20-f60b-49bf-a91c-98fa552cfd35 tempest-TaggedBootDevicesTest_v242-1336169590 None] Lock "cinder-1f91241d-022f-4a09-af85-c3aaa9d0c00f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:10:01 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-8f2a6e20-f60b-49bf-a91c-98fa552cfd35 tempest-TaggedBootDevicesTest_v242-1336169590 None] Acquiring lock "cinder-quobyte-1f91241d-022f-4a09-af85-c3aaa9d0c00f" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:10:01 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-8f2a6e20-f60b-49bf-a91c-98fa552cfd35 tempest-TaggedBootDevicesTest_v242-1336169590 None] Lock "cinder-quobyte-1f91241d-022f-4a09-af85-c3aaa9d0c00f" acquired by "delete_volume" :: waited 0.026s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:10:01 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[1769fdfb-9056-413f-bdb8-b46528dd1615]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:10:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-8f2a6e20-f60b-49bf-a91c-98fa552cfd35 tempest-TaggedBootDevicesTest_v242-1336169590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1f91241d-022f-4a09-af85-c3aaa9d0c00f {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:10:01 devstack sudo[91303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1f91241d-022f-4a09-af85-c3aaa9d0c00f Apr 29 15:10:01 devstack sudo[91303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:10:02 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-6d45b3bd-7afe-4784-aac0-a77a995ce862 req-359b25ff-180a-4e04-871f-a2c349bdcfc7 tempest-ServerActionsTestOtherA-411716500 None] Terminate volume connection completed successfully. Apr 29 15:10:02 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-6d45b3bd-7afe-4784-aac0-a77a995ce862 req-359b25ff-180a-4e04-871f-a2c349bdcfc7 tempest-ServerActionsTestOtherA-411716500 None] Deleting attachment b761c343-0c4e-42e4-8dc3-9117f1384919. {{(pid=84448) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 15:10:02 devstack sudo[91303]: pam_unix(sudo:session): session closed for user root Apr 29 15:10:02 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-8f2a6e20-f60b-49bf-a91c-98fa552cfd35 tempest-TaggedBootDevicesTest_v242-1336169590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1f91241d-022f-4a09-af85-c3aaa9d0c00f" returned: 0 in 0.790s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:10:02 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-8f2a6e20-f60b-49bf-a91c-98fa552cfd35 tempest-TaggedBootDevicesTest_v242-1336169590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1f91241d-022f-4a09-af85-c3aaa9d0c00f {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:10:02 devstack sudo[91316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1f91241d-022f-4a09-af85-c3aaa9d0c00f Apr 29 15:10:02 devstack sudo[91316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:10:03 devstack sudo[91316]: pam_unix(sudo:session): session closed for user root Apr 29 15:10:03 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-8f2a6e20-f60b-49bf-a91c-98fa552cfd35 tempest-TaggedBootDevicesTest_v242-1336169590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1f91241d-022f-4a09-af85-c3aaa9d0c00f" returned: 0 in 0.620s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:10:03 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-8f2a6e20-f60b-49bf-a91c-98fa552cfd35 tempest-TaggedBootDevicesTest_v242-1336169590 None] Lock "cinder-quobyte-1f91241d-022f-4a09-af85-c3aaa9d0c00f" released by "delete_volume" :: held 1.487s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:10:03 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-8f2a6e20-f60b-49bf-a91c-98fa552cfd35 tempest-TaggedBootDevicesTest_v242-1336169590 None] Created reservations ['62471ecf-d461-445a-b320-0393655a98cb', '4d7514d0-8590-4763-bb02-afea9d579d44', 'd8e6bd1a-1d93-4e0b-ba0e-903c4e151cf9', '95ab7a68-41ed-44b4-a280-2519a6e94fd0'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:10:03 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-8f2a6e20-f60b-49bf-a91c-98fa552cfd35 tempest-TaggedBootDevicesTest_v242-1336169590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:10:03 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-8f2a6e20-f60b-49bf-a91c-98fa552cfd35 tempest-TaggedBootDevicesTest_v242-1336169590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:10:03 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-8f2a6e20-f60b-49bf-a91c-98fa552cfd35 tempest-TaggedBootDevicesTest_v242-1336169590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:10:03 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-8f2a6e20-f60b-49bf-a91c-98fa552cfd35 tempest-TaggedBootDevicesTest_v242-1336169590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:10:03 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-8f2a6e20-f60b-49bf-a91c-98fa552cfd35 tempest-TaggedBootDevicesTest_v242-1336169590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:10:03 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-8f2a6e20-f60b-49bf-a91c-98fa552cfd35 tempest-TaggedBootDevicesTest_v242-1336169590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:10:03 devstack sudo[91320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:10:03 devstack sudo[91320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:10:03 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-07ca97f7-e9c6-4dc6-ba7e-7fda5c0c7fe9 tempest-TaggedBootDevicesTest_v242-1336169590 None] Acquiring lock "cinder-f103949c-247a-4a29-b7a0-0d60858e68a0-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:10:03 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-07ca97f7-e9c6-4dc6-ba7e-7fda5c0c7fe9 tempest-TaggedBootDevicesTest_v242-1336169590 None] Lock "cinder-f103949c-247a-4a29-b7a0-0d60858e68a0-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:10:03 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-07ca97f7-e9c6-4dc6-ba7e-7fda5c0c7fe9 tempest-TaggedBootDevicesTest_v242-1336169590 None] Acquiring lock "cinder-quobyte-f103949c-247a-4a29-b7a0-0d60858e68a0" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:10:03 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-07ca97f7-e9c6-4dc6-ba7e-7fda5c0c7fe9 tempest-TaggedBootDevicesTest_v242-1336169590 None] Lock "cinder-quobyte-f103949c-247a-4a29-b7a0-0d60858e68a0" acquired by "delete_volume" :: waited 0.022s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:10:04 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a9afe6-5ba4-4002-bb8b-d0412dfbb22f]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:10:04 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-07ca97f7-e9c6-4dc6-ba7e-7fda5c0c7fe9 tempest-TaggedBootDevicesTest_v242-1336169590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f103949c-247a-4a29-b7a0-0d60858e68a0 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:10:04 devstack sudo[91320]: pam_unix(sudo:session): session closed for user root Apr 29 15:10:04 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-8f2a6e20-f60b-49bf-a91c-98fa552cfd35 tempest-TaggedBootDevicesTest_v242-1336169590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.745s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:10:04 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-8f2a6e20-f60b-49bf-a91c-98fa552cfd35 tempest-TaggedBootDevicesTest_v242-1336169590 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:10:04 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-8f2a6e20-f60b-49bf-a91c-98fa552cfd35 tempest-TaggedBootDevicesTest_v242-1336169590 None] Deleted volume successfully. Apr 29 15:10:04 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-8f2a6e20-f60b-49bf-a91c-98fa552cfd35 tempest-TaggedBootDevicesTest_v242-1336169590 None] Lock "cinder-1f91241d-022f-4a09-af85-c3aaa9d0c00f-delete_volume" released by "delete_volume" :: held 2.485s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:10:04 devstack sudo[91323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f103949c-247a-4a29-b7a0-0d60858e68a0 Apr 29 15:10:04 devstack sudo[91323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:10:04 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-6d45b3bd-7afe-4784-aac0-a77a995ce862 req-1bd7c60a-b746-4a21-aa4f-6b231232a49d tempest-ServerActionsTestOtherA-411716500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:10:04 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-6d45b3bd-7afe-4784-aac0-a77a995ce862 req-1bd7c60a-b746-4a21-aa4f-6b231232a49d tempest-ServerActionsTestOtherA-411716500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:10:04 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bab567d-c800-4666-9d5d-89561c1043f0]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:10:04 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-6d45b3bd-7afe-4784-aac0-a77a995ce862 req-1bd7c60a-b746-4a21-aa4f-6b231232a49d tempest-ServerActionsTestOtherA-411716500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ed99b35b-7068-4ab5-8cde-7f4a5efce0cb {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:10:04 devstack sudo[91333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ed99b35b-7068-4ab5-8cde-7f4a5efce0cb Apr 29 15:10:04 devstack sudo[91333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:10:04 devstack sudo[91323]: pam_unix(sudo:session): session closed for user root Apr 29 15:10:04 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-07ca97f7-e9c6-4dc6-ba7e-7fda5c0c7fe9 tempest-TaggedBootDevicesTest_v242-1336169590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f103949c-247a-4a29-b7a0-0d60858e68a0" returned: 0 in 0.744s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:10:04 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-07ca97f7-e9c6-4dc6-ba7e-7fda5c0c7fe9 tempest-TaggedBootDevicesTest_v242-1336169590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f103949c-247a-4a29-b7a0-0d60858e68a0 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:10:04 devstack sudo[91339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f103949c-247a-4a29-b7a0-0d60858e68a0 Apr 29 15:10:04 devstack sudo[91339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:10:05 devstack sudo[91333]: pam_unix(sudo:session): session closed for user root Apr 29 15:10:05 devstack sudo[91339]: pam_unix(sudo:session): session closed for user root Apr 29 15:10:05 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-6d45b3bd-7afe-4784-aac0-a77a995ce862 req-1bd7c60a-b746-4a21-aa4f-6b231232a49d tempest-ServerActionsTestOtherA-411716500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ed99b35b-7068-4ab5-8cde-7f4a5efce0cb" returned: 0 in 0.775s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:10:05 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-07ca97f7-e9c6-4dc6-ba7e-7fda5c0c7fe9 tempest-TaggedBootDevicesTest_v242-1336169590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f103949c-247a-4a29-b7a0-0d60858e68a0" returned: 0 in 0.610s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:10:05 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-6d45b3bd-7afe-4784-aac0-a77a995ce862 req-1bd7c60a-b746-4a21-aa4f-6b231232a49d tempest-ServerActionsTestOtherA-411716500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.791s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:10:05 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-07ca97f7-e9c6-4dc6-ba7e-7fda5c0c7fe9 tempest-TaggedBootDevicesTest_v242-1336169590 None] Lock "cinder-quobyte-f103949c-247a-4a29-b7a0-0d60858e68a0" released by "delete_volume" :: held 1.407s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:10:05 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-6d45b3bd-7afe-4784-aac0-a77a995ce862 req-1bd7c60a-b746-4a21-aa4f-6b231232a49d tempest-ServerActionsTestOtherA-411716500 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a', 'name': 'volume-ed99b35b-7068-4ab5-8cde-7f4a5efce0cb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bcea890b-bdce-4b71-be4f-8cbc26b7f85b', 'enforce_multipath': True} {{(pid=84448) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 15:10:05 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-07ca97f7-e9c6-4dc6-ba7e-7fda5c0c7fe9 tempest-TaggedBootDevicesTest_v242-1336169590 None] Created reservations ['27823500-e503-4865-83eb-f46547030eec', '9ff7da57-2146-4126-b5ab-568c2548884f', 'f591fcbc-0041-4e85-bf32-90587eb16e69', '6953e15a-3fa6-4e4c-a050-c56a49f154a6'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:10:05 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-6d45b3bd-7afe-4784-aac0-a77a995ce862 req-1bd7c60a-b746-4a21-aa4f-6b231232a49d tempest-ServerActionsTestOtherA-411716500 None] attachment_update completed successfully. Apr 29 15:10:05 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-07ca97f7-e9c6-4dc6-ba7e-7fda5c0c7fe9 tempest-TaggedBootDevicesTest_v242-1336169590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:10:05 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-07ca97f7-e9c6-4dc6-ba7e-7fda5c0c7fe9 tempest-TaggedBootDevicesTest_v242-1336169590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:10:05 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-07ca97f7-e9c6-4dc6-ba7e-7fda5c0c7fe9 tempest-TaggedBootDevicesTest_v242-1336169590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:10:05 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-07ca97f7-e9c6-4dc6-ba7e-7fda5c0c7fe9 tempest-TaggedBootDevicesTest_v242-1336169590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:10:05 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-07ca97f7-e9c6-4dc6-ba7e-7fda5c0c7fe9 tempest-TaggedBootDevicesTest_v242-1336169590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:10:05 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-07ca97f7-e9c6-4dc6-ba7e-7fda5c0c7fe9 tempest-TaggedBootDevicesTest_v242-1336169590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:10:05 devstack sudo[91347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:10:05 devstack sudo[91347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:10:06 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-6a1876e6-398b-4d8d-be08-69bbecff8b0d tempest-TaggedBootDevicesTest_v242-1336169590 None] Acquiring lock "cinder-0c3ebf48-e6c9-4ca7-8372-c5bcb99850ab-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:10:06 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-6a1876e6-398b-4d8d-be08-69bbecff8b0d tempest-TaggedBootDevicesTest_v242-1336169590 None] Lock "cinder-0c3ebf48-e6c9-4ca7-8372-c5bcb99850ab-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:10:06 devstack sudo[91347]: pam_unix(sudo:session): session closed for user root Apr 29 15:10:06 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-07ca97f7-e9c6-4dc6-ba7e-7fda5c0c7fe9 tempest-TaggedBootDevicesTest_v242-1336169590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.671s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:10:06 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-07ca97f7-e9c6-4dc6-ba7e-7fda5c0c7fe9 tempest-TaggedBootDevicesTest_v242-1336169590 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:10:06 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-07ca97f7-e9c6-4dc6-ba7e-7fda5c0c7fe9 tempest-TaggedBootDevicesTest_v242-1336169590 None] Deleted volume successfully. Apr 29 15:10:06 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-6a1876e6-398b-4d8d-be08-69bbecff8b0d tempest-TaggedBootDevicesTest_v242-1336169590 None] Acquiring lock "cinder-quobyte-0c3ebf48-e6c9-4ca7-8372-c5bcb99850ab" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:10:06 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-6a1876e6-398b-4d8d-be08-69bbecff8b0d tempest-TaggedBootDevicesTest_v242-1336169590 None] Lock "cinder-quobyte-0c3ebf48-e6c9-4ca7-8372-c5bcb99850ab" acquired by "delete_volume" :: waited 0.021s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:10:06 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-07ca97f7-e9c6-4dc6-ba7e-7fda5c0c7fe9 tempest-TaggedBootDevicesTest_v242-1336169590 None] Lock "cinder-f103949c-247a-4a29-b7a0-0d60858e68a0-delete_volume" released by "delete_volume" :: held 2.366s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:10:06 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab5df307-446f-457d-986a-74e3315b2f84]: (4, 'raw') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:10:06 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6a1876e6-398b-4d8d-be08-69bbecff8b0d tempest-TaggedBootDevicesTest_v242-1336169590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0c3ebf48-e6c9-4ca7-8372-c5bcb99850ab {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:10:06 devstack sudo[91350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0c3ebf48-e6c9-4ca7-8372-c5bcb99850ab Apr 29 15:10:06 devstack sudo[91350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:10:06 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-d98a11dd-909b-4049-af53-9f8523be99d8 req-0117aabb-b2a0-439f-aab4-a5026237cbe4 tempest-AttachVolumeShelveTestJSON-435060681 None] Terminate volume connection completed successfully. Apr 29 15:10:06 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-d98a11dd-909b-4049-af53-9f8523be99d8 req-0117aabb-b2a0-439f-aab4-a5026237cbe4 tempest-AttachVolumeShelveTestJSON-435060681 None] Deleting attachment c06ad96c-d9b7-455b-aef9-99d5863ae811. {{(pid=84448) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 15:10:06 devstack sudo[91350]: pam_unix(sudo:session): session closed for user root Apr 29 15:10:06 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6a1876e6-398b-4d8d-be08-69bbecff8b0d tempest-TaggedBootDevicesTest_v242-1336169590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0c3ebf48-e6c9-4ca7-8372-c5bcb99850ab" returned: 0 in 0.717s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:10:06 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6a1876e6-398b-4d8d-be08-69bbecff8b0d tempest-TaggedBootDevicesTest_v242-1336169590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0c3ebf48-e6c9-4ca7-8372-c5bcb99850ab {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:10:07 devstack sudo[91356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0c3ebf48-e6c9-4ca7-8372-c5bcb99850ab Apr 29 15:10:07 devstack sudo[91356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:10:07 devstack sudo[91356]: pam_unix(sudo:session): session closed for user root Apr 29 15:10:07 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6a1876e6-398b-4d8d-be08-69bbecff8b0d tempest-TaggedBootDevicesTest_v242-1336169590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0c3ebf48-e6c9-4ca7-8372-c5bcb99850ab" returned: 1 in 0.699s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:10:07 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6a1876e6-398b-4d8d-be08-69bbecff8b0d tempest-TaggedBootDevicesTest_v242-1336169590 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0c3ebf48-e6c9-4ca7-8372-c5bcb99850ab' failed. Not Retrying. {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 15:10:07 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6a1876e6-398b-4d8d-be08-69bbecff8b0d tempest-TaggedBootDevicesTest_v242-1336169590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0c3ebf48-e6c9-4ca7-8372-c5bcb99850ab {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:10:07 devstack sudo[91374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0c3ebf48-e6c9-4ca7-8372-c5bcb99850ab Apr 29 15:10:07 devstack sudo[91374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:10:08 devstack sudo[91374]: pam_unix(sudo:session): session closed for user root Apr 29 15:10:08 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6a1876e6-398b-4d8d-be08-69bbecff8b0d tempest-TaggedBootDevicesTest_v242-1336169590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0c3ebf48-e6c9-4ca7-8372-c5bcb99850ab" returned: 0 in 0.625s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:10:08 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-6a1876e6-398b-4d8d-be08-69bbecff8b0d tempest-TaggedBootDevicesTest_v242-1336169590 None] Lock "cinder-quobyte-0c3ebf48-e6c9-4ca7-8372-c5bcb99850ab" released by "delete_volume" :: held 2.109s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:10:08 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-6a1876e6-398b-4d8d-be08-69bbecff8b0d tempest-TaggedBootDevicesTest_v242-1336169590 None] Created reservations ['929e6cdb-dde1-424b-b279-1a83a745a36f', '345f6d0d-988f-4e67-8c46-de9e03ccd2b3', '6f497cef-2d88-4d47-8bac-121d0cc4703a', '1cdaa9de-6bea-4472-81e4-c03dd638882a'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:10:08 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-6a1876e6-398b-4d8d-be08-69bbecff8b0d tempest-TaggedBootDevicesTest_v242-1336169590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:10:08 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-6a1876e6-398b-4d8d-be08-69bbecff8b0d tempest-TaggedBootDevicesTest_v242-1336169590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:10:08 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-6a1876e6-398b-4d8d-be08-69bbecff8b0d tempest-TaggedBootDevicesTest_v242-1336169590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:10:08 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-6a1876e6-398b-4d8d-be08-69bbecff8b0d tempest-TaggedBootDevicesTest_v242-1336169590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:10:08 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-6a1876e6-398b-4d8d-be08-69bbecff8b0d tempest-TaggedBootDevicesTest_v242-1336169590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:10:08 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6a1876e6-398b-4d8d-be08-69bbecff8b0d tempest-TaggedBootDevicesTest_v242-1336169590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:10:08 devstack sudo[91379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:10:08 devstack sudo[91379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:10:09 devstack sudo[91379]: pam_unix(sudo:session): session closed for user root Apr 29 15:10:09 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6a1876e6-398b-4d8d-be08-69bbecff8b0d tempest-TaggedBootDevicesTest_v242-1336169590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.643s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:10:09 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-6a1876e6-398b-4d8d-be08-69bbecff8b0d tempest-TaggedBootDevicesTest_v242-1336169590 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:10:09 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-6a1876e6-398b-4d8d-be08-69bbecff8b0d tempest-TaggedBootDevicesTest_v242-1336169590 None] Deleted volume successfully. Apr 29 15:10:09 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-6a1876e6-398b-4d8d-be08-69bbecff8b0d tempest-TaggedBootDevicesTest_v242-1336169590 None] Lock "cinder-0c3ebf48-e6c9-4ca7-8372-c5bcb99850ab-delete_volume" released by "delete_volume" :: held 2.969s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:10:15 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-07e5ddc5-d525-45ba-ba5e-81192afe913b req-dcaeb2ff-5246-4eeb-b24b-81e4206cef3f tempest-ServerActionsV293TestJSON-1649971535 None] Terminate volume connection completed successfully. Apr 29 15:10:15 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-07e5ddc5-d525-45ba-ba5e-81192afe913b req-dcaeb2ff-5246-4eeb-b24b-81e4206cef3f tempest-ServerActionsV293TestJSON-1649971535 None] Deleting attachment f6f0ce55-540e-4e4d-8715-84ea4e222164. {{(pid=84448) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 15:10:16 devstack cinder-volume[84448]: DEBUG cinder.image.glance [req-07e5ddc5-d525-45ba-ba5e-81192afe913b req-864c4abe-3bef-40fb-b6d7-fed3fdb56603 tempest-ServerActionsV293TestJSON-1649971535 None] Creating Keystone auth plugin from conf {{(pid=84448) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 29 15:10:16 devstack cinder-volume[84448]: DEBUG cinder.volume.volume_utils [req-07e5ddc5-d525-45ba-ba5e-81192afe913b req-864c4abe-3bef-40fb-b6d7-fed3fdb56603 tempest-ServerActionsV293TestJSON-1649971535 None] Attempting download of ad86f424-7d2a-4f3b-9577-890075e7dc72 ((None, [{'url': 'file:///opt/stack/data/glance/images/ad86f424-7d2a-4f3b-9577-890075e7dc72', 'metadata': {}}])) to volume d573566a-71f4-4dcd-b754-90e0377c7b3a. {{(pid=84448) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 29 15:10:16 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf1fb97-d9ab-4980-a1a7-25b267c2451c]: (4, 'raw') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:10:16 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-07e5ddc5-d525-45ba-ba5e-81192afe913b req-864c4abe-3bef-40fb-b6d7-fed3fdb56603 tempest-ServerActionsV293TestJSON-1649971535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ad86f424-7d2a-4f3b-9577-890075e7dc72_mnnxfq7h {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:10:16 devstack sudo[91521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ad86f424-7d2a-4f3b-9577-890075e7dc72_mnnxfq7h Apr 29 15:10:16 devstack sudo[91521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:10:17 devstack sudo[91521]: pam_unix(sudo:session): session closed for user root Apr 29 15:10:17 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-07e5ddc5-d525-45ba-ba5e-81192afe913b req-864c4abe-3bef-40fb-b6d7-fed3fdb56603 tempest-ServerActionsV293TestJSON-1649971535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ad86f424-7d2a-4f3b-9577-890075e7dc72_mnnxfq7h" returned: 0 in 1.086s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:10:17 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-07e5ddc5-d525-45ba-ba5e-81192afe913b req-864c4abe-3bef-40fb-b6d7-fed3fdb56603 tempest-ServerActionsV293TestJSON-1649971535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ad86f424-7d2a-4f3b-9577-890075e7dc72_mnnxfq7h {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:10:18 devstack sudo[91561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ad86f424-7d2a-4f3b-9577-890075e7dc72_mnnxfq7h Apr 29 15:10:18 devstack sudo[91561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:10:18 devstack sudo[91561]: pam_unix(sudo:session): session closed for user root Apr 29 15:10:18 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-07e5ddc5-d525-45ba-ba5e-81192afe913b req-864c4abe-3bef-40fb-b6d7-fed3fdb56603 tempest-ServerActionsV293TestJSON-1649971535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ad86f424-7d2a-4f3b-9577-890075e7dc72_mnnxfq7h" returned: 1 in 1.074s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:10:18 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-07e5ddc5-d525-45ba-ba5e-81192afe913b req-864c4abe-3bef-40fb-b6d7-fed3fdb56603 tempest-ServerActionsV293TestJSON-1649971535 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ad86f424-7d2a-4f3b-9577-890075e7dc72_mnnxfq7h' failed. Not Retrying. {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 15:10:19 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [req-07e5ddc5-d525-45ba-ba5e-81192afe913b req-864c4abe-3bef-40fb-b6d7-fed3fdb56603 tempest-ServerActionsV293TestJSON-1649971535 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_download_ad86f424-7d2a-4f3b-9577-890075e7dc72_mnnxfq7h, size 20.69 MB, duration 1.00 sec {{(pid=84448) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 29 15:10:19 devstack cinder-volume[84448]: INFO cinder.image.image_utils [req-07e5ddc5-d525-45ba-ba5e-81192afe913b req-864c4abe-3bef-40fb-b6d7-fed3fdb56603 tempest-ServerActionsV293TestJSON-1649971535 None] Image download 20.69 MB at 20.69 MB/s Apr 29 15:10:19 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9b4cf5-e2c0-49f7-b87a-1e2473caf302]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:10:19 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-07e5ddc5-d525-45ba-ba5e-81192afe913b req-864c4abe-3bef-40fb-b6d7-fed3fdb56603 tempest-ServerActionsV293TestJSON-1649971535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_download_ad86f424-7d2a-4f3b-9577-890075e7dc72_mnnxfq7h {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:10:19 devstack sudo[91567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_download_ad86f424-7d2a-4f3b-9577-890075e7dc72_mnnxfq7h Apr 29 15:10:19 devstack sudo[91567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:10:20 devstack sudo[91567]: pam_unix(sudo:session): session closed for user root Apr 29 15:10:20 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-07e5ddc5-d525-45ba-ba5e-81192afe913b req-864c4abe-3bef-40fb-b6d7-fed3fdb56603 tempest-ServerActionsV293TestJSON-1649971535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_download_ad86f424-7d2a-4f3b-9577-890075e7dc72_mnnxfq7h" returned: 0 in 1.268s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:10:20 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [req-07e5ddc5-d525-45ba-ba5e-81192afe913b req-864c4abe-3bef-40fb-b6d7-fed3fdb56603 tempest-ServerActionsV293TestJSON-1649971535 None] ad86f424-7d2a-4f3b-9577-890075e7dc72 was qcow2, converting to raw {{(pid=84448) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 29 15:10:20 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-07e5ddc5-d525-45ba-ba5e-81192afe913b req-864c4abe-3bef-40fb-b6d7-fed3fdb56603 tempest-ServerActionsV293TestJSON-1649971535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -S 0 -f qcow2 /opt/stack/data/cinder/conversion/image_download_ad86f424-7d2a-4f3b-9577-890075e7dc72_mnnxfq7h /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d573566a-71f4-4dcd-b754-90e0377c7b3a {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:10:20 devstack sudo[91573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -S 0 -f qcow2 /opt/stack/data/cinder/conversion/image_download_ad86f424-7d2a-4f3b-9577-890075e7dc72_mnnxfq7h /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d573566a-71f4-4dcd-b754-90e0377c7b3a Apr 29 15:10:20 devstack sudo[91573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:10:25 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:SELECT=34,cinder:UPDATE=33,cinder:INSERT=5,cinder:DELETE=1 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:10:25 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:SELECT=30,cinder:UPDATE=21,cinder:INSERT=7,cinder:DELETE=2 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:10:26 devstack sudo[91573]: pam_unix(sudo:session): session closed for user root Apr 29 15:10:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-07e5ddc5-d525-45ba-ba5e-81192afe913b req-864c4abe-3bef-40fb-b6d7-fed3fdb56603 tempest-ServerActionsV293TestJSON-1649971535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -S 0 -f qcow2 /opt/stack/data/cinder/conversion/image_download_ad86f424-7d2a-4f3b-9577-890075e7dc72_mnnxfq7h /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d573566a-71f4-4dcd-b754-90e0377c7b3a" returned: 0 in 5.333s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:10:26 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [req-07e5ddc5-d525-45ba-ba5e-81192afe913b req-864c4abe-3bef-40fb-b6d7-fed3fdb56603 tempest-ServerActionsV293TestJSON-1649971535 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_download_ad86f424-7d2a-4f3b-9577-890075e7dc72_mnnxfq7h, size 112.00 MB, duration 5.34 sec, destination /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d573566a-71f4-4dcd-b754-90e0377c7b3a {{(pid=84448) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 15:10:26 devstack cinder-volume[84448]: INFO cinder.image.image_utils [req-07e5ddc5-d525-45ba-ba5e-81192afe913b req-864c4abe-3bef-40fb-b6d7-fed3fdb56603 tempest-ServerActionsV293TestJSON-1649971535 None] Converted 112.00 MB image at 20.99 MB/s Apr 29 15:10:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-07e5ddc5-d525-45ba-ba5e-81192afe913b req-864c4abe-3bef-40fb-b6d7-fed3fdb56603 tempest-ServerActionsV293TestJSON-1649971535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d573566a-71f4-4dcd-b754-90e0377c7b3a 1G {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:10:26 devstack sudo[91628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d573566a-71f4-4dcd-b754-90e0377c7b3a 1G Apr 29 15:10:26 devstack sudo[91628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:10:26 devstack sudo[91628]: pam_unix(sudo:session): session closed for user root Apr 29 15:10:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-07e5ddc5-d525-45ba-ba5e-81192afe913b req-864c4abe-3bef-40fb-b6d7-fed3fdb56603 tempest-ServerActionsV293TestJSON-1649971535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d573566a-71f4-4dcd-b754-90e0377c7b3a 1G" returned: 0 in 0.767s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:10:26 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[834217d7-805b-4027-bdf8-d2a31126ef4e]: (4, 'raw') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:10:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-07e5ddc5-d525-45ba-ba5e-81192afe913b req-864c4abe-3bef-40fb-b6d7-fed3fdb56603 tempest-ServerActionsV293TestJSON-1649971535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d573566a-71f4-4dcd-b754-90e0377c7b3a {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:10:27 devstack sudo[91633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d573566a-71f4-4dcd-b754-90e0377c7b3a Apr 29 15:10:27 devstack sudo[91633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:10:27 devstack sudo[91633]: pam_unix(sudo:session): session closed for user root Apr 29 15:10:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-07e5ddc5-d525-45ba-ba5e-81192afe913b req-864c4abe-3bef-40fb-b6d7-fed3fdb56603 tempest-ServerActionsV293TestJSON-1649971535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d573566a-71f4-4dcd-b754-90e0377c7b3a" returned: 0 in 0.758s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:10:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-07e5ddc5-d525-45ba-ba5e-81192afe913b req-864c4abe-3bef-40fb-b6d7-fed3fdb56603 tempest-ServerActionsV293TestJSON-1649971535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d573566a-71f4-4dcd-b754-90e0377c7b3a {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:10:27 devstack sudo[91637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d573566a-71f4-4dcd-b754-90e0377c7b3a Apr 29 15:10:27 devstack sudo[91637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:10:28 devstack sudo[91637]: pam_unix(sudo:session): session closed for user root Apr 29 15:10:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-07e5ddc5-d525-45ba-ba5e-81192afe913b req-864c4abe-3bef-40fb-b6d7-fed3fdb56603 tempest-ServerActionsV293TestJSON-1649971535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d573566a-71f4-4dcd-b754-90e0377c7b3a" returned: 1 in 0.753s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:10:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-07e5ddc5-d525-45ba-ba5e-81192afe913b req-864c4abe-3bef-40fb-b6d7-fed3fdb56603 tempest-ServerActionsV293TestJSON-1649971535 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d573566a-71f4-4dcd-b754-90e0377c7b3a' failed. Not Retrying. {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 15:10:28 devstack cinder-volume[84448]: DEBUG cinder.volume.volume_utils [req-07e5ddc5-d525-45ba-ba5e-81192afe913b req-864c4abe-3bef-40fb-b6d7-fed3fdb56603 tempest-ServerActionsV293TestJSON-1649971535 None] Downloaded image ad86f424-7d2a-4f3b-9577-890075e7dc72 ((None, [{'url': 'file:///opt/stack/data/glance/images/ad86f424-7d2a-4f3b-9577-890075e7dc72', 'metadata': {}}])) to volume d573566a-71f4-4dcd-b754-90e0377c7b3a successfully. {{(pid=84448) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 29 15:10:28 devstack cinder-volume[84448]: DEBUG cinder.volume.volume_utils [req-07e5ddc5-d525-45ba-ba5e-81192afe913b req-864c4abe-3bef-40fb-b6d7-fed3fdb56603 tempest-ServerActionsV293TestJSON-1649971535 None] Marking volume d573566a-71f4-4dcd-b754-90e0377c7b3a as bootable. {{(pid=84448) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 29 15:10:28 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-07e5ddc5-d525-45ba-ba5e-81192afe913b req-864c4abe-3bef-40fb-b6d7-fed3fdb56603 tempest-ServerActionsV293TestJSON-1649971535 None] Creating volume glance metadata for volume d573566a-71f4-4dcd-b754-90e0377c7b3a backed by image ad86f424-7d2a-4f3b-9577-890075e7dc72 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'ad86f424-7d2a-4f3b-9577-890075e7dc72', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84448) _refresh_volume_glance_meta /opt/stack/cinder/cinder/volume/manager.py:5408}} Apr 29 15:10:28 devstack cinder-volume[84448]: DEBUG cinder.compute.nova [req-07e5ddc5-d525-45ba-ba5e-81192afe913b req-864c4abe-3bef-40fb-b6d7-fed3fdb56603 tempest-ServerActionsV293TestJSON-1649971535 None] Creating Keystone auth plugin from conf {{(pid=84448) novaclient /opt/stack/cinder/cinder/compute/nova.py:99}} Apr 29 15:10:28 devstack cinder-volume[84448]: DEBUG novaclient.v2.client [req-07e5ddc5-d525-45ba-ba5e-81192afe913b req-864c4abe-3bef-40fb-b6d7-fed3fdb56603 tempest-ServerActionsV293TestJSON-1649971535 None] REQ: curl -g -i -X POST http://192.168.122.236/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "OpenStack-API-Version: compute 2.93" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}2939b89701d6dca272ddbdbb3251fd72af947d6205cf61dff4c7c9480dffe3fc" -H "X-OpenStack-Nova-API-Version: 2.93" -H "X-OpenStack-Request-ID: req-07e5ddc5-d525-45ba-ba5e-81192afe913b" -H "X-Service-Token: {SHA256}f91612d714cf76f6bfbda4d85948ddfd10d564df91cfcbf6101c6465795b9551" -d '{"events": [{"name": "volume-reimaged", "server_uuid": "bbabe80f-0004-4cd0-bb18-ba587a4e6d7e", "tag": "d573566a-71f4-4dcd-b754-90e0377c7b3a"}]}' {{(pid=84448) _http_log_request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:575}} Apr 29 15:10:28 devstack cinder-volume[84448]: DEBUG novaclient.v2.client [req-07e5ddc5-d525-45ba-ba5e-81192afe913b req-864c4abe-3bef-40fb-b6d7-fed3fdb56603 tempest-ServerActionsV293TestJSON-1649971535 None] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 29 Apr 2026 13:10:28 GMT OpenStack-API-Version: compute 2.93 Server: Apache/2.4.58 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.93 x-compute-request-id: req-d59e00c7-f9e6-4bec-91db-92b34cf9e0af x-openstack-request-id: req-d59e00c7-f9e6-4bec-91db-92b34cf9e0af {{(pid=84448) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:616}} Apr 29 15:10:28 devstack cinder-volume[84448]: DEBUG novaclient.v2.client [req-07e5ddc5-d525-45ba-ba5e-81192afe913b req-864c4abe-3bef-40fb-b6d7-fed3fdb56603 tempest-ServerActionsV293TestJSON-1649971535 None] RESP BODY: {"events": [{"name": "volume-reimaged", "server_uuid": "bbabe80f-0004-4cd0-bb18-ba587a4e6d7e", "tag": "d573566a-71f4-4dcd-b754-90e0377c7b3a", "status": "completed", "code": 200}]} {{(pid=84448) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:651}} Apr 29 15:10:28 devstack cinder-volume[84448]: DEBUG novaclient.v2.client [req-07e5ddc5-d525-45ba-ba5e-81192afe913b req-864c4abe-3bef-40fb-b6d7-fed3fdb56603 tempest-ServerActionsV293TestJSON-1649971535 None] POST call to compute for http://192.168.122.236/compute/v2.1/os-server-external-events used request id req-d59e00c7-f9e6-4bec-91db-92b34cf9e0af {{(pid=84448) request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:1076}} Apr 29 15:10:28 devstack cinder-volume[84448]: INFO cinder.compute.nova [req-07e5ddc5-d525-45ba-ba5e-81192afe913b req-864c4abe-3bef-40fb-b6d7-fed3fdb56603 tempest-ServerActionsV293TestJSON-1649971535 None] Nova event response: {'name': 'volume-reimaged', 'server_uuid': 'bbabe80f-0004-4cd0-bb18-ba587a4e6d7e', 'tag': 'd573566a-71f4-4dcd-b754-90e0377c7b3a', 'status': 'completed', 'code': 200}. Apr 29 15:10:28 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-07e5ddc5-d525-45ba-ba5e-81192afe913b req-864c4abe-3bef-40fb-b6d7-fed3fdb56603 tempest-ServerActionsV293TestJSON-1649971535 None] Re-imaged ad86f424-7d2a-4f3b-9577-890075e7dc72 to volume d573566a-71f4-4dcd-b754-90e0377c7b3a successfully. {{(pid=84448) reimage /opt/stack/cinder/cinder/volume/manager.py:5451}} Apr 29 15:10:29 devstack cinder-volume[84448]: DEBUG oslo_db.sqlalchemy.engines [req-07e5ddc5-d525-45ba-ba5e-81192afe913b req-4a847add-aaa5-4fb6-92a2-0f74f600e6ee tempest-ServerActionsV293TestJSON-1649971535 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84448) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 15:10:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-07e5ddc5-d525-45ba-ba5e-81192afe913b req-4a847add-aaa5-4fb6-92a2-0f74f600e6ee tempest-ServerActionsV293TestJSON-1649971535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:10:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-07e5ddc5-d525-45ba-ba5e-81192afe913b req-4a847add-aaa5-4fb6-92a2-0f74f600e6ee tempest-ServerActionsV293TestJSON-1649971535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:10:29 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2198220-76d4-49de-8671-37a54a98debc]: (4, 'raw') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:10:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-07e5ddc5-d525-45ba-ba5e-81192afe913b req-4a847add-aaa5-4fb6-92a2-0f74f600e6ee tempest-ServerActionsV293TestJSON-1649971535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d573566a-71f4-4dcd-b754-90e0377c7b3a {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:10:29 devstack sudo[91656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d573566a-71f4-4dcd-b754-90e0377c7b3a Apr 29 15:10:29 devstack sudo[91656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:10:30 devstack cinder-volume[84448]: DEBUG oslo_service.periodic_task [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84448) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 15:10:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:10:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:10:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:10:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:10:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:10:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:10:30 devstack sudo[91658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:10:30 devstack sudo[91658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:10:30 devstack sudo[91656]: pam_unix(sudo:session): session closed for user root Apr 29 15:10:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-07e5ddc5-d525-45ba-ba5e-81192afe913b req-4a847add-aaa5-4fb6-92a2-0f74f600e6ee tempest-ServerActionsV293TestJSON-1649971535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d573566a-71f4-4dcd-b754-90e0377c7b3a" returned: 0 in 0.749s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:10:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-07e5ddc5-d525-45ba-ba5e-81192afe913b req-4a847add-aaa5-4fb6-92a2-0f74f600e6ee tempest-ServerActionsV293TestJSON-1649971535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d573566a-71f4-4dcd-b754-90e0377c7b3a {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:10:30 devstack sudo[91662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d573566a-71f4-4dcd-b754-90e0377c7b3a Apr 29 15:10:30 devstack sudo[91662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:10:30 devstack sudo[91658]: pam_unix(sudo:session): session closed for user root Apr 29 15:10:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.626s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:10:30 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:10:31 devstack sudo[91662]: pam_unix(sudo:session): session closed for user root Apr 29 15:10:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-07e5ddc5-d525-45ba-ba5e-81192afe913b req-4a847add-aaa5-4fb6-92a2-0f74f600e6ee tempest-ServerActionsV293TestJSON-1649971535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d573566a-71f4-4dcd-b754-90e0377c7b3a" returned: 1 in 0.887s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:10:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-07e5ddc5-d525-45ba-ba5e-81192afe913b req-4a847add-aaa5-4fb6-92a2-0f74f600e6ee tempest-ServerActionsV293TestJSON-1649971535 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d573566a-71f4-4dcd-b754-90e0377c7b3a' failed. Not Retrying. {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 15:10:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-07e5ddc5-d525-45ba-ba5e-81192afe913b req-4a847add-aaa5-4fb6-92a2-0f74f600e6ee tempest-ServerActionsV293TestJSON-1649971535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.685s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:10:31 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-07e5ddc5-d525-45ba-ba5e-81192afe913b req-4a847add-aaa5-4fb6-92a2-0f74f600e6ee tempest-ServerActionsV293TestJSON-1649971535 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a', 'name': 'volume-d573566a-71f4-4dcd-b754-90e0377c7b3a', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ecbfea11-87a2-4bee-8b02-6f85a66c7955', 'enforce_multipath': True} {{(pid=84448) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 15:10:31 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-07e5ddc5-d525-45ba-ba5e-81192afe913b req-4a847add-aaa5-4fb6-92a2-0f74f600e6ee tempest-ServerActionsV293TestJSON-1649971535 None] attachment_update completed successfully. Apr 29 15:10:40 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-7fd77b91-d10d-4806-8d83-a4f58ae5b9ba req-e2f797b9-dd8f-4caa-b42f-412bdcdfac23 tempest-ServerActionsTestOtherA-411716500 None] Terminate volume connection completed successfully. Apr 29 15:10:40 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-7fd77b91-d10d-4806-8d83-a4f58ae5b9ba req-e2f797b9-dd8f-4caa-b42f-412bdcdfac23 tempest-ServerActionsTestOtherA-411716500 None] Deleting attachment bcea890b-bdce-4b71-be4f-8cbc26b7f85b. {{(pid=84448) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 15:10:41 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-70afaacd-420e-4f83-8f50-c61e7af7874f tempest-ServerStableDeviceRescueTest-87139885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:10:41 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-70afaacd-420e-4f83-8f50-c61e7af7874f tempest-ServerStableDeviceRescueTest-87139885 None] Flow 'volume_create_manager' (92c6c565-9ad8-4def-b17a-d30b9d716450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:10:41 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-70afaacd-420e-4f83-8f50-c61e7af7874f tempest-ServerStableDeviceRescueTest-87139885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (266f5739-2383-4008-848f-7db76ebb0b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:10:41 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-70afaacd-420e-4f83-8f50-c61e7af7874f tempest-ServerStableDeviceRescueTest-87139885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (266f5739-2383-4008-848f-7db76ebb0b0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:10:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerStableDeviceRescueTest-volume-1453296857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd41dddb-f750-45ae-b1a9-8e0c2045838b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dec581d319f24a3bb9f53c719633640b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:10:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:10:41Z,use_quota=True,user_id='9bcaee03393f439a999b857761c24a34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:10:41 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-70afaacd-420e-4f83-8f50-c61e7af7874f tempest-ServerStableDeviceRescueTest-87139885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16737f6f-bb16-4f1e-ad7b-5b5a00598caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:10:41 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-70afaacd-420e-4f83-8f50-c61e7af7874f tempest-ServerStableDeviceRescueTest-87139885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16737f6f-bb16-4f1e-ad7b-5b5a00598caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:10:41 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-70afaacd-420e-4f83-8f50-c61e7af7874f tempest-ServerStableDeviceRescueTest-87139885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c4e24f9-aacb-4837-8c15-c13f6d4dd12c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:10:41 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-70afaacd-420e-4f83-8f50-c61e7af7874f tempest-ServerStableDeviceRescueTest-87139885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c4e24f9-aacb-4837-8c15-c13f6d4dd12c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd41dddb-f750-45ae-b1a9-8e0c2045838b', 'volume_name': 'volume-cd41dddb-f750-45ae-b1a9-8e0c2045838b', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:10:41 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-70afaacd-420e-4f83-8f50-c61e7af7874f tempest-ServerStableDeviceRescueTest-87139885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b131f597-1ecd-4f1d-a1ca-3d7daaae0436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:10:41 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-70afaacd-420e-4f83-8f50-c61e7af7874f tempest-ServerStableDeviceRescueTest-87139885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b131f597-1ecd-4f1d-a1ca-3d7daaae0436) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:10:41 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-70afaacd-420e-4f83-8f50-c61e7af7874f tempest-ServerStableDeviceRescueTest-87139885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (185ac68f-e7cd-49c8-ac6c-6626b1d3b59b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:10:41 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-70afaacd-420e-4f83-8f50-c61e7af7874f tempest-ServerStableDeviceRescueTest-87139885 None] Volume cd41dddb-f750-45ae-b1a9-8e0c2045838b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd41dddb-f750-45ae-b1a9-8e0c2045838b', 'volume_size': 1} Apr 29 15:10:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-70afaacd-420e-4f83-8f50-c61e7af7874f tempest-ServerStableDeviceRescueTest-87139885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:10:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-70afaacd-420e-4f83-8f50-c61e7af7874f tempest-ServerStableDeviceRescueTest-87139885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:10:41 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-70afaacd-420e-4f83-8f50-c61e7af7874f tempest-ServerStableDeviceRescueTest-87139885 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:10:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerStableDeviceRescueTest-volume-1453296857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd41dddb-f750-45ae-b1a9-8e0c2045838b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dec581d319f24a3bb9f53c719633640b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:10:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:10:41Z,use_quota=True,user_id='9bcaee03393f439a999b857761c24a34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:10:41 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-70afaacd-420e-4f83-8f50-c61e7af7874f tempest-ServerStableDeviceRescueTest-87139885 None] Creating volume cd41dddb-f750-45ae-b1a9-8e0c2045838b {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:10:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-70afaacd-420e-4f83-8f50-c61e7af7874f tempest-ServerStableDeviceRescueTest-87139885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:10:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-70afaacd-420e-4f83-8f50-c61e7af7874f tempest-ServerStableDeviceRescueTest-87139885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:10:41 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-70afaacd-420e-4f83-8f50-c61e7af7874f tempest-ServerStableDeviceRescueTest-87139885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:10:41 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-70afaacd-420e-4f83-8f50-c61e7af7874f tempest-ServerStableDeviceRescueTest-87139885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:10:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-70afaacd-420e-4f83-8f50-c61e7af7874f tempest-ServerStableDeviceRescueTest-87139885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:10:41 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-70afaacd-420e-4f83-8f50-c61e7af7874f tempest-ServerStableDeviceRescueTest-87139885 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:10:41 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-70afaacd-420e-4f83-8f50-c61e7af7874f tempest-ServerStableDeviceRescueTest-87139885 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:10:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-70afaacd-420e-4f83-8f50-c61e7af7874f tempest-ServerStableDeviceRescueTest-87139885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cd41dddb-f750-45ae-b1a9-8e0c2045838b 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:10:41 devstack sudo[91812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cd41dddb-f750-45ae-b1a9-8e0c2045838b 1073741824 Apr 29 15:10:41 devstack sudo[91812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:10:43 devstack sudo[91812]: pam_unix(sudo:session): session closed for user root Apr 29 15:10:43 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-70afaacd-420e-4f83-8f50-c61e7af7874f tempest-ServerStableDeviceRescueTest-87139885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cd41dddb-f750-45ae-b1a9-8e0c2045838b 1073741824" returned: 0 in 1.876s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:10:43 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-70afaacd-420e-4f83-8f50-c61e7af7874f tempest-ServerStableDeviceRescueTest-87139885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cd41dddb-f750-45ae-b1a9-8e0c2045838b {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:10:43 devstack sudo[91821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cd41dddb-f750-45ae-b1a9-8e0c2045838b Apr 29 15:10:43 devstack sudo[91821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:10:45 devstack sudo[91821]: pam_unix(sudo:session): session closed for user root Apr 29 15:10:45 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-70afaacd-420e-4f83-8f50-c61e7af7874f tempest-ServerStableDeviceRescueTest-87139885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cd41dddb-f750-45ae-b1a9-8e0c2045838b" returned: 0 in 1.653s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:10:45 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-70afaacd-420e-4f83-8f50-c61e7af7874f tempest-ServerStableDeviceRescueTest-87139885 None] <== create_volume: return (3675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:10:45 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-70afaacd-420e-4f83-8f50-c61e7af7874f tempest-ServerStableDeviceRescueTest-87139885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.685s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:10:45 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-70afaacd-420e-4f83-8f50-c61e7af7874f tempest-ServerStableDeviceRescueTest-87139885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (185ac68f-e7cd-49c8-ac6c-6626b1d3b59b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd41dddb-f750-45ae-b1a9-8e0c2045838b', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:10:45 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-70afaacd-420e-4f83-8f50-c61e7af7874f tempest-ServerStableDeviceRescueTest-87139885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98d2a7d9-8fea-4970-92db-cdbe69ecdc09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:10:45 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-70afaacd-420e-4f83-8f50-c61e7af7874f tempest-ServerStableDeviceRescueTest-87139885 None] Volume volume-cd41dddb-f750-45ae-b1a9-8e0c2045838b (cd41dddb-f750-45ae-b1a9-8e0c2045838b): created successfully Apr 29 15:10:45 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-70afaacd-420e-4f83-8f50-c61e7af7874f tempest-ServerStableDeviceRescueTest-87139885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98d2a7d9-8fea-4970-92db-cdbe69ecdc09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:10:45 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-70afaacd-420e-4f83-8f50-c61e7af7874f tempest-ServerStableDeviceRescueTest-87139885 None] Flow 'volume_create_manager' (92c6c565-9ad8-4def-b17a-d30b9d716450) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:10:45 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-70afaacd-420e-4f83-8f50-c61e7af7874f tempest-ServerStableDeviceRescueTest-87139885 None] Created volume successfully. Apr 29 15:10:52 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-69bc32b8-787e-4ca1-aab0-418d19e9884f tempest-ServerActionsTestOtherA-411716500 None] Acquiring lock "cinder-ed99b35b-7068-4ab5-8cde-7f4a5efce0cb-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:10:52 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-69bc32b8-787e-4ca1-aab0-418d19e9884f tempest-ServerActionsTestOtherA-411716500 None] Lock "cinder-ed99b35b-7068-4ab5-8cde-7f4a5efce0cb-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:10:52 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-69bc32b8-787e-4ca1-aab0-418d19e9884f tempest-ServerActionsTestOtherA-411716500 None] Acquiring lock "cinder-quobyte-ed99b35b-7068-4ab5-8cde-7f4a5efce0cb" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:10:52 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-69bc32b8-787e-4ca1-aab0-418d19e9884f tempest-ServerActionsTestOtherA-411716500 None] Lock "cinder-quobyte-ed99b35b-7068-4ab5-8cde-7f4a5efce0cb" acquired by "delete_volume" :: waited 0.026s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:10:52 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d02062-f278-4600-92f2-3c563deb7a54]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:10:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-69bc32b8-787e-4ca1-aab0-418d19e9884f tempest-ServerActionsTestOtherA-411716500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ed99b35b-7068-4ab5-8cde-7f4a5efce0cb {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:10:52 devstack sudo[91865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ed99b35b-7068-4ab5-8cde-7f4a5efce0cb Apr 29 15:10:52 devstack sudo[91865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:10:53 devstack sudo[91865]: pam_unix(sudo:session): session closed for user root Apr 29 15:10:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-69bc32b8-787e-4ca1-aab0-418d19e9884f tempest-ServerActionsTestOtherA-411716500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ed99b35b-7068-4ab5-8cde-7f4a5efce0cb" returned: 0 in 0.752s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:10:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-69bc32b8-787e-4ca1-aab0-418d19e9884f tempest-ServerActionsTestOtherA-411716500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ed99b35b-7068-4ab5-8cde-7f4a5efce0cb {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:10:53 devstack sudo[91870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ed99b35b-7068-4ab5-8cde-7f4a5efce0cb Apr 29 15:10:53 devstack sudo[91870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:10:54 devstack sudo[91870]: pam_unix(sudo:session): session closed for user root Apr 29 15:10:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-69bc32b8-787e-4ca1-aab0-418d19e9884f tempest-ServerActionsTestOtherA-411716500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ed99b35b-7068-4ab5-8cde-7f4a5efce0cb" returned: 0 in 0.808s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:10:54 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-69bc32b8-787e-4ca1-aab0-418d19e9884f tempest-ServerActionsTestOtherA-411716500 None] Lock "cinder-quobyte-ed99b35b-7068-4ab5-8cde-7f4a5efce0cb" released by "delete_volume" :: held 1.618s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:10:54 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-69bc32b8-787e-4ca1-aab0-418d19e9884f tempest-ServerActionsTestOtherA-411716500 None] Created reservations ['ea035732-c3c9-47fb-9e6f-e6ddec9d6d88', '49a34371-2634-4b54-b833-a24c003f9432', 'ec6dfc06-62e8-43f9-bf08-e9ebbf180739', 'bca101d9-2d29-492d-925a-e1105e78cf33'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:10:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-69bc32b8-787e-4ca1-aab0-418d19e9884f tempest-ServerActionsTestOtherA-411716500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:10:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-69bc32b8-787e-4ca1-aab0-418d19e9884f tempest-ServerActionsTestOtherA-411716500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:10:54 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-69bc32b8-787e-4ca1-aab0-418d19e9884f tempest-ServerActionsTestOtherA-411716500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:10:54 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-69bc32b8-787e-4ca1-aab0-418d19e9884f tempest-ServerActionsTestOtherA-411716500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:10:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-69bc32b8-787e-4ca1-aab0-418d19e9884f tempest-ServerActionsTestOtherA-411716500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:10:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-69bc32b8-787e-4ca1-aab0-418d19e9884f tempest-ServerActionsTestOtherA-411716500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:10:54 devstack sudo[91873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:10:54 devstack sudo[91873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:10:55 devstack sudo[91873]: pam_unix(sudo:session): session closed for user root Apr 29 15:10:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-69bc32b8-787e-4ca1-aab0-418d19e9884f tempest-ServerActionsTestOtherA-411716500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.988s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:10:55 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-69bc32b8-787e-4ca1-aab0-418d19e9884f tempest-ServerActionsTestOtherA-411716500 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:10:55 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-69bc32b8-787e-4ca1-aab0-418d19e9884f tempest-ServerActionsTestOtherA-411716500 None] Deleted volume successfully. Apr 29 15:10:55 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-69bc32b8-787e-4ca1-aab0-418d19e9884f tempest-ServerActionsTestOtherA-411716500 None] Lock "cinder-ed99b35b-7068-4ab5-8cde-7f4a5efce0cb-delete_volume" released by "delete_volume" :: held 2.967s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:11:04 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:SELECT=25,cinder:INSERT=8,cinder:UPDATE=16 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:11:05 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:UPDATE=12,cinder:SELECT=15,cinder:INSERT=9,cinder:DELETE=2 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:11:07 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a036140-0f5f-4061-9a69-99f90dcbadf8 tempest-AttachVolumeShelveTestJSON-435060681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:11:07 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6a036140-0f5f-4061-9a69-99f90dcbadf8 tempest-AttachVolumeShelveTestJSON-435060681 None] Flow 'volume_create_manager' (eeb1f205-839f-41f4-95af-ff6de33dae0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:11:07 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6a036140-0f5f-4061-9a69-99f90dcbadf8 tempest-AttachVolumeShelveTestJSON-435060681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8c64c54-d9b8-4b9a-93ae-8cea9c35cc19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:11:07 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6a036140-0f5f-4061-9a69-99f90dcbadf8 tempest-AttachVolumeShelveTestJSON-435060681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8c64c54-d9b8-4b9a-93ae-8cea9c35cc19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:11:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1810840029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=765d5942-8b61-4eaa-a1b8-7b7b7ae7df67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98c13fc024f349db8ef55acfa3176fec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:11:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:11:08Z,use_quota=True,user_id='13bfd745ee9647e9b1c7d032f3b49857',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:11:07 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6a036140-0f5f-4061-9a69-99f90dcbadf8 tempest-AttachVolumeShelveTestJSON-435060681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f218549-5b36-46e0-a777-265d89dc4b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:11:07 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6a036140-0f5f-4061-9a69-99f90dcbadf8 tempest-AttachVolumeShelveTestJSON-435060681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f218549-5b36-46e0-a777-265d89dc4b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:11:07 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6a036140-0f5f-4061-9a69-99f90dcbadf8 tempest-AttachVolumeShelveTestJSON-435060681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83aa124b-e029-4af5-ad3c-f6abfb3f139e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:11:08 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6a036140-0f5f-4061-9a69-99f90dcbadf8 tempest-AttachVolumeShelveTestJSON-435060681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83aa124b-e029-4af5-ad3c-f6abfb3f139e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '765d5942-8b61-4eaa-a1b8-7b7b7ae7df67', 'volume_name': 'volume-765d5942-8b61-4eaa-a1b8-7b7b7ae7df67', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:11:08 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6a036140-0f5f-4061-9a69-99f90dcbadf8 tempest-AttachVolumeShelveTestJSON-435060681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f247a8b4-9469-4786-91a9-629c53217f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:11:08 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6a036140-0f5f-4061-9a69-99f90dcbadf8 tempest-AttachVolumeShelveTestJSON-435060681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f247a8b4-9469-4786-91a9-629c53217f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:11:08 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6a036140-0f5f-4061-9a69-99f90dcbadf8 tempest-AttachVolumeShelveTestJSON-435060681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (647636fd-a723-4702-a091-0c9a278bafed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:11:08 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-6a036140-0f5f-4061-9a69-99f90dcbadf8 tempest-AttachVolumeShelveTestJSON-435060681 None] Volume 765d5942-8b61-4eaa-a1b8-7b7b7ae7df67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-765d5942-8b61-4eaa-a1b8-7b7b7ae7df67', 'volume_size': 1} Apr 29 15:11:08 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-6a036140-0f5f-4061-9a69-99f90dcbadf8 tempest-AttachVolumeShelveTestJSON-435060681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:11:08 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-6a036140-0f5f-4061-9a69-99f90dcbadf8 tempest-AttachVolumeShelveTestJSON-435060681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:11:08 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-6a036140-0f5f-4061-9a69-99f90dcbadf8 tempest-AttachVolumeShelveTestJSON-435060681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:11:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1810840029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=765d5942-8b61-4eaa-a1b8-7b7b7ae7df67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98c13fc024f349db8ef55acfa3176fec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:11:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:11:08Z,use_quota=True,user_id='13bfd745ee9647e9b1c7d032f3b49857',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:11:08 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-6a036140-0f5f-4061-9a69-99f90dcbadf8 tempest-AttachVolumeShelveTestJSON-435060681 None] Creating volume 765d5942-8b61-4eaa-a1b8-7b7b7ae7df67 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:11:08 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-6a036140-0f5f-4061-9a69-99f90dcbadf8 tempest-AttachVolumeShelveTestJSON-435060681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:11:08 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-6a036140-0f5f-4061-9a69-99f90dcbadf8 tempest-AttachVolumeShelveTestJSON-435060681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:11:08 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-6a036140-0f5f-4061-9a69-99f90dcbadf8 tempest-AttachVolumeShelveTestJSON-435060681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:11:08 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-6a036140-0f5f-4061-9a69-99f90dcbadf8 tempest-AttachVolumeShelveTestJSON-435060681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:11:08 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-6a036140-0f5f-4061-9a69-99f90dcbadf8 tempest-AttachVolumeShelveTestJSON-435060681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:11:08 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-6a036140-0f5f-4061-9a69-99f90dcbadf8 tempest-AttachVolumeShelveTestJSON-435060681 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:11:08 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-6a036140-0f5f-4061-9a69-99f90dcbadf8 tempest-AttachVolumeShelveTestJSON-435060681 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:11:08 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6a036140-0f5f-4061-9a69-99f90dcbadf8 tempest-AttachVolumeShelveTestJSON-435060681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-765d5942-8b61-4eaa-a1b8-7b7b7ae7df67 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:11:08 devstack sudo[92043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-765d5942-8b61-4eaa-a1b8-7b7b7ae7df67 1073741824 Apr 29 15:11:08 devstack sudo[92043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:11:09 devstack sudo[92043]: pam_unix(sudo:session): session closed for user root Apr 29 15:11:09 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6a036140-0f5f-4061-9a69-99f90dcbadf8 tempest-AttachVolumeShelveTestJSON-435060681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-765d5942-8b61-4eaa-a1b8-7b7b7ae7df67 1073741824" returned: 0 in 1.079s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:11:09 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6a036140-0f5f-4061-9a69-99f90dcbadf8 tempest-AttachVolumeShelveTestJSON-435060681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-765d5942-8b61-4eaa-a1b8-7b7b7ae7df67 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:11:09 devstack sudo[92049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-765d5942-8b61-4eaa-a1b8-7b7b7ae7df67 Apr 29 15:11:09 devstack sudo[92049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:11:09 devstack sudo[92049]: pam_unix(sudo:session): session closed for user root Apr 29 15:11:09 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6a036140-0f5f-4061-9a69-99f90dcbadf8 tempest-AttachVolumeShelveTestJSON-435060681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-765d5942-8b61-4eaa-a1b8-7b7b7ae7df67" returned: 0 in 0.795s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:11:09 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-6a036140-0f5f-4061-9a69-99f90dcbadf8 tempest-AttachVolumeShelveTestJSON-435060681 None] <== create_volume: return (1931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:11:09 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-6a036140-0f5f-4061-9a69-99f90dcbadf8 tempest-AttachVolumeShelveTestJSON-435060681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.934s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:11:09 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6a036140-0f5f-4061-9a69-99f90dcbadf8 tempest-AttachVolumeShelveTestJSON-435060681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (647636fd-a723-4702-a091-0c9a278bafed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-765d5942-8b61-4eaa-a1b8-7b7b7ae7df67', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:11:09 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6a036140-0f5f-4061-9a69-99f90dcbadf8 tempest-AttachVolumeShelveTestJSON-435060681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (397c3100-e2a7-42f2-af18-bfbbd898505c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:11:10 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-6a036140-0f5f-4061-9a69-99f90dcbadf8 tempest-AttachVolumeShelveTestJSON-435060681 None] Volume volume-765d5942-8b61-4eaa-a1b8-7b7b7ae7df67 (765d5942-8b61-4eaa-a1b8-7b7b7ae7df67): created successfully Apr 29 15:11:10 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6a036140-0f5f-4061-9a69-99f90dcbadf8 tempest-AttachVolumeShelveTestJSON-435060681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (397c3100-e2a7-42f2-af18-bfbbd898505c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:11:10 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6a036140-0f5f-4061-9a69-99f90dcbadf8 tempest-AttachVolumeShelveTestJSON-435060681 None] Flow 'volume_create_manager' (eeb1f205-839f-41f4-95af-ff6de33dae0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:11:10 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-6a036140-0f5f-4061-9a69-99f90dcbadf8 tempest-AttachVolumeShelveTestJSON-435060681 None] Created volume successfully. Apr 29 15:11:20 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:UPDATE=4,cinder:SELECT=2 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:11:20 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:SELECT=2,cinder:INSERT=1,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:11:23 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-6635cb89-1248-4610-ad05-1a2a42c6f81d req-b2c69789-656f-4a12-8c4b-33d03360d549 tempest-ServerActionsV293TestJSON-1649971535 None] Terminate volume connection completed successfully. Apr 29 15:11:23 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-6635cb89-1248-4610-ad05-1a2a42c6f81d req-b2c69789-656f-4a12-8c4b-33d03360d549 tempest-ServerActionsV293TestJSON-1649971535 None] Deleting attachment ecbfea11-87a2-4bee-8b02-6f85a66c7955. {{(pid=84448) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 15:11:24 devstack cinder-volume[84448]: DEBUG cinder.coordination [req-6635cb89-1248-4610-ad05-1a2a42c6f81d req-ba493352-b3df-44b3-931c-a6d762b31ec8 tempest-ServerActionsV293TestJSON-1649971535 None] Acquiring lock "cinder-d573566a-71f4-4dcd-b754-90e0377c7b3a-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:11:24 devstack cinder-volume[84448]: DEBUG cinder.coordination [req-6635cb89-1248-4610-ad05-1a2a42c6f81d req-ba493352-b3df-44b3-931c-a6d762b31ec8 tempest-ServerActionsV293TestJSON-1649971535 None] Lock "cinder-d573566a-71f4-4dcd-b754-90e0377c7b3a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:11:24 devstack cinder-volume[84448]: DEBUG cinder.coordination [req-6635cb89-1248-4610-ad05-1a2a42c6f81d req-ba493352-b3df-44b3-931c-a6d762b31ec8 tempest-ServerActionsV293TestJSON-1649971535 None] Acquiring lock "cinder-quobyte-d573566a-71f4-4dcd-b754-90e0377c7b3a" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:11:24 devstack cinder-volume[84448]: DEBUG cinder.coordination [req-6635cb89-1248-4610-ad05-1a2a42c6f81d req-ba493352-b3df-44b3-931c-a6d762b31ec8 tempest-ServerActionsV293TestJSON-1649971535 None] Lock "cinder-quobyte-d573566a-71f4-4dcd-b754-90e0377c7b3a" acquired by "delete_volume" :: waited 0.023s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:11:24 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3fb8991-2f3d-4d0a-83ed-613a6d603c43]: (4, 'raw') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:11:24 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-6635cb89-1248-4610-ad05-1a2a42c6f81d req-ba493352-b3df-44b3-931c-a6d762b31ec8 tempest-ServerActionsV293TestJSON-1649971535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d573566a-71f4-4dcd-b754-90e0377c7b3a {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:11:25 devstack sudo[92236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d573566a-71f4-4dcd-b754-90e0377c7b3a Apr 29 15:11:25 devstack sudo[92236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:11:25 devstack sudo[92236]: pam_unix(sudo:session): session closed for user root Apr 29 15:11:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-6635cb89-1248-4610-ad05-1a2a42c6f81d req-ba493352-b3df-44b3-931c-a6d762b31ec8 tempest-ServerActionsV293TestJSON-1649971535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d573566a-71f4-4dcd-b754-90e0377c7b3a" returned: 0 in 0.860s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:11:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-6635cb89-1248-4610-ad05-1a2a42c6f81d req-ba493352-b3df-44b3-931c-a6d762b31ec8 tempest-ServerActionsV293TestJSON-1649971535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d573566a-71f4-4dcd-b754-90e0377c7b3a {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:11:25 devstack sudo[92242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d573566a-71f4-4dcd-b754-90e0377c7b3a Apr 29 15:11:25 devstack sudo[92242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:11:26 devstack sudo[92242]: pam_unix(sudo:session): session closed for user root Apr 29 15:11:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-6635cb89-1248-4610-ad05-1a2a42c6f81d req-ba493352-b3df-44b3-931c-a6d762b31ec8 tempest-ServerActionsV293TestJSON-1649971535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d573566a-71f4-4dcd-b754-90e0377c7b3a" returned: 1 in 0.909s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:11:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-6635cb89-1248-4610-ad05-1a2a42c6f81d req-ba493352-b3df-44b3-931c-a6d762b31ec8 tempest-ServerActionsV293TestJSON-1649971535 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d573566a-71f4-4dcd-b754-90e0377c7b3a' failed. Not Retrying. {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 15:11:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-6635cb89-1248-4610-ad05-1a2a42c6f81d req-ba493352-b3df-44b3-931c-a6d762b31ec8 tempest-ServerActionsV293TestJSON-1649971535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d573566a-71f4-4dcd-b754-90e0377c7b3a {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:11:26 devstack sudo[92249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d573566a-71f4-4dcd-b754-90e0377c7b3a Apr 29 15:11:26 devstack sudo[92249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:11:27 devstack sudo[92249]: pam_unix(sudo:session): session closed for user root Apr 29 15:11:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-6635cb89-1248-4610-ad05-1a2a42c6f81d req-ba493352-b3df-44b3-931c-a6d762b31ec8 tempest-ServerActionsV293TestJSON-1649971535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d573566a-71f4-4dcd-b754-90e0377c7b3a" returned: 0 in 0.819s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:11:27 devstack cinder-volume[84448]: DEBUG cinder.coordination [req-6635cb89-1248-4610-ad05-1a2a42c6f81d req-ba493352-b3df-44b3-931c-a6d762b31ec8 tempest-ServerActionsV293TestJSON-1649971535 None] Lock "cinder-quobyte-d573566a-71f4-4dcd-b754-90e0377c7b3a" released by "delete_volume" :: held 2.684s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:11:27 devstack cinder-volume[84448]: DEBUG cinder.quota [req-6635cb89-1248-4610-ad05-1a2a42c6f81d req-ba493352-b3df-44b3-931c-a6d762b31ec8 tempest-ServerActionsV293TestJSON-1649971535 None] Created reservations ['b4382c74-370e-4488-a691-e50aed4643dc', '4334270e-8ea9-44ee-ad04-ebf1efa66a3b', 'e1d6546d-f000-433e-b989-5f24191a724d', 'f1133345-2b53-4273-92ac-479f28670eed'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:11:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-6635cb89-1248-4610-ad05-1a2a42c6f81d req-ba493352-b3df-44b3-931c-a6d762b31ec8 tempest-ServerActionsV293TestJSON-1649971535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:11:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-6635cb89-1248-4610-ad05-1a2a42c6f81d req-ba493352-b3df-44b3-931c-a6d762b31ec8 tempest-ServerActionsV293TestJSON-1649971535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:11:27 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [req-6635cb89-1248-4610-ad05-1a2a42c6f81d req-ba493352-b3df-44b3-931c-a6d762b31ec8 tempest-ServerActionsV293TestJSON-1649971535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:11:27 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [req-6635cb89-1248-4610-ad05-1a2a42c6f81d req-ba493352-b3df-44b3-931c-a6d762b31ec8 tempest-ServerActionsV293TestJSON-1649971535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:11:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-6635cb89-1248-4610-ad05-1a2a42c6f81d req-ba493352-b3df-44b3-931c-a6d762b31ec8 tempest-ServerActionsV293TestJSON-1649971535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:11:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-6635cb89-1248-4610-ad05-1a2a42c6f81d req-ba493352-b3df-44b3-931c-a6d762b31ec8 tempest-ServerActionsV293TestJSON-1649971535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:11:27 devstack sudo[92254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:11:27 devstack sudo[92254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:11:28 devstack sudo[92254]: pam_unix(sudo:session): session closed for user root Apr 29 15:11:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-6635cb89-1248-4610-ad05-1a2a42c6f81d req-ba493352-b3df-44b3-931c-a6d762b31ec8 tempest-ServerActionsV293TestJSON-1649971535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.728s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:11:28 devstack cinder-volume[84448]: DEBUG cinder.manager [req-6635cb89-1248-4610-ad05-1a2a42c6f81d req-ba493352-b3df-44b3-931c-a6d762b31ec8 tempest-ServerActionsV293TestJSON-1649971535 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:11:28 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-6635cb89-1248-4610-ad05-1a2a42c6f81d req-ba493352-b3df-44b3-931c-a6d762b31ec8 tempest-ServerActionsV293TestJSON-1649971535 None] Deleted volume successfully. Apr 29 15:11:28 devstack cinder-volume[84448]: DEBUG cinder.coordination [req-6635cb89-1248-4610-ad05-1a2a42c6f81d req-ba493352-b3df-44b3-931c-a6d762b31ec8 tempest-ServerActionsV293TestJSON-1649971535 None] Lock "cinder-d573566a-71f4-4dcd-b754-90e0377c7b3a-delete_volume" released by "delete_volume" :: held 3.802s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:11:28 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-e1f7ca94-1c15-40bb-8ffe-8c2a9c3a5b32 req-9568b7df-4451-438a-bbb0-b17541fa1af4 tempest-AttachVolumeShelveTestJSON-435060681 None] No connector for attachment 3012ee8b-6cc7-4ab8-87e9-ac29d88b930a; skipping storage backend terminate_connection call. {{(pid=84448) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Apr 29 15:11:28 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-e1f7ca94-1c15-40bb-8ffe-8c2a9c3a5b32 req-9568b7df-4451-438a-bbb0-b17541fa1af4 tempest-AttachVolumeShelveTestJSON-435060681 None] Deleting attachment 3012ee8b-6cc7-4ab8-87e9-ac29d88b930a. {{(pid=84448) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 15:11:30 devstack cinder-volume[84448]: DEBUG oslo_service.periodic_task [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84448) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 15:11:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:11:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:11:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:11:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:11:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:11:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:11:30 devstack sudo[92266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:11:30 devstack sudo[92266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:11:31 devstack sudo[92266]: pam_unix(sudo:session): session closed for user root Apr 29 15:11:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.763s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:11:31 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:11:38 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:SELECT=8,cinder:INSERT=2,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:11:38 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:SELECT=7,cinder:UPDATE=10,cinder:INSERT=2 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:11:43 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-6c279a11-b826-4f77-855c-2a581b7f1737 req-1240bb48-0c3f-4750-8828-80dde7d64d86 tempest-ServerStableDeviceRescueTest-87139885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:11:43 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-6c279a11-b826-4f77-855c-2a581b7f1737 req-1240bb48-0c3f-4750-8828-80dde7d64d86 tempest-ServerStableDeviceRescueTest-87139885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:11:43 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe88b47-20c2-4aba-ad66-51081f1dda73]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:11:43 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-6c279a11-b826-4f77-855c-2a581b7f1737 req-1240bb48-0c3f-4750-8828-80dde7d64d86 tempest-ServerStableDeviceRescueTest-87139885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cd41dddb-f750-45ae-b1a9-8e0c2045838b {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:11:43 devstack sudo[92430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cd41dddb-f750-45ae-b1a9-8e0c2045838b Apr 29 15:11:43 devstack sudo[92430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:11:44 devstack sudo[92430]: pam_unix(sudo:session): session closed for user root Apr 29 15:11:44 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-6c279a11-b826-4f77-855c-2a581b7f1737 req-1240bb48-0c3f-4750-8828-80dde7d64d86 tempest-ServerStableDeviceRescueTest-87139885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cd41dddb-f750-45ae-b1a9-8e0c2045838b" returned: 0 in 1.162s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:11:44 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-6c279a11-b826-4f77-855c-2a581b7f1737 req-1240bb48-0c3f-4750-8828-80dde7d64d86 tempest-ServerStableDeviceRescueTest-87139885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.214s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:11:44 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-6c279a11-b826-4f77-855c-2a581b7f1737 req-1240bb48-0c3f-4750-8828-80dde7d64d86 tempest-ServerStableDeviceRescueTest-87139885 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a', 'name': 'volume-cd41dddb-f750-45ae-b1a9-8e0c2045838b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '813d0231-4d6d-4dce-9c59-a51331d651f5', 'enforce_multipath': True} {{(pid=84448) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 15:11:44 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-6c279a11-b826-4f77-855c-2a581b7f1737 req-1240bb48-0c3f-4750-8828-80dde7d64d86 tempest-ServerStableDeviceRescueTest-87139885 None] attachment_update completed successfully. Apr 29 15:11:54 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:11:54 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:12:11 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-78665b4f-bcd4-4b56-9495-6f72aa43af78 tempest-ServerActionsTestOtherB-242761823 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:12:11 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-78665b4f-bcd4-4b56-9495-6f72aa43af78 tempest-ServerActionsTestOtherB-242761823 None] Flow 'volume_create_manager' (1a8d295c-b918-49c1-a4fe-02586bb268f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:12:11 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-78665b4f-bcd4-4b56-9495-6f72aa43af78 tempest-ServerActionsTestOtherB-242761823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d13c4ee-e069-4f50-9fe0-214be2eda457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:12:11 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-78665b4f-bcd4-4b56-9495-6f72aa43af78 tempest-ServerActionsTestOtherB-242761823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d13c4ee-e069-4f50-9fe0-214be2eda457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:12:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherB-volume-920057333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dec142d-c8b2-4d90-aab1-d8cd5b0b5ed3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe061090ef3f412593eec2d8528c16ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:12:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:12:11Z,use_quota=True,user_id='dbfdf23f38c54849a2c43d0b6b5cf432',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:12:11 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-78665b4f-bcd4-4b56-9495-6f72aa43af78 tempest-ServerActionsTestOtherB-242761823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f82a12ff-eba1-44fd-8084-94c00020e1ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:12:11 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-78665b4f-bcd4-4b56-9495-6f72aa43af78 tempest-ServerActionsTestOtherB-242761823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f82a12ff-eba1-44fd-8084-94c00020e1ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:12:11 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-78665b4f-bcd4-4b56-9495-6f72aa43af78 tempest-ServerActionsTestOtherB-242761823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fa41e43-355c-4662-8a54-b5004fe282cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:12:11 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-78665b4f-bcd4-4b56-9495-6f72aa43af78 tempest-ServerActionsTestOtherB-242761823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fa41e43-355c-4662-8a54-b5004fe282cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2dec142d-c8b2-4d90-aab1-d8cd5b0b5ed3', 'volume_name': 'volume-2dec142d-c8b2-4d90-aab1-d8cd5b0b5ed3', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:12:11 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-78665b4f-bcd4-4b56-9495-6f72aa43af78 tempest-ServerActionsTestOtherB-242761823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89ee8529-9b73-4360-9830-6ca9f78a9300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:12:11 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-78665b4f-bcd4-4b56-9495-6f72aa43af78 tempest-ServerActionsTestOtherB-242761823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89ee8529-9b73-4360-9830-6ca9f78a9300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:12:11 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-78665b4f-bcd4-4b56-9495-6f72aa43af78 tempest-ServerActionsTestOtherB-242761823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0837de6-3044-42f8-af8b-b519f7468853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:12:11 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-78665b4f-bcd4-4b56-9495-6f72aa43af78 tempest-ServerActionsTestOtherB-242761823 None] Volume 2dec142d-c8b2-4d90-aab1-d8cd5b0b5ed3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2dec142d-c8b2-4d90-aab1-d8cd5b0b5ed3', 'volume_size': 1} Apr 29 15:12:11 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-78665b4f-bcd4-4b56-9495-6f72aa43af78 tempest-ServerActionsTestOtherB-242761823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:12:11 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-78665b4f-bcd4-4b56-9495-6f72aa43af78 tempest-ServerActionsTestOtherB-242761823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:12:11 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-78665b4f-bcd4-4b56-9495-6f72aa43af78 tempest-ServerActionsTestOtherB-242761823 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:12:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherB-volume-920057333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dec142d-c8b2-4d90-aab1-d8cd5b0b5ed3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe061090ef3f412593eec2d8528c16ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:12:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:12:11Z,use_quota=True,user_id='dbfdf23f38c54849a2c43d0b6b5cf432',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:12:11 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-78665b4f-bcd4-4b56-9495-6f72aa43af78 tempest-ServerActionsTestOtherB-242761823 None] Creating volume 2dec142d-c8b2-4d90-aab1-d8cd5b0b5ed3 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:12:11 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-78665b4f-bcd4-4b56-9495-6f72aa43af78 tempest-ServerActionsTestOtherB-242761823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:12:11 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-78665b4f-bcd4-4b56-9495-6f72aa43af78 tempest-ServerActionsTestOtherB-242761823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:12:11 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-78665b4f-bcd4-4b56-9495-6f72aa43af78 tempest-ServerActionsTestOtherB-242761823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:12:11 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-78665b4f-bcd4-4b56-9495-6f72aa43af78 tempest-ServerActionsTestOtherB-242761823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:12:11 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-78665b4f-bcd4-4b56-9495-6f72aa43af78 tempest-ServerActionsTestOtherB-242761823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:12:11 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-78665b4f-bcd4-4b56-9495-6f72aa43af78 tempest-ServerActionsTestOtherB-242761823 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:12:11 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-78665b4f-bcd4-4b56-9495-6f72aa43af78 tempest-ServerActionsTestOtherB-242761823 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:12:11 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-78665b4f-bcd4-4b56-9495-6f72aa43af78 tempest-ServerActionsTestOtherB-242761823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2dec142d-c8b2-4d90-aab1-d8cd5b0b5ed3 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:12:11 devstack sudo[93176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2dec142d-c8b2-4d90-aab1-d8cd5b0b5ed3 1073741824 Apr 29 15:12:11 devstack sudo[93176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:12:12 devstack sudo[93176]: pam_unix(sudo:session): session closed for user root Apr 29 15:12:12 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-78665b4f-bcd4-4b56-9495-6f72aa43af78 tempest-ServerActionsTestOtherB-242761823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2dec142d-c8b2-4d90-aab1-d8cd5b0b5ed3 1073741824" returned: 0 in 1.810s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:12:13 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-78665b4f-bcd4-4b56-9495-6f72aa43af78 tempest-ServerActionsTestOtherB-242761823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2dec142d-c8b2-4d90-aab1-d8cd5b0b5ed3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:12:13 devstack sudo[93227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2dec142d-c8b2-4d90-aab1-d8cd5b0b5ed3 Apr 29 15:12:13 devstack sudo[93227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:12:14 devstack sudo[93227]: pam_unix(sudo:session): session closed for user root Apr 29 15:12:14 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-78665b4f-bcd4-4b56-9495-6f72aa43af78 tempest-ServerActionsTestOtherB-242761823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2dec142d-c8b2-4d90-aab1-d8cd5b0b5ed3" returned: 0 in 1.304s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:12:14 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-78665b4f-bcd4-4b56-9495-6f72aa43af78 tempest-ServerActionsTestOtherB-242761823 None] <== create_volume: return (3231ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:12:14 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-78665b4f-bcd4-4b56-9495-6f72aa43af78 tempest-ServerActionsTestOtherB-242761823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.239s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:12:14 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-78665b4f-bcd4-4b56-9495-6f72aa43af78 tempest-ServerActionsTestOtherB-242761823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0837de6-3044-42f8-af8b-b519f7468853) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2dec142d-c8b2-4d90-aab1-d8cd5b0b5ed3', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:12:14 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-78665b4f-bcd4-4b56-9495-6f72aa43af78 tempest-ServerActionsTestOtherB-242761823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e01cb12-4075-4876-8f16-15180083f927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:12:14 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-78665b4f-bcd4-4b56-9495-6f72aa43af78 tempest-ServerActionsTestOtherB-242761823 None] Volume volume-2dec142d-c8b2-4d90-aab1-d8cd5b0b5ed3 (2dec142d-c8b2-4d90-aab1-d8cd5b0b5ed3): created successfully Apr 29 15:12:14 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-78665b4f-bcd4-4b56-9495-6f72aa43af78 tempest-ServerActionsTestOtherB-242761823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e01cb12-4075-4876-8f16-15180083f927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:12:14 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-78665b4f-bcd4-4b56-9495-6f72aa43af78 tempest-ServerActionsTestOtherB-242761823 None] Flow 'volume_create_manager' (1a8d295c-b918-49c1-a4fe-02586bb268f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:12:14 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-78665b4f-bcd4-4b56-9495-6f72aa43af78 tempest-ServerActionsTestOtherB-242761823 None] Created volume successfully. Apr 29 15:12:19 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-10a6e843-97e0-4af9-bb59-d38b63ca5e4f req-f61c0d28-a478-4ad7-8f0c-eb422a37fd51 tempest-ServerActionsTestOtherB-242761823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:12:19 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-10a6e843-97e0-4af9-bb59-d38b63ca5e4f req-f61c0d28-a478-4ad7-8f0c-eb422a37fd51 tempest-ServerActionsTestOtherB-242761823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:12:19 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0eef4b-345d-445d-bb1c-bdfcfed39db0]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:12:19 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-10a6e843-97e0-4af9-bb59-d38b63ca5e4f req-f61c0d28-a478-4ad7-8f0c-eb422a37fd51 tempest-ServerActionsTestOtherB-242761823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2dec142d-c8b2-4d90-aab1-d8cd5b0b5ed3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:12:20 devstack sudo[93376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2dec142d-c8b2-4d90-aab1-d8cd5b0b5ed3 Apr 29 15:12:20 devstack sudo[93376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:12:20 devstack sudo[93376]: pam_unix(sudo:session): session closed for user root Apr 29 15:12:20 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-10a6e843-97e0-4af9-bb59-d38b63ca5e4f req-f61c0d28-a478-4ad7-8f0c-eb422a37fd51 tempest-ServerActionsTestOtherB-242761823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2dec142d-c8b2-4d90-aab1-d8cd5b0b5ed3" returned: 0 in 1.209s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:12:20 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-10a6e843-97e0-4af9-bb59-d38b63ca5e4f req-f61c0d28-a478-4ad7-8f0c-eb422a37fd51 tempest-ServerActionsTestOtherB-242761823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.271s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:12:21 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-10a6e843-97e0-4af9-bb59-d38b63ca5e4f req-f61c0d28-a478-4ad7-8f0c-eb422a37fd51 tempest-ServerActionsTestOtherB-242761823 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a', 'name': 'volume-2dec142d-c8b2-4d90-aab1-d8cd5b0b5ed3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e5f94b7b-94df-4491-b3a9-e4dc989eb2b9', 'enforce_multipath': True} {{(pid=84448) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 15:12:21 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-10a6e843-97e0-4af9-bb59-d38b63ca5e4f req-f61c0d28-a478-4ad7-8f0c-eb422a37fd51 tempest-ServerActionsTestOtherB-242761823 None] attachment_update completed successfully. Apr 29 15:12:26 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-cadcb5e2-1c58-4030-bbf8-a32ad8623134 tempest-AttachVolumeShelveTestJSON-435060681 None] Acquiring lock "cinder-765d5942-8b61-4eaa-a1b8-7b7b7ae7df67-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:12:26 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-cadcb5e2-1c58-4030-bbf8-a32ad8623134 tempest-AttachVolumeShelveTestJSON-435060681 None] Lock "cinder-765d5942-8b61-4eaa-a1b8-7b7b7ae7df67-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:12:26 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-cadcb5e2-1c58-4030-bbf8-a32ad8623134 tempest-AttachVolumeShelveTestJSON-435060681 None] Acquiring lock "cinder-quobyte-765d5942-8b61-4eaa-a1b8-7b7b7ae7df67" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:12:26 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-cadcb5e2-1c58-4030-bbf8-a32ad8623134 tempest-AttachVolumeShelveTestJSON-435060681 None] Lock "cinder-quobyte-765d5942-8b61-4eaa-a1b8-7b7b7ae7df67" acquired by "delete_volume" :: waited 0.049s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:12:26 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eda51d3-6251-41af-937e-b93a730dd4f4]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:12:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cadcb5e2-1c58-4030-bbf8-a32ad8623134 tempest-AttachVolumeShelveTestJSON-435060681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-765d5942-8b61-4eaa-a1b8-7b7b7ae7df67 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:12:26 devstack sudo[93445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-765d5942-8b61-4eaa-a1b8-7b7b7ae7df67 Apr 29 15:12:26 devstack sudo[93445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:12:27 devstack sudo[93445]: pam_unix(sudo:session): session closed for user root Apr 29 15:12:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cadcb5e2-1c58-4030-bbf8-a32ad8623134 tempest-AttachVolumeShelveTestJSON-435060681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-765d5942-8b61-4eaa-a1b8-7b7b7ae7df67" returned: 0 in 1.325s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:12:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cadcb5e2-1c58-4030-bbf8-a32ad8623134 tempest-AttachVolumeShelveTestJSON-435060681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-765d5942-8b61-4eaa-a1b8-7b7b7ae7df67 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:12:27 devstack sudo[93464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-765d5942-8b61-4eaa-a1b8-7b7b7ae7df67 Apr 29 15:12:27 devstack sudo[93464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:12:28 devstack sudo[93464]: pam_unix(sudo:session): session closed for user root Apr 29 15:12:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cadcb5e2-1c58-4030-bbf8-a32ad8623134 tempest-AttachVolumeShelveTestJSON-435060681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-765d5942-8b61-4eaa-a1b8-7b7b7ae7df67" returned: 0 in 0.936s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:12:28 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-cadcb5e2-1c58-4030-bbf8-a32ad8623134 tempest-AttachVolumeShelveTestJSON-435060681 None] Lock "cinder-quobyte-765d5942-8b61-4eaa-a1b8-7b7b7ae7df67" released by "delete_volume" :: held 2.387s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:12:28 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-cadcb5e2-1c58-4030-bbf8-a32ad8623134 tempest-AttachVolumeShelveTestJSON-435060681 None] Created reservations ['09eb21fb-361c-4125-8c9d-d584b17ad027', 'a1efc220-17d0-4e7f-bcf8-ff96117a0343', 'e803da92-2aeb-4550-96df-338b67dfdffe', '573454e8-b31f-4fb8-93ed-b75d1491ede1'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:12:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-cadcb5e2-1c58-4030-bbf8-a32ad8623134 tempest-AttachVolumeShelveTestJSON-435060681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:12:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-cadcb5e2-1c58-4030-bbf8-a32ad8623134 tempest-AttachVolumeShelveTestJSON-435060681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:12:28 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-cadcb5e2-1c58-4030-bbf8-a32ad8623134 tempest-AttachVolumeShelveTestJSON-435060681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:12:28 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-cadcb5e2-1c58-4030-bbf8-a32ad8623134 tempest-AttachVolumeShelveTestJSON-435060681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:12:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-cadcb5e2-1c58-4030-bbf8-a32ad8623134 tempest-AttachVolumeShelveTestJSON-435060681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:12:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cadcb5e2-1c58-4030-bbf8-a32ad8623134 tempest-AttachVolumeShelveTestJSON-435060681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:12:28 devstack sudo[93468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:12:28 devstack sudo[93468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:12:29 devstack sudo[93468]: pam_unix(sudo:session): session closed for user root Apr 29 15:12:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cadcb5e2-1c58-4030-bbf8-a32ad8623134 tempest-AttachVolumeShelveTestJSON-435060681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.638s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:12:29 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-cadcb5e2-1c58-4030-bbf8-a32ad8623134 tempest-AttachVolumeShelveTestJSON-435060681 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:12:29 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-cadcb5e2-1c58-4030-bbf8-a32ad8623134 tempest-AttachVolumeShelveTestJSON-435060681 None] Deleted volume successfully. Apr 29 15:12:29 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-cadcb5e2-1c58-4030-bbf8-a32ad8623134 tempest-AttachVolumeShelveTestJSON-435060681 None] Lock "cinder-765d5942-8b61-4eaa-a1b8-7b7b7ae7df67-delete_volume" released by "delete_volume" :: held 3.332s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:12:29 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-0448edf4-7573-46b2-a9b7-dbcc7c780b05 tempest-AttachVolumeShelveTestJSON-435060681 None] Acquiring lock "cinder-56dd9f10-c9a3-4ce2-8eba-ef7db03d376f-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:12:29 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-0448edf4-7573-46b2-a9b7-dbcc7c780b05 tempest-AttachVolumeShelveTestJSON-435060681 None] Lock "cinder-56dd9f10-c9a3-4ce2-8eba-ef7db03d376f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:12:29 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-0448edf4-7573-46b2-a9b7-dbcc7c780b05 tempest-AttachVolumeShelveTestJSON-435060681 None] Acquiring lock "cinder-quobyte-56dd9f10-c9a3-4ce2-8eba-ef7db03d376f" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:12:29 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-0448edf4-7573-46b2-a9b7-dbcc7c780b05 tempest-AttachVolumeShelveTestJSON-435060681 None] Lock "cinder-quobyte-56dd9f10-c9a3-4ce2-8eba-ef7db03d376f" acquired by "delete_volume" :: waited 0.029s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:12:30 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebdceaef-9521-45f9-8f29-bbf4315e2ed1]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:12:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-0448edf4-7573-46b2-a9b7-dbcc7c780b05 tempest-AttachVolumeShelveTestJSON-435060681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-56dd9f10-c9a3-4ce2-8eba-ef7db03d376f {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:12:30 devstack sudo[93477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-56dd9f10-c9a3-4ce2-8eba-ef7db03d376f Apr 29 15:12:30 devstack sudo[93477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:12:30 devstack sudo[93477]: pam_unix(sudo:session): session closed for user root Apr 29 15:12:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-0448edf4-7573-46b2-a9b7-dbcc7c780b05 tempest-AttachVolumeShelveTestJSON-435060681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-56dd9f10-c9a3-4ce2-8eba-ef7db03d376f" returned: 0 in 0.756s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:12:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-0448edf4-7573-46b2-a9b7-dbcc7c780b05 tempest-AttachVolumeShelveTestJSON-435060681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-56dd9f10-c9a3-4ce2-8eba-ef7db03d376f {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:12:30 devstack sudo[93489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-56dd9f10-c9a3-4ce2-8eba-ef7db03d376f Apr 29 15:12:30 devstack sudo[93489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:12:31 devstack sudo[93489]: pam_unix(sudo:session): session closed for user root Apr 29 15:12:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-0448edf4-7573-46b2-a9b7-dbcc7c780b05 tempest-AttachVolumeShelveTestJSON-435060681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-56dd9f10-c9a3-4ce2-8eba-ef7db03d376f" returned: 0 in 0.590s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:12:31 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-0448edf4-7573-46b2-a9b7-dbcc7c780b05 tempest-AttachVolumeShelveTestJSON-435060681 None] Lock "cinder-quobyte-56dd9f10-c9a3-4ce2-8eba-ef7db03d376f" released by "delete_volume" :: held 1.391s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:12:31 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-0448edf4-7573-46b2-a9b7-dbcc7c780b05 tempest-AttachVolumeShelveTestJSON-435060681 None] Created reservations ['45fd9b43-b583-4311-8161-ad430661129d', '85a2da63-774b-46b2-a53f-9a811b32d52c', '5eec9fda-0264-4d46-894c-f4565926892a', '183a85d2-d782-4555-94d4-8ab39194fb2f'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:12:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-0448edf4-7573-46b2-a9b7-dbcc7c780b05 tempest-AttachVolumeShelveTestJSON-435060681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:12:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-0448edf4-7573-46b2-a9b7-dbcc7c780b05 tempest-AttachVolumeShelveTestJSON-435060681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:12:31 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-0448edf4-7573-46b2-a9b7-dbcc7c780b05 tempest-AttachVolumeShelveTestJSON-435060681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:12:31 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-0448edf4-7573-46b2-a9b7-dbcc7c780b05 tempest-AttachVolumeShelveTestJSON-435060681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:12:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-0448edf4-7573-46b2-a9b7-dbcc7c780b05 tempest-AttachVolumeShelveTestJSON-435060681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:12:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-0448edf4-7573-46b2-a9b7-dbcc7c780b05 tempest-AttachVolumeShelveTestJSON-435060681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:12:31 devstack sudo[93492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:12:31 devstack sudo[93492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:12:32 devstack sudo[93492]: pam_unix(sudo:session): session closed for user root Apr 29 15:12:32 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-0448edf4-7573-46b2-a9b7-dbcc7c780b05 tempest-AttachVolumeShelveTestJSON-435060681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.595s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:12:32 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-0448edf4-7573-46b2-a9b7-dbcc7c780b05 tempest-AttachVolumeShelveTestJSON-435060681 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:12:32 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-0448edf4-7573-46b2-a9b7-dbcc7c780b05 tempest-AttachVolumeShelveTestJSON-435060681 None] Deleted volume successfully. Apr 29 15:12:32 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-0448edf4-7573-46b2-a9b7-dbcc7c780b05 tempest-AttachVolumeShelveTestJSON-435060681 None] Lock "cinder-56dd9f10-c9a3-4ce2-8eba-ef7db03d376f-delete_volume" released by "delete_volume" :: held 2.184s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:12:36 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [req-2e3e3009-7162-4df1-a129-67593ff71c47 req-b2b3aadf-637f-47da-939d-88920c6e5fe0 tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:12:36 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-2e3e3009-7162-4df1-a129-67593ff71c47 req-b2b3aadf-637f-47da-939d-88920c6e5fe0 tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Flow 'volume_create_manager' (a68e964d-b2d9-45f3-8e35-f8b6dc02cd32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:12:36 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-2e3e3009-7162-4df1-a129-67593ff71c47 req-b2b3aadf-637f-47da-939d-88920c6e5fe0 tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e277097-a912-421c-b7fe-15d3d4c37323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:12:36 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-2e3e3009-7162-4df1-a129-67593ff71c47 req-b2b3aadf-637f-47da-939d-88920c6e5fe0 tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e277097-a912-421c-b7fe-15d3d4c37323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:12:36Z,deleted=False,deleted_at=None,display_description='',display_name='54c21d31-223e-4625-92d3-c58929741aaa-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d04ea0f4-4cb2-4e64-a05f-3208620dfbe1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35dad894a21e475cb16f0eb9f2a959c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:12:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:12:37Z,use_quota=True,user_id='1bdf8feb2bba476a9253ccbe0ba9cf91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:12:36 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-2e3e3009-7162-4df1-a129-67593ff71c47 req-b2b3aadf-637f-47da-939d-88920c6e5fe0 tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26dac1f9-3cea-4b17-b2bf-ab008a9d91a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:12:36 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-2e3e3009-7162-4df1-a129-67593ff71c47 req-b2b3aadf-637f-47da-939d-88920c6e5fe0 tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26dac1f9-3cea-4b17-b2bf-ab008a9d91a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:12:36 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-2e3e3009-7162-4df1-a129-67593ff71c47 req-b2b3aadf-637f-47da-939d-88920c6e5fe0 tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4413f5b-9468-49c9-878f-bf31397e87dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:12:36 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-2e3e3009-7162-4df1-a129-67593ff71c47 req-b2b3aadf-637f-47da-939d-88920c6e5fe0 tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4413f5b-9468-49c9-878f-bf31397e87dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd04ea0f4-4cb2-4e64-a05f-3208620dfbe1', 'volume_name': 'volume-d04ea0f4-4cb2-4e64-a05f-3208620dfbe1', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:12:36 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-2e3e3009-7162-4df1-a129-67593ff71c47 req-b2b3aadf-637f-47da-939d-88920c6e5fe0 tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b61b55bf-2c90-4bd2-8173-ae0f5b2e8ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:12:36 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-2e3e3009-7162-4df1-a129-67593ff71c47 req-b2b3aadf-637f-47da-939d-88920c6e5fe0 tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b61b55bf-2c90-4bd2-8173-ae0f5b2e8ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:12:36 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-2e3e3009-7162-4df1-a129-67593ff71c47 req-b2b3aadf-637f-47da-939d-88920c6e5fe0 tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e941dc6-23fd-41de-ae4f-aa9c2f3f962b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:12:36 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [req-2e3e3009-7162-4df1-a129-67593ff71c47 req-b2b3aadf-637f-47da-939d-88920c6e5fe0 tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Volume d04ea0f4-4cb2-4e64-a05f-3208620dfbe1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d04ea0f4-4cb2-4e64-a05f-3208620dfbe1', 'volume_size': 1} Apr 29 15:12:36 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-2e3e3009-7162-4df1-a129-67593ff71c47 req-b2b3aadf-637f-47da-939d-88920c6e5fe0 tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:12:36 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-2e3e3009-7162-4df1-a129-67593ff71c47 req-b2b3aadf-637f-47da-939d-88920c6e5fe0 tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:12:36 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [req-2e3e3009-7162-4df1-a129-67593ff71c47 req-b2b3aadf-637f-47da-939d-88920c6e5fe0 tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:12:36Z,deleted=False,deleted_at=None,display_description='',display_name='54c21d31-223e-4625-92d3-c58929741aaa-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d04ea0f4-4cb2-4e64-a05f-3208620dfbe1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35dad894a21e475cb16f0eb9f2a959c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:12:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:12:37Z,use_quota=True,user_id='1bdf8feb2bba476a9253ccbe0ba9cf91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:12:36 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [req-2e3e3009-7162-4df1-a129-67593ff71c47 req-b2b3aadf-637f-47da-939d-88920c6e5fe0 tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Creating volume d04ea0f4-4cb2-4e64-a05f-3208620dfbe1 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:12:36 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-2e3e3009-7162-4df1-a129-67593ff71c47 req-b2b3aadf-637f-47da-939d-88920c6e5fe0 tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:12:36 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-2e3e3009-7162-4df1-a129-67593ff71c47 req-b2b3aadf-637f-47da-939d-88920c6e5fe0 tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:12:36 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [req-2e3e3009-7162-4df1-a129-67593ff71c47 req-b2b3aadf-637f-47da-939d-88920c6e5fe0 tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:12:36 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [req-2e3e3009-7162-4df1-a129-67593ff71c47 req-b2b3aadf-637f-47da-939d-88920c6e5fe0 tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:12:36 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-2e3e3009-7162-4df1-a129-67593ff71c47 req-b2b3aadf-637f-47da-939d-88920c6e5fe0 tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:12:36 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [req-2e3e3009-7162-4df1-a129-67593ff71c47 req-b2b3aadf-637f-47da-939d-88920c6e5fe0 tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:12:36 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [req-2e3e3009-7162-4df1-a129-67593ff71c47 req-b2b3aadf-637f-47da-939d-88920c6e5fe0 tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:12:36 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-2e3e3009-7162-4df1-a129-67593ff71c47 req-b2b3aadf-637f-47da-939d-88920c6e5fe0 tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d04ea0f4-4cb2-4e64-a05f-3208620dfbe1 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:12:36 devstack sudo[93498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d04ea0f4-4cb2-4e64-a05f-3208620dfbe1 1073741824 Apr 29 15:12:36 devstack sudo[93498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:12:37 devstack sudo[93498]: pam_unix(sudo:session): session closed for user root Apr 29 15:12:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-2e3e3009-7162-4df1-a129-67593ff71c47 req-b2b3aadf-637f-47da-939d-88920c6e5fe0 tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d04ea0f4-4cb2-4e64-a05f-3208620dfbe1 1073741824" returned: 0 in 0.936s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:12:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-2e3e3009-7162-4df1-a129-67593ff71c47 req-b2b3aadf-637f-47da-939d-88920c6e5fe0 tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d04ea0f4-4cb2-4e64-a05f-3208620dfbe1 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:12:37 devstack sudo[93505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d04ea0f4-4cb2-4e64-a05f-3208620dfbe1 Apr 29 15:12:37 devstack sudo[93505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:12:38 devstack sudo[93505]: pam_unix(sudo:session): session closed for user root Apr 29 15:12:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-2e3e3009-7162-4df1-a129-67593ff71c47 req-b2b3aadf-637f-47da-939d-88920c6e5fe0 tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d04ea0f4-4cb2-4e64-a05f-3208620dfbe1" returned: 0 in 0.920s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:12:38 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [req-2e3e3009-7162-4df1-a129-67593ff71c47 req-b2b3aadf-637f-47da-939d-88920c6e5fe0 tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] <== create_volume: return (1915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:12:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-2e3e3009-7162-4df1-a129-67593ff71c47 req-b2b3aadf-637f-47da-939d-88920c6e5fe0 tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.918s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:12:38 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-2e3e3009-7162-4df1-a129-67593ff71c47 req-b2b3aadf-637f-47da-939d-88920c6e5fe0 tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e941dc6-23fd-41de-ae4f-aa9c2f3f962b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d04ea0f4-4cb2-4e64-a05f-3208620dfbe1', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:12:38 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-2e3e3009-7162-4df1-a129-67593ff71c47 req-b2b3aadf-637f-47da-939d-88920c6e5fe0 tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84313bb5-c5ba-4742-8b31-9faf2e4a1de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:12:38 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [req-2e3e3009-7162-4df1-a129-67593ff71c47 req-b2b3aadf-637f-47da-939d-88920c6e5fe0 tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Volume volume-d04ea0f4-4cb2-4e64-a05f-3208620dfbe1 (d04ea0f4-4cb2-4e64-a05f-3208620dfbe1): created successfully Apr 29 15:12:38 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-2e3e3009-7162-4df1-a129-67593ff71c47 req-b2b3aadf-637f-47da-939d-88920c6e5fe0 tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84313bb5-c5ba-4742-8b31-9faf2e4a1de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:12:38 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-2e3e3009-7162-4df1-a129-67593ff71c47 req-b2b3aadf-637f-47da-939d-88920c6e5fe0 tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Flow 'volume_create_manager' (a68e964d-b2d9-45f3-8e35-f8b6dc02cd32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:12:38 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-2e3e3009-7162-4df1-a129-67593ff71c47 req-b2b3aadf-637f-47da-939d-88920c6e5fe0 tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Created volume successfully. Apr 29 15:12:40 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-2e3e3009-7162-4df1-a129-67593ff71c47 req-91ffac99-7dd4-41c4-b558-2d9f22da93c6 tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:12:40 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-2e3e3009-7162-4df1-a129-67593ff71c47 req-91ffac99-7dd4-41c4-b558-2d9f22da93c6 tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:12:40 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e789d19-ee16-4cc2-9224-7009a8329c73]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:12:40 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-2e3e3009-7162-4df1-a129-67593ff71c47 req-91ffac99-7dd4-41c4-b558-2d9f22da93c6 tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d04ea0f4-4cb2-4e64-a05f-3208620dfbe1 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:12:40 devstack sudo[93518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d04ea0f4-4cb2-4e64-a05f-3208620dfbe1 Apr 29 15:12:40 devstack sudo[93518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:12:40 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [req-76c93b85-1555-4957-8434-9bdded20fc7f req-4644577f-f6cd-47cb-9260-429baaef2773 tempest-VolumesSnapshotsTestJSON-885180718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:12:40 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-76c93b85-1555-4957-8434-9bdded20fc7f req-4644577f-f6cd-47cb-9260-429baaef2773 tempest-VolumesSnapshotsTestJSON-885180718 None] Flow 'volume_create_manager' (f994ad2b-17a4-4cf9-a46c-47dfe8f6a2ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:12:40 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-76c93b85-1555-4957-8434-9bdded20fc7f req-4644577f-f6cd-47cb-9260-429baaef2773 tempest-VolumesSnapshotsTestJSON-885180718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9182fbf-a39b-4676-93cb-0bfcdf2cf372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:12:40 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-76c93b85-1555-4957-8434-9bdded20fc7f req-4644577f-f6cd-47cb-9260-429baaef2773 tempest-VolumesSnapshotsTestJSON-885180718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9182fbf-a39b-4676-93cb-0bfcdf2cf372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:12:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-263491881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eae92c75-d4bc-4e26-863f-a2fe40892b63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70621cf0a2f94396bfee1e30a17c9b8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:12:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:12:40Z,use_quota=True,user_id='5df703c9f53e45cda0c34cd5ec8fac58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:12:40 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-76c93b85-1555-4957-8434-9bdded20fc7f req-4644577f-f6cd-47cb-9260-429baaef2773 tempest-VolumesSnapshotsTestJSON-885180718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fd42f2e-ed1a-42aa-913f-de5f9693fe1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:12:40 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-76c93b85-1555-4957-8434-9bdded20fc7f req-4644577f-f6cd-47cb-9260-429baaef2773 tempest-VolumesSnapshotsTestJSON-885180718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fd42f2e-ed1a-42aa-913f-de5f9693fe1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:12:40 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-76c93b85-1555-4957-8434-9bdded20fc7f req-4644577f-f6cd-47cb-9260-429baaef2773 tempest-VolumesSnapshotsTestJSON-885180718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (150195ab-b38f-40d7-a737-ed327f42499f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:12:40 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-76c93b85-1555-4957-8434-9bdded20fc7f req-4644577f-f6cd-47cb-9260-429baaef2773 tempest-VolumesSnapshotsTestJSON-885180718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (150195ab-b38f-40d7-a737-ed327f42499f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eae92c75-d4bc-4e26-863f-a2fe40892b63', 'volume_name': 'volume-eae92c75-d4bc-4e26-863f-a2fe40892b63', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:12:40 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-76c93b85-1555-4957-8434-9bdded20fc7f req-4644577f-f6cd-47cb-9260-429baaef2773 tempest-VolumesSnapshotsTestJSON-885180718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7045f9e-05c0-4853-9218-40acaad62323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:12:40 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-76c93b85-1555-4957-8434-9bdded20fc7f req-4644577f-f6cd-47cb-9260-429baaef2773 tempest-VolumesSnapshotsTestJSON-885180718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7045f9e-05c0-4853-9218-40acaad62323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:12:40 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-76c93b85-1555-4957-8434-9bdded20fc7f req-4644577f-f6cd-47cb-9260-429baaef2773 tempest-VolumesSnapshotsTestJSON-885180718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00660bb0-3793-4ebc-9d62-a350bb728519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:12:40 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [req-76c93b85-1555-4957-8434-9bdded20fc7f req-4644577f-f6cd-47cb-9260-429baaef2773 tempest-VolumesSnapshotsTestJSON-885180718 None] Volume eae92c75-d4bc-4e26-863f-a2fe40892b63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eae92c75-d4bc-4e26-863f-a2fe40892b63', 'volume_size': 1} Apr 29 15:12:40 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-76c93b85-1555-4957-8434-9bdded20fc7f req-4644577f-f6cd-47cb-9260-429baaef2773 tempest-VolumesSnapshotsTestJSON-885180718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:12:41 devstack sudo[93518]: pam_unix(sudo:session): session closed for user root Apr 29 15:12:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-2e3e3009-7162-4df1-a129-67593ff71c47 req-91ffac99-7dd4-41c4-b558-2d9f22da93c6 tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d04ea0f4-4cb2-4e64-a05f-3208620dfbe1" returned: 0 in 0.843s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:12:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-2e3e3009-7162-4df1-a129-67593ff71c47 req-91ffac99-7dd4-41c4-b558-2d9f22da93c6 tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.867s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:12:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-76c93b85-1555-4957-8434-9bdded20fc7f req-4644577f-f6cd-47cb-9260-429baaef2773 tempest-VolumesSnapshotsTestJSON-885180718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.510s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:12:41 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [req-76c93b85-1555-4957-8434-9bdded20fc7f req-4644577f-f6cd-47cb-9260-429baaef2773 tempest-VolumesSnapshotsTestJSON-885180718 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:12:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-263491881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eae92c75-d4bc-4e26-863f-a2fe40892b63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70621cf0a2f94396bfee1e30a17c9b8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:12:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:12:40Z,use_quota=True,user_id='5df703c9f53e45cda0c34cd5ec8fac58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:12:41 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [req-76c93b85-1555-4957-8434-9bdded20fc7f req-4644577f-f6cd-47cb-9260-429baaef2773 tempest-VolumesSnapshotsTestJSON-885180718 None] Creating volume eae92c75-d4bc-4e26-863f-a2fe40892b63 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:12:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-76c93b85-1555-4957-8434-9bdded20fc7f req-4644577f-f6cd-47cb-9260-429baaef2773 tempest-VolumesSnapshotsTestJSON-885180718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:12:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-76c93b85-1555-4957-8434-9bdded20fc7f req-4644577f-f6cd-47cb-9260-429baaef2773 tempest-VolumesSnapshotsTestJSON-885180718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:12:41 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [req-76c93b85-1555-4957-8434-9bdded20fc7f req-4644577f-f6cd-47cb-9260-429baaef2773 tempest-VolumesSnapshotsTestJSON-885180718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:12:41 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [req-76c93b85-1555-4957-8434-9bdded20fc7f req-4644577f-f6cd-47cb-9260-429baaef2773 tempest-VolumesSnapshotsTestJSON-885180718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:12:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-76c93b85-1555-4957-8434-9bdded20fc7f req-4644577f-f6cd-47cb-9260-429baaef2773 tempest-VolumesSnapshotsTestJSON-885180718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:12:41 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [req-76c93b85-1555-4957-8434-9bdded20fc7f req-4644577f-f6cd-47cb-9260-429baaef2773 tempest-VolumesSnapshotsTestJSON-885180718 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:12:41 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [req-76c93b85-1555-4957-8434-9bdded20fc7f req-4644577f-f6cd-47cb-9260-429baaef2773 tempest-VolumesSnapshotsTestJSON-885180718 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:12:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-76c93b85-1555-4957-8434-9bdded20fc7f req-4644577f-f6cd-47cb-9260-429baaef2773 tempest-VolumesSnapshotsTestJSON-885180718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-eae92c75-d4bc-4e26-863f-a2fe40892b63 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:12:41 devstack sudo[93544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-eae92c75-d4bc-4e26-863f-a2fe40892b63 1073741824 Apr 29 15:12:41 devstack sudo[93544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:12:41 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-2e3e3009-7162-4df1-a129-67593ff71c47 req-91ffac99-7dd4-41c4-b558-2d9f22da93c6 tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a', 'name': 'volume-d04ea0f4-4cb2-4e64-a05f-3208620dfbe1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e8004ef4-6f22-4fc4-9b2c-6f93b7138739', 'enforce_multipath': True} {{(pid=84448) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 15:12:41 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-2e3e3009-7162-4df1-a129-67593ff71c47 req-91ffac99-7dd4-41c4-b558-2d9f22da93c6 tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] attachment_update completed successfully. Apr 29 15:12:41 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-bd04c8a5-81cc-44a9-8be2-2c03890895a2 req-25c776b0-2a8c-4dfb-be25-cc63fa9ab52c tempest-ServerActionsTestOtherB-242761823 None] Terminate volume connection completed successfully. Apr 29 15:12:41 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-bd04c8a5-81cc-44a9-8be2-2c03890895a2 req-25c776b0-2a8c-4dfb-be25-cc63fa9ab52c tempest-ServerActionsTestOtherB-242761823 None] Deleting attachment e5f94b7b-94df-4491-b3a9-e4dc989eb2b9. {{(pid=84448) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 15:12:42 devstack sudo[93544]: pam_unix(sudo:session): session closed for user root Apr 29 15:12:42 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-76c93b85-1555-4957-8434-9bdded20fc7f req-4644577f-f6cd-47cb-9260-429baaef2773 tempest-VolumesSnapshotsTestJSON-885180718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-eae92c75-d4bc-4e26-863f-a2fe40892b63 1073741824" returned: 0 in 0.982s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:12:42 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-76c93b85-1555-4957-8434-9bdded20fc7f req-4644577f-f6cd-47cb-9260-429baaef2773 tempest-VolumesSnapshotsTestJSON-885180718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-eae92c75-d4bc-4e26-863f-a2fe40892b63 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:12:42 devstack sudo[93579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-eae92c75-d4bc-4e26-863f-a2fe40892b63 Apr 29 15:12:42 devstack sudo[93579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:12:42 devstack sudo[93579]: pam_unix(sudo:session): session closed for user root Apr 29 15:12:42 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-76c93b85-1555-4957-8434-9bdded20fc7f req-4644577f-f6cd-47cb-9260-429baaef2773 tempest-VolumesSnapshotsTestJSON-885180718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-eae92c75-d4bc-4e26-863f-a2fe40892b63" returned: 0 in 0.655s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:12:42 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [req-76c93b85-1555-4957-8434-9bdded20fc7f req-4644577f-f6cd-47cb-9260-429baaef2773 tempest-VolumesSnapshotsTestJSON-885180718 None] <== create_volume: return (1686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:12:42 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-76c93b85-1555-4957-8434-9bdded20fc7f req-4644577f-f6cd-47cb-9260-429baaef2773 tempest-VolumesSnapshotsTestJSON-885180718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.690s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:12:42 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-76c93b85-1555-4957-8434-9bdded20fc7f req-4644577f-f6cd-47cb-9260-429baaef2773 tempest-VolumesSnapshotsTestJSON-885180718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00660bb0-3793-4ebc-9d62-a350bb728519) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eae92c75-d4bc-4e26-863f-a2fe40892b63', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:12:42 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-76c93b85-1555-4957-8434-9bdded20fc7f req-4644577f-f6cd-47cb-9260-429baaef2773 tempest-VolumesSnapshotsTestJSON-885180718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dd2e4f4-3e85-4112-ac7e-af0d6aadbd42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:12:42 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [req-76c93b85-1555-4957-8434-9bdded20fc7f req-4644577f-f6cd-47cb-9260-429baaef2773 tempest-VolumesSnapshotsTestJSON-885180718 None] Volume volume-eae92c75-d4bc-4e26-863f-a2fe40892b63 (eae92c75-d4bc-4e26-863f-a2fe40892b63): created successfully Apr 29 15:12:42 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-76c93b85-1555-4957-8434-9bdded20fc7f req-4644577f-f6cd-47cb-9260-429baaef2773 tempest-VolumesSnapshotsTestJSON-885180718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dd2e4f4-3e85-4112-ac7e-af0d6aadbd42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:12:42 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-76c93b85-1555-4957-8434-9bdded20fc7f req-4644577f-f6cd-47cb-9260-429baaef2773 tempest-VolumesSnapshotsTestJSON-885180718 None] Flow 'volume_create_manager' (f994ad2b-17a4-4cf9-a46c-47dfe8f6a2ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:12:42 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-76c93b85-1555-4957-8434-9bdded20fc7f req-4644577f-f6cd-47cb-9260-429baaef2773 tempest-VolumesSnapshotsTestJSON-885180718 None] Created volume successfully. Apr 29 15:12:44 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-011730a5-2f31-41e5-a509-f815bd2f41e7 req-3070cdff-4046-403c-b571-95fed6c12c84 tempest-VolumesSnapshotsTestJSON-885180718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:12:44 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-011730a5-2f31-41e5-a509-f815bd2f41e7 req-3070cdff-4046-403c-b571-95fed6c12c84 tempest-VolumesSnapshotsTestJSON-885180718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:12:44 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [req-011730a5-2f31-41e5-a509-f815bd2f41e7 req-3070cdff-4046-403c-b571-95fed6c12c84 tempest-VolumesSnapshotsTestJSON-885180718 None] Creating offline snapshot d81f6844-b7fd-44f5-8928-70c4fc1d5961 of volume eae92c75-d4bc-4e26-863f-a2fe40892b63 {{(pid=84448) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 15:12:44 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[6625b174-fe34-4d05-b842-1ff4be89ca66]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:12:44 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-011730a5-2f31-41e5-a509-f815bd2f41e7 req-3070cdff-4046-403c-b571-95fed6c12c84 tempest-VolumesSnapshotsTestJSON-885180718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-eae92c75-d4bc-4e26-863f-a2fe40892b63 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:12:44 devstack sudo[93584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-eae92c75-d4bc-4e26-863f-a2fe40892b63 Apr 29 15:12:44 devstack sudo[93584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:12:44 devstack sudo[93584]: pam_unix(sudo:session): session closed for user root Apr 29 15:12:44 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-011730a5-2f31-41e5-a509-f815bd2f41e7 req-3070cdff-4046-403c-b571-95fed6c12c84 tempest-VolumesSnapshotsTestJSON-885180718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-eae92c75-d4bc-4e26-863f-a2fe40892b63" returned: 0 in 0.742s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:12:44 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-011730a5-2f31-41e5-a509-f815bd2f41e7 req-3070cdff-4046-403c-b571-95fed6c12c84 tempest-VolumesSnapshotsTestJSON-885180718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-eae92c75-d4bc-4e26-863f-a2fe40892b63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-eae92c75-d4bc-4e26-863f-a2fe40892b63.d81f6844-b7fd-44f5-8928-70c4fc1d5961 1G {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:12:44 devstack sudo[93595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-eae92c75-d4bc-4e26-863f-a2fe40892b63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-eae92c75-d4bc-4e26-863f-a2fe40892b63.d81f6844-b7fd-44f5-8928-70c4fc1d5961 1G Apr 29 15:12:44 devstack sudo[93595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:12:45 devstack sudo[93595]: pam_unix(sudo:session): session closed for user root Apr 29 15:12:45 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-011730a5-2f31-41e5-a509-f815bd2f41e7 req-3070cdff-4046-403c-b571-95fed6c12c84 tempest-VolumesSnapshotsTestJSON-885180718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-eae92c75-d4bc-4e26-863f-a2fe40892b63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-eae92c75-d4bc-4e26-863f-a2fe40892b63.d81f6844-b7fd-44f5-8928-70c4fc1d5961 1G" returned: 0 in 0.750s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:12:45 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-011730a5-2f31-41e5-a509-f815bd2f41e7 req-3070cdff-4046-403c-b571-95fed6c12c84 tempest-VolumesSnapshotsTestJSON-885180718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eae92c75-d4bc-4e26-863f-a2fe40892b63 -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-eae92c75-d4bc-4e26-863f-a2fe40892b63.d81f6844-b7fd-44f5-8928-70c4fc1d5961 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:12:45 devstack sudo[93600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eae92c75-d4bc-4e26-863f-a2fe40892b63 -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-eae92c75-d4bc-4e26-863f-a2fe40892b63.d81f6844-b7fd-44f5-8928-70c4fc1d5961 Apr 29 15:12:45 devstack sudo[93600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:12:46 devstack sudo[93600]: pam_unix(sudo:session): session closed for user root Apr 29 15:12:46 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-011730a5-2f31-41e5-a509-f815bd2f41e7 req-3070cdff-4046-403c-b571-95fed6c12c84 tempest-VolumesSnapshotsTestJSON-885180718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eae92c75-d4bc-4e26-863f-a2fe40892b63 -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-eae92c75-d4bc-4e26-863f-a2fe40892b63.d81f6844-b7fd-44f5-8928-70c4fc1d5961" returned: 0 in 0.818s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:12:46 devstack cinder-volume[84448]: WARNING cinder.volume.drivers.remotefs [req-011730a5-2f31-41e5-a509-f815bd2f41e7 req-3070cdff-4046-403c-b571-95fed6c12c84 tempest-VolumesSnapshotsTestJSON-885180718 None] /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-eae92c75-d4bc-4e26-863f-a2fe40892b63.d81f6844-b7fd-44f5-8928-70c4fc1d5961 is being set with open permissions: ugo+rw Apr 29 15:12:46 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-011730a5-2f31-41e5-a509-f815bd2f41e7 req-3070cdff-4046-403c-b571-95fed6c12c84 tempest-VolumesSnapshotsTestJSON-885180718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-eae92c75-d4bc-4e26-863f-a2fe40892b63.d81f6844-b7fd-44f5-8928-70c4fc1d5961 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:12:46 devstack sudo[93631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-eae92c75-d4bc-4e26-863f-a2fe40892b63.d81f6844-b7fd-44f5-8928-70c4fc1d5961 Apr 29 15:12:46 devstack sudo[93631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:12:47 devstack sudo[93631]: pam_unix(sudo:session): session closed for user root Apr 29 15:12:47 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-011730a5-2f31-41e5-a509-f815bd2f41e7 req-3070cdff-4046-403c-b571-95fed6c12c84 tempest-VolumesSnapshotsTestJSON-885180718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-eae92c75-d4bc-4e26-863f-a2fe40892b63.d81f6844-b7fd-44f5-8928-70c4fc1d5961" returned: 0 in 0.811s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:12:47 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-011730a5-2f31-41e5-a509-f815bd2f41e7 req-3070cdff-4046-403c-b571-95fed6c12c84 tempest-VolumesSnapshotsTestJSON-885180718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-eae92c75-d4bc-4e26-863f-a2fe40892b63.info {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:12:47 devstack sudo[93644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-eae92c75-d4bc-4e26-863f-a2fe40892b63.info Apr 29 15:12:47 devstack sudo[93644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:12:47 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-bd04c8a5-81cc-44a9-8be2-2c03890895a2 req-d686c13c-5c64-4c21-9c82-4dd91baf638b tempest-ServerActionsTestOtherB-242761823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:12:48 devstack sudo[93644]: pam_unix(sudo:session): session closed for user root Apr 29 15:12:48 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-011730a5-2f31-41e5-a509-f815bd2f41e7 req-3070cdff-4046-403c-b571-95fed6c12c84 tempest-VolumesSnapshotsTestJSON-885180718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-eae92c75-d4bc-4e26-863f-a2fe40892b63.info" returned: 0 in 0.827s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:12:48 devstack cinder-volume[84448]: WARNING cinder.volume.drivers.remotefs [req-011730a5-2f31-41e5-a509-f815bd2f41e7 req-3070cdff-4046-403c-b571-95fed6c12c84 tempest-VolumesSnapshotsTestJSON-885180718 None] /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-eae92c75-d4bc-4e26-863f-a2fe40892b63.info is being set with open permissions: ugo+rw Apr 29 15:12:48 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-011730a5-2f31-41e5-a509-f815bd2f41e7 req-3070cdff-4046-403c-b571-95fed6c12c84 tempest-VolumesSnapshotsTestJSON-885180718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-eae92c75-d4bc-4e26-863f-a2fe40892b63.info {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:12:48 devstack sudo[93658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-eae92c75-d4bc-4e26-863f-a2fe40892b63.info Apr 29 15:12:48 devstack sudo[93658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:12:48 devstack sudo[93658]: pam_unix(sudo:session): session closed for user root Apr 29 15:12:48 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-011730a5-2f31-41e5-a509-f815bd2f41e7 req-3070cdff-4046-403c-b571-95fed6c12c84 tempest-VolumesSnapshotsTestJSON-885180718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-eae92c75-d4bc-4e26-863f-a2fe40892b63.info" returned: 0 in 0.673s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:12:48 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-011730a5-2f31-41e5-a509-f815bd2f41e7 req-3070cdff-4046-403c-b571-95fed6c12c84 tempest-VolumesSnapshotsTestJSON-885180718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.739s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:12:48 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-bd04c8a5-81cc-44a9-8be2-2c03890895a2 req-d686c13c-5c64-4c21-9c82-4dd91baf638b tempest-ServerActionsTestOtherB-242761823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.046s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:12:48 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39a977f-e60d-4837-94f2-f99b13f29e30]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:12:48 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-bd04c8a5-81cc-44a9-8be2-2c03890895a2 req-d686c13c-5c64-4c21-9c82-4dd91baf638b tempest-ServerActionsTestOtherB-242761823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2dec142d-c8b2-4d90-aab1-d8cd5b0b5ed3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:12:48 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-011730a5-2f31-41e5-a509-f815bd2f41e7 req-3070cdff-4046-403c-b571-95fed6c12c84 tempest-VolumesSnapshotsTestJSON-885180718 None] Create snapshot completed successfully Apr 29 15:12:48 devstack sudo[93662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2dec142d-c8b2-4d90-aab1-d8cd5b0b5ed3 Apr 29 15:12:48 devstack sudo[93662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:12:49 devstack cinder-volume[84448]: DEBUG cinder.coordination [req-2fa84680-d847-4cb9-853a-70887bd3d16b req-19634987-7b5a-4ccd-ab88-c804d137bf59 tempest-VolumesSnapshotsTestJSON-885180718 None] Acquiring lock "cinder-d81f6844-b7fd-44f5-8928-70c4fc1d5961-delete_snapshot" by "delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:12:49 devstack cinder-volume[84448]: DEBUG cinder.coordination [req-2fa84680-d847-4cb9-853a-70887bd3d16b req-19634987-7b5a-4ccd-ab88-c804d137bf59 tempest-VolumesSnapshotsTestJSON-885180718 None] Lock "cinder-d81f6844-b7fd-44f5-8928-70c4fc1d5961-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:12:49 devstack cinder-volume[84448]: DEBUG cinder.coordination [req-2fa84680-d847-4cb9-853a-70887bd3d16b req-19634987-7b5a-4ccd-ab88-c804d137bf59 tempest-VolumesSnapshotsTestJSON-885180718 None] Acquiring lock "cinder-quobyte-eae92c75-d4bc-4e26-863f-a2fe40892b63" by "delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:12:49 devstack cinder-volume[84448]: DEBUG cinder.coordination [req-2fa84680-d847-4cb9-853a-70887bd3d16b req-19634987-7b5a-4ccd-ab88-c804d137bf59 tempest-VolumesSnapshotsTestJSON-885180718 None] Lock "cinder-quobyte-eae92c75-d4bc-4e26-863f-a2fe40892b63" acquired by "delete_snapshot" :: waited 0.017s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:12:49 devstack cinder-volume[84448]: DEBUG cinder.coordination [req-2fa84680-d847-4cb9-853a-70887bd3d16b req-19634987-7b5a-4ccd-ab88-c804d137bf59 tempest-VolumesSnapshotsTestJSON-885180718 None] Acquiring lock "cinder-quobyte-d81f6844-b7fd-44f5-8928-70c4fc1d5961" by "_delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:12:49 devstack cinder-volume[84448]: DEBUG cinder.coordination [req-2fa84680-d847-4cb9-853a-70887bd3d16b req-19634987-7b5a-4ccd-ab88-c804d137bf59 tempest-VolumesSnapshotsTestJSON-885180718 None] Lock "cinder-quobyte-d81f6844-b7fd-44f5-8928-70c4fc1d5961" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:12:49 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [req-2fa84680-d847-4cb9-853a-70887bd3d16b req-19634987-7b5a-4ccd-ab88-c804d137bf59 tempest-VolumesSnapshotsTestJSON-885180718 None] Deleting offline snapshot d81f6844-b7fd-44f5-8928-70c4fc1d5961 of volume eae92c75-d4bc-4e26-863f-a2fe40892b63 {{(pid=84448) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 15:12:49 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [req-2fa84680-d847-4cb9-853a-70887bd3d16b req-19634987-7b5a-4ccd-ab88-c804d137bf59 tempest-VolumesSnapshotsTestJSON-885180718 None] snapshot_file for this snap is: volume-eae92c75-d4bc-4e26-863f-a2fe40892b63.d81f6844-b7fd-44f5-8928-70c4fc1d5961 {{(pid=84448) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 15:12:49 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d4b7bd-f429-4c79-b9e1-9eaae8df28a7]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:12:49 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-2fa84680-d847-4cb9-853a-70887bd3d16b req-19634987-7b5a-4ccd-ab88-c804d137bf59 tempest-VolumesSnapshotsTestJSON-885180718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-eae92c75-d4bc-4e26-863f-a2fe40892b63.d81f6844-b7fd-44f5-8928-70c4fc1d5961 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:12:49 devstack sudo[93664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-eae92c75-d4bc-4e26-863f-a2fe40892b63.d81f6844-b7fd-44f5-8928-70c4fc1d5961 Apr 29 15:12:49 devstack sudo[93664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:12:49 devstack sudo[93662]: pam_unix(sudo:session): session closed for user root Apr 29 15:12:49 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-bd04c8a5-81cc-44a9-8be2-2c03890895a2 req-d686c13c-5c64-4c21-9c82-4dd91baf638b tempest-ServerActionsTestOtherB-242761823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2dec142d-c8b2-4d90-aab1-d8cd5b0b5ed3" returned: 0 in 0.719s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:12:49 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-bd04c8a5-81cc-44a9-8be2-2c03890895a2 req-d686c13c-5c64-4c21-9c82-4dd91baf638b tempest-ServerActionsTestOtherB-242761823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.740s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:12:49 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-bd04c8a5-81cc-44a9-8be2-2c03890895a2 req-d686c13c-5c64-4c21-9c82-4dd91baf638b tempest-ServerActionsTestOtherB-242761823 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a', 'name': 'volume-2dec142d-c8b2-4d90-aab1-d8cd5b0b5ed3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '76b0fd04-4b8c-4b71-9b4c-65c3cd3b1aea', 'enforce_multipath': True} {{(pid=84448) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 15:12:49 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-bd04c8a5-81cc-44a9-8be2-2c03890895a2 req-d686c13c-5c64-4c21-9c82-4dd91baf638b tempest-ServerActionsTestOtherB-242761823 None] attachment_update completed successfully. Apr 29 15:12:50 devstack sudo[93664]: pam_unix(sudo:session): session closed for user root Apr 29 15:12:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-2fa84680-d847-4cb9-853a-70887bd3d16b req-19634987-7b5a-4ccd-ab88-c804d137bf59 tempest-VolumesSnapshotsTestJSON-885180718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-eae92c75-d4bc-4e26-863f-a2fe40892b63.d81f6844-b7fd-44f5-8928-70c4fc1d5961" returned: 0 in 0.794s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:12:50 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [req-2fa84680-d847-4cb9-853a-70887bd3d16b req-19634987-7b5a-4ccd-ab88-c804d137bf59 tempest-VolumesSnapshotsTestJSON-885180718 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eae92c75-d4bc-4e26-863f-a2fe40892b63(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84448) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 15:12:50 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49776e6-ac18-417f-af04-a006486f1449]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:12:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-2fa84680-d847-4cb9-853a-70887bd3d16b req-19634987-7b5a-4ccd-ab88-c804d137bf59 tempest-VolumesSnapshotsTestJSON-885180718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-eae92c75-d4bc-4e26-863f-a2fe40892b63 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:12:50 devstack sudo[93672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-eae92c75-d4bc-4e26-863f-a2fe40892b63 Apr 29 15:12:50 devstack sudo[93672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:12:50 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-30875697-7fca-47e4-b73e-ace2363175e5 req-6a649035-7baf-403a-bb84-7523b5653672 tempest-ServerStableDeviceRescueTest-87139885 None] Terminate volume connection completed successfully. Apr 29 15:12:50 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-30875697-7fca-47e4-b73e-ace2363175e5 req-6a649035-7baf-403a-bb84-7523b5653672 tempest-ServerStableDeviceRescueTest-87139885 None] Deleting attachment 813d0231-4d6d-4dce-9c59-a51331d651f5. {{(pid=84448) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 15:12:50 devstack sudo[93672]: pam_unix(sudo:session): session closed for user root Apr 29 15:12:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-2fa84680-d847-4cb9-853a-70887bd3d16b req-19634987-7b5a-4ccd-ab88-c804d137bf59 tempest-VolumesSnapshotsTestJSON-885180718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-eae92c75-d4bc-4e26-863f-a2fe40892b63" returned: 0 in 0.781s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:12:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-2fa84680-d847-4cb9-853a-70887bd3d16b req-19634987-7b5a-4ccd-ab88-c804d137bf59 tempest-VolumesSnapshotsTestJSON-885180718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-eae92c75-d4bc-4e26-863f-a2fe40892b63.d81f6844-b7fd-44f5-8928-70c4fc1d5961 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:12:50 devstack sudo[93685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-eae92c75-d4bc-4e26-863f-a2fe40892b63.d81f6844-b7fd-44f5-8928-70c4fc1d5961 Apr 29 15:12:50 devstack sudo[93685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:12:51 devstack sudo[93685]: pam_unix(sudo:session): session closed for user root Apr 29 15:12:51 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-2fa84680-d847-4cb9-853a-70887bd3d16b req-19634987-7b5a-4ccd-ab88-c804d137bf59 tempest-VolumesSnapshotsTestJSON-885180718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-eae92c75-d4bc-4e26-863f-a2fe40892b63.d81f6844-b7fd-44f5-8928-70c4fc1d5961" returned: 0 in 0.716s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:12:51 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-2fa84680-d847-4cb9-853a-70887bd3d16b req-19634987-7b5a-4ccd-ab88-c804d137bf59 tempest-VolumesSnapshotsTestJSON-885180718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-eae92c75-d4bc-4e26-863f-a2fe40892b63.d81f6844-b7fd-44f5-8928-70c4fc1d5961 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:12:51 devstack sudo[93690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-eae92c75-d4bc-4e26-863f-a2fe40892b63.d81f6844-b7fd-44f5-8928-70c4fc1d5961 Apr 29 15:12:51 devstack sudo[93690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:12:52 devstack sudo[93690]: pam_unix(sudo:session): session closed for user root Apr 29 15:12:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-2fa84680-d847-4cb9-853a-70887bd3d16b req-19634987-7b5a-4ccd-ab88-c804d137bf59 tempest-VolumesSnapshotsTestJSON-885180718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-eae92c75-d4bc-4e26-863f-a2fe40892b63.d81f6844-b7fd-44f5-8928-70c4fc1d5961" returned: 0 in 0.613s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:12:52 devstack cinder-volume[84448]: DEBUG cinder.coordination [req-2fa84680-d847-4cb9-853a-70887bd3d16b req-19634987-7b5a-4ccd-ab88-c804d137bf59 tempest-VolumesSnapshotsTestJSON-885180718 None] Lock "cinder-quobyte-d81f6844-b7fd-44f5-8928-70c4fc1d5961" released by "_delete_snapshot" :: held 3.021s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:12:52 devstack cinder-volume[84448]: DEBUG cinder.coordination [req-2fa84680-d847-4cb9-853a-70887bd3d16b req-19634987-7b5a-4ccd-ab88-c804d137bf59 tempest-VolumesSnapshotsTestJSON-885180718 None] Lock "cinder-quobyte-eae92c75-d4bc-4e26-863f-a2fe40892b63" released by "delete_snapshot" :: held 3.047s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:12:52 devstack cinder-volume[84448]: WARNING cinder.quota [req-2fa84680-d847-4cb9-853a-70887bd3d16b req-19634987-7b5a-4ccd-ab88-c804d137bf59 tempest-VolumesSnapshotsTestJSON-885180718 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 29 15:12:52 devstack cinder-volume[84448]: DEBUG cinder.quota [req-2fa84680-d847-4cb9-853a-70887bd3d16b req-19634987-7b5a-4ccd-ab88-c804d137bf59 tempest-VolumesSnapshotsTestJSON-885180718 None] Created reservations ['c85d0ea6-dc84-45d3-b0f6-dd948d1e9ad1', '596a5d65-6dee-4a37-aede-1ce5d54e770f', '0d6d56a5-d2f1-4a05-9135-11fc1e08a65b', '3389ae70-92ce-4002-84f1-6a4ed4eed912'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:12:52 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-2fa84680-d847-4cb9-853a-70887bd3d16b req-19634987-7b5a-4ccd-ab88-c804d137bf59 tempest-VolumesSnapshotsTestJSON-885180718 None] Delete snapshot completed successfully. Apr 29 15:12:52 devstack cinder-volume[84448]: DEBUG cinder.coordination [req-2fa84680-d847-4cb9-853a-70887bd3d16b req-19634987-7b5a-4ccd-ab88-c804d137bf59 tempest-VolumesSnapshotsTestJSON-885180718 None] Lock "cinder-d81f6844-b7fd-44f5-8928-70c4fc1d5961-delete_snapshot" released by "delete_snapshot" :: held 3.284s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:12:52 devstack cinder-volume[84448]: DEBUG cinder.coordination [req-836e3740-8830-4098-821a-c4949ae10056 req-0a31f490-51d3-4c4f-a8ca-52dafcf75923 tempest-VolumesSnapshotsTestJSON-885180718 None] Acquiring lock "cinder-eae92c75-d4bc-4e26-863f-a2fe40892b63-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:12:52 devstack cinder-volume[84448]: DEBUG cinder.coordination [req-836e3740-8830-4098-821a-c4949ae10056 req-0a31f490-51d3-4c4f-a8ca-52dafcf75923 tempest-VolumesSnapshotsTestJSON-885180718 None] Lock "cinder-eae92c75-d4bc-4e26-863f-a2fe40892b63-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:12:52 devstack cinder-volume[84448]: DEBUG cinder.coordination [req-836e3740-8830-4098-821a-c4949ae10056 req-0a31f490-51d3-4c4f-a8ca-52dafcf75923 tempest-VolumesSnapshotsTestJSON-885180718 None] Acquiring lock "cinder-quobyte-eae92c75-d4bc-4e26-863f-a2fe40892b63" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:12:52 devstack cinder-volume[84448]: DEBUG cinder.coordination [req-836e3740-8830-4098-821a-c4949ae10056 req-0a31f490-51d3-4c4f-a8ca-52dafcf75923 tempest-VolumesSnapshotsTestJSON-885180718 None] Lock "cinder-quobyte-eae92c75-d4bc-4e26-863f-a2fe40892b63" acquired by "delete_volume" :: waited 0.017s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:12:52 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[628bffae-156c-4b11-8e45-29be61a945c9]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:12:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-836e3740-8830-4098-821a-c4949ae10056 req-0a31f490-51d3-4c4f-a8ca-52dafcf75923 tempest-VolumesSnapshotsTestJSON-885180718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-eae92c75-d4bc-4e26-863f-a2fe40892b63 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:12:52 devstack sudo[93697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-eae92c75-d4bc-4e26-863f-a2fe40892b63 Apr 29 15:12:52 devstack sudo[93697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:12:53 devstack sudo[93697]: pam_unix(sudo:session): session closed for user root Apr 29 15:12:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-836e3740-8830-4098-821a-c4949ae10056 req-0a31f490-51d3-4c4f-a8ca-52dafcf75923 tempest-VolumesSnapshotsTestJSON-885180718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-eae92c75-d4bc-4e26-863f-a2fe40892b63" returned: 0 in 0.742s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:12:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-836e3740-8830-4098-821a-c4949ae10056 req-0a31f490-51d3-4c4f-a8ca-52dafcf75923 tempest-VolumesSnapshotsTestJSON-885180718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-eae92c75-d4bc-4e26-863f-a2fe40892b63 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:12:53 devstack sudo[93709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-eae92c75-d4bc-4e26-863f-a2fe40892b63 Apr 29 15:12:53 devstack sudo[93709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:12:54 devstack sudo[93709]: pam_unix(sudo:session): session closed for user root Apr 29 15:12:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-836e3740-8830-4098-821a-c4949ae10056 req-0a31f490-51d3-4c4f-a8ca-52dafcf75923 tempest-VolumesSnapshotsTestJSON-885180718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-eae92c75-d4bc-4e26-863f-a2fe40892b63" returned: 0 in 1.254s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:12:54 devstack cinder-volume[84448]: DEBUG cinder.coordination [req-836e3740-8830-4098-821a-c4949ae10056 req-0a31f490-51d3-4c4f-a8ca-52dafcf75923 tempest-VolumesSnapshotsTestJSON-885180718 None] Lock "cinder-quobyte-eae92c75-d4bc-4e26-863f-a2fe40892b63" released by "delete_volume" :: held 2.094s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:12:55 devstack cinder-volume[84448]: DEBUG cinder.quota [req-836e3740-8830-4098-821a-c4949ae10056 req-0a31f490-51d3-4c4f-a8ca-52dafcf75923 tempest-VolumesSnapshotsTestJSON-885180718 None] Created reservations ['34758fc1-609c-4800-8606-9a3189e77271', 'c6207497-0937-4164-84ae-20e4b471d8b6', 'b62a9d3b-5f6b-4bbb-94fa-716782de7e48', '01efca9c-56a7-4425-bcbc-361fd1a30476'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:12:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-836e3740-8830-4098-821a-c4949ae10056 req-0a31f490-51d3-4c4f-a8ca-52dafcf75923 tempest-VolumesSnapshotsTestJSON-885180718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:12:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-836e3740-8830-4098-821a-c4949ae10056 req-0a31f490-51d3-4c4f-a8ca-52dafcf75923 tempest-VolumesSnapshotsTestJSON-885180718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:12:55 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [req-836e3740-8830-4098-821a-c4949ae10056 req-0a31f490-51d3-4c4f-a8ca-52dafcf75923 tempest-VolumesSnapshotsTestJSON-885180718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:12:55 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [req-836e3740-8830-4098-821a-c4949ae10056 req-0a31f490-51d3-4c4f-a8ca-52dafcf75923 tempest-VolumesSnapshotsTestJSON-885180718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:12:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-836e3740-8830-4098-821a-c4949ae10056 req-0a31f490-51d3-4c4f-a8ca-52dafcf75923 tempest-VolumesSnapshotsTestJSON-885180718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:12:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-836e3740-8830-4098-821a-c4949ae10056 req-0a31f490-51d3-4c4f-a8ca-52dafcf75923 tempest-VolumesSnapshotsTestJSON-885180718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:12:55 devstack sudo[93831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:12:55 devstack sudo[93831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:12:56 devstack sudo[93831]: pam_unix(sudo:session): session closed for user root Apr 29 15:12:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-836e3740-8830-4098-821a-c4949ae10056 req-0a31f490-51d3-4c4f-a8ca-52dafcf75923 tempest-VolumesSnapshotsTestJSON-885180718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 1.102s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:12:56 devstack cinder-volume[84448]: DEBUG cinder.manager [req-836e3740-8830-4098-821a-c4949ae10056 req-0a31f490-51d3-4c4f-a8ca-52dafcf75923 tempest-VolumesSnapshotsTestJSON-885180718 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:12:56 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-836e3740-8830-4098-821a-c4949ae10056 req-0a31f490-51d3-4c4f-a8ca-52dafcf75923 tempest-VolumesSnapshotsTestJSON-885180718 None] Deleted volume successfully. Apr 29 15:12:56 devstack cinder-volume[84448]: DEBUG cinder.coordination [req-836e3740-8830-4098-821a-c4949ae10056 req-0a31f490-51d3-4c4f-a8ca-52dafcf75923 tempest-VolumesSnapshotsTestJSON-885180718 None] Lock "cinder-eae92c75-d4bc-4e26-863f-a2fe40892b63-delete_volume" released by "delete_volume" :: held 3.845s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:13:02 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-3c250359-a2f9-4c76-b082-fcf3e540584f tempest-BackendsCapabilitiesAdminTestsJSON-72731378 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.583583831787, 'free_capacity_gb': 1775.583583831787, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=84448) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 29 15:13:02 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-5cd8790c-16eb-48ed-8284-499f838a0d22 tempest-BackendsCapabilitiesAdminTestsJSON-72731378 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.583583831787, 'free_capacity_gb': 1775.583583831787, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=84448) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 29 15:13:03 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-5c0826a3-00d6-492b-b61b-1fc401ea6deb req-0db6b148-016f-451b-85f9-504c1c4ea4fd tempest-ServerActionsTestOtherB-242761823 None] Terminate volume connection completed successfully. Apr 29 15:13:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-5c0826a3-00d6-492b-b61b-1fc401ea6deb req-0db6b148-016f-451b-85f9-504c1c4ea4fd tempest-ServerActionsTestOtherB-242761823 None] Deleting attachment 76b0fd04-4b8c-4b71-9b4c-65c3cd3b1aea. {{(pid=84448) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 15:13:03 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-628dbce2-93d1-42c8-9e2f-f926e73e5815 tempest-ServerStableDeviceRescueTest-87139885 None] Acquiring lock "cinder-cd41dddb-f750-45ae-b1a9-8e0c2045838b-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:13:03 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-628dbce2-93d1-42c8-9e2f-f926e73e5815 tempest-ServerStableDeviceRescueTest-87139885 None] Lock "cinder-cd41dddb-f750-45ae-b1a9-8e0c2045838b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:13:03 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-628dbce2-93d1-42c8-9e2f-f926e73e5815 tempest-ServerStableDeviceRescueTest-87139885 None] Acquiring lock "cinder-quobyte-cd41dddb-f750-45ae-b1a9-8e0c2045838b" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:13:03 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-628dbce2-93d1-42c8-9e2f-f926e73e5815 tempest-ServerStableDeviceRescueTest-87139885 None] Lock "cinder-quobyte-cd41dddb-f750-45ae-b1a9-8e0c2045838b" acquired by "delete_volume" :: waited 0.014s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:13:03 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4bb8aec-6f94-4edd-a61e-ff95e3ddd8b0]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:13:03 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-628dbce2-93d1-42c8-9e2f-f926e73e5815 tempest-ServerStableDeviceRescueTest-87139885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cd41dddb-f750-45ae-b1a9-8e0c2045838b {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:13:03 devstack sudo[93947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cd41dddb-f750-45ae-b1a9-8e0c2045838b Apr 29 15:13:03 devstack sudo[93947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:13:04 devstack sudo[93947]: pam_unix(sudo:session): session closed for user root Apr 29 15:13:04 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-628dbce2-93d1-42c8-9e2f-f926e73e5815 tempest-ServerStableDeviceRescueTest-87139885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cd41dddb-f750-45ae-b1a9-8e0c2045838b" returned: 0 in 0.943s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:13:04 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-628dbce2-93d1-42c8-9e2f-f926e73e5815 tempest-ServerStableDeviceRescueTest-87139885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cd41dddb-f750-45ae-b1a9-8e0c2045838b {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:13:04 devstack sudo[93953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cd41dddb-f750-45ae-b1a9-8e0c2045838b Apr 29 15:13:04 devstack sudo[93953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:13:05 devstack sudo[93953]: pam_unix(sudo:session): session closed for user root Apr 29 15:13:05 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-628dbce2-93d1-42c8-9e2f-f926e73e5815 tempest-ServerStableDeviceRescueTest-87139885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cd41dddb-f750-45ae-b1a9-8e0c2045838b" returned: 0 in 0.713s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:13:05 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-628dbce2-93d1-42c8-9e2f-f926e73e5815 tempest-ServerStableDeviceRescueTest-87139885 None] Lock "cinder-quobyte-cd41dddb-f750-45ae-b1a9-8e0c2045838b" released by "delete_volume" :: held 1.719s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:13:05 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:SELECT=55,cinder:UPDATE=40,cinder:DELETE=4,cinder:INSERT=10 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:13:05 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:UPDATE=50,cinder:SELECT=48,cinder:INSERT=10,cinder:DELETE=3 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:13:05 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-628dbce2-93d1-42c8-9e2f-f926e73e5815 tempest-ServerStableDeviceRescueTest-87139885 None] Created reservations ['eab93ea9-d6a2-4412-b68f-571247933d66', '7b21a898-4165-453b-9733-1dc50dcd1fad', '078f9052-5bd1-4c9c-a428-64bdb433d899', '39afc526-6904-4a50-a9bd-25bbb2c67a55'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:13:05 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-628dbce2-93d1-42c8-9e2f-f926e73e5815 tempest-ServerStableDeviceRescueTest-87139885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:13:05 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-628dbce2-93d1-42c8-9e2f-f926e73e5815 tempest-ServerStableDeviceRescueTest-87139885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:13:05 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-628dbce2-93d1-42c8-9e2f-f926e73e5815 tempest-ServerStableDeviceRescueTest-87139885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:13:05 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-628dbce2-93d1-42c8-9e2f-f926e73e5815 tempest-ServerStableDeviceRescueTest-87139885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:13:05 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-628dbce2-93d1-42c8-9e2f-f926e73e5815 tempest-ServerStableDeviceRescueTest-87139885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:13:05 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-628dbce2-93d1-42c8-9e2f-f926e73e5815 tempest-ServerStableDeviceRescueTest-87139885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:13:05 devstack sudo[93959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:13:05 devstack sudo[93959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:13:06 devstack sudo[93959]: pam_unix(sudo:session): session closed for user root Apr 29 15:13:06 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-628dbce2-93d1-42c8-9e2f-f926e73e5815 tempest-ServerStableDeviceRescueTest-87139885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.814s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:13:06 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-628dbce2-93d1-42c8-9e2f-f926e73e5815 tempest-ServerStableDeviceRescueTest-87139885 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:13:06 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-628dbce2-93d1-42c8-9e2f-f926e73e5815 tempest-ServerStableDeviceRescueTest-87139885 None] Deleted volume successfully. Apr 29 15:13:06 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-628dbce2-93d1-42c8-9e2f-f926e73e5815 tempest-ServerStableDeviceRescueTest-87139885 None] Lock "cinder-cd41dddb-f750-45ae-b1a9-8e0c2045838b-delete_volume" released by "delete_volume" :: held 2.769s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:13:11 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-5c0826a3-00d6-492b-b61b-1fc401ea6deb req-895946d9-7e36-4811-8d5e-83849d0dcc1f tempest-ServerActionsTestOtherB-242761823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:13:11 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-5c0826a3-00d6-492b-b61b-1fc401ea6deb req-895946d9-7e36-4811-8d5e-83849d0dcc1f tempest-ServerActionsTestOtherB-242761823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:13:11 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b3ae2f-3176-4c99-896c-707747f2d4ff]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:13:11 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-5c0826a3-00d6-492b-b61b-1fc401ea6deb req-895946d9-7e36-4811-8d5e-83849d0dcc1f tempest-ServerActionsTestOtherB-242761823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2dec142d-c8b2-4d90-aab1-d8cd5b0b5ed3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:13:11 devstack sudo[93972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2dec142d-c8b2-4d90-aab1-d8cd5b0b5ed3 Apr 29 15:13:11 devstack sudo[93972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:13:12 devstack sudo[93972]: pam_unix(sudo:session): session closed for user root Apr 29 15:13:12 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-5c0826a3-00d6-492b-b61b-1fc401ea6deb req-895946d9-7e36-4811-8d5e-83849d0dcc1f tempest-ServerActionsTestOtherB-242761823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2dec142d-c8b2-4d90-aab1-d8cd5b0b5ed3" returned: 0 in 1.025s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:13:12 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-5c0826a3-00d6-492b-b61b-1fc401ea6deb req-895946d9-7e36-4811-8d5e-83849d0dcc1f tempest-ServerActionsTestOtherB-242761823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.059s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:13:12 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-5c0826a3-00d6-492b-b61b-1fc401ea6deb req-895946d9-7e36-4811-8d5e-83849d0dcc1f tempest-ServerActionsTestOtherB-242761823 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a', 'name': 'volume-2dec142d-c8b2-4d90-aab1-d8cd5b0b5ed3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ae5d7a91-3937-4ec7-8dbb-2a6adca843cf', 'enforce_multipath': True} {{(pid=84448) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 15:13:12 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-5c0826a3-00d6-492b-b61b-1fc401ea6deb req-895946d9-7e36-4811-8d5e-83849d0dcc1f tempest-ServerActionsTestOtherB-242761823 None] attachment_update completed successfully. Apr 29 15:13:16 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-a429cbfa-31b8-45fa-b3aa-61bc65e1fc4e tempest-SnapshotsActionsTest-339173462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:13:16 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-a429cbfa-31b8-45fa-b3aa-61bc65e1fc4e tempest-SnapshotsActionsTest-339173462 None] Flow 'volume_create_manager' (029a3584-40ba-42ee-b96b-80e77a82d92b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:13:16 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-a429cbfa-31b8-45fa-b3aa-61bc65e1fc4e tempest-SnapshotsActionsTest-339173462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77bc60d8-96cc-4dc8-99b8-beab65268c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:13:16 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-a429cbfa-31b8-45fa-b3aa-61bc65e1fc4e tempest-SnapshotsActionsTest-339173462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77bc60d8-96cc-4dc8-99b8-beab65268c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:13:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-68538123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daa4a945-abaf-45b3-818e-a0fa9206c6c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33201bbd9d1842aa85c98373dd165341',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:13:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:13:16Z,use_quota=True,user_id='597e063e8b6f4f20ace89aff5f6f8e56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:13:16 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-a429cbfa-31b8-45fa-b3aa-61bc65e1fc4e tempest-SnapshotsActionsTest-339173462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c74a1f1a-81b3-4a79-a2a8-642cfd9d499c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:13:16 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-a429cbfa-31b8-45fa-b3aa-61bc65e1fc4e tempest-SnapshotsActionsTest-339173462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c74a1f1a-81b3-4a79-a2a8-642cfd9d499c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:13:16 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-a429cbfa-31b8-45fa-b3aa-61bc65e1fc4e tempest-SnapshotsActionsTest-339173462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b826ae7-8327-4c4f-870f-9ce59d07e59e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:13:16 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-a429cbfa-31b8-45fa-b3aa-61bc65e1fc4e tempest-SnapshotsActionsTest-339173462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b826ae7-8327-4c4f-870f-9ce59d07e59e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'daa4a945-abaf-45b3-818e-a0fa9206c6c4', 'volume_name': 'volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:13:16 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-a429cbfa-31b8-45fa-b3aa-61bc65e1fc4e tempest-SnapshotsActionsTest-339173462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85d6a687-7a16-4c9b-b1c3-1c662b84f4aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:13:16 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-a429cbfa-31b8-45fa-b3aa-61bc65e1fc4e tempest-SnapshotsActionsTest-339173462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85d6a687-7a16-4c9b-b1c3-1c662b84f4aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:13:16 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-a429cbfa-31b8-45fa-b3aa-61bc65e1fc4e tempest-SnapshotsActionsTest-339173462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6db16af4-d121-4d16-92c1-1da1ac2523f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:13:16 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-a429cbfa-31b8-45fa-b3aa-61bc65e1fc4e tempest-SnapshotsActionsTest-339173462 None] Volume daa4a945-abaf-45b3-818e-a0fa9206c6c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4', 'volume_size': 1} Apr 29 15:13:16 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-a429cbfa-31b8-45fa-b3aa-61bc65e1fc4e tempest-SnapshotsActionsTest-339173462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:13:16 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-a429cbfa-31b8-45fa-b3aa-61bc65e1fc4e tempest-SnapshotsActionsTest-339173462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:13:16 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-a429cbfa-31b8-45fa-b3aa-61bc65e1fc4e tempest-SnapshotsActionsTest-339173462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:13:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-68538123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daa4a945-abaf-45b3-818e-a0fa9206c6c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33201bbd9d1842aa85c98373dd165341',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:13:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:13:16Z,use_quota=True,user_id='597e063e8b6f4f20ace89aff5f6f8e56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:13:16 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-a429cbfa-31b8-45fa-b3aa-61bc65e1fc4e tempest-SnapshotsActionsTest-339173462 None] Creating volume daa4a945-abaf-45b3-818e-a0fa9206c6c4 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:13:16 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-a429cbfa-31b8-45fa-b3aa-61bc65e1fc4e tempest-SnapshotsActionsTest-339173462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:13:16 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-a429cbfa-31b8-45fa-b3aa-61bc65e1fc4e tempest-SnapshotsActionsTest-339173462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:13:16 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-a429cbfa-31b8-45fa-b3aa-61bc65e1fc4e tempest-SnapshotsActionsTest-339173462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:13:16 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-a429cbfa-31b8-45fa-b3aa-61bc65e1fc4e tempest-SnapshotsActionsTest-339173462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:13:16 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-a429cbfa-31b8-45fa-b3aa-61bc65e1fc4e tempest-SnapshotsActionsTest-339173462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:13:16 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-a429cbfa-31b8-45fa-b3aa-61bc65e1fc4e tempest-SnapshotsActionsTest-339173462 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:13:16 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-a429cbfa-31b8-45fa-b3aa-61bc65e1fc4e tempest-SnapshotsActionsTest-339173462 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:13:16 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a429cbfa-31b8-45fa-b3aa-61bc65e1fc4e tempest-SnapshotsActionsTest-339173462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:13:16 devstack sudo[94464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4 1073741824 Apr 29 15:13:16 devstack sudo[94464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:13:17 devstack sudo[94464]: pam_unix(sudo:session): session closed for user root Apr 29 15:13:17 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a429cbfa-31b8-45fa-b3aa-61bc65e1fc4e tempest-SnapshotsActionsTest-339173462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4 1073741824" returned: 0 in 1.248s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:13:17 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a429cbfa-31b8-45fa-b3aa-61bc65e1fc4e tempest-SnapshotsActionsTest-339173462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:13:17 devstack sudo[94474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4 Apr 29 15:13:17 devstack sudo[94474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:13:19 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a429cbfa-31b8-45fa-b3aa-61bc65e1fc4e tempest-SnapshotsActionsTest-339173462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4" returned: 0 in 1.292s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:13:19 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-a429cbfa-31b8-45fa-b3aa-61bc65e1fc4e tempest-SnapshotsActionsTest-339173462 None] <== create_volume: return (2626ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:13:19 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-a429cbfa-31b8-45fa-b3aa-61bc65e1fc4e tempest-SnapshotsActionsTest-339173462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.638s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:13:19 devstack sudo[94474]: pam_unix(sudo:session): session closed for user root Apr 29 15:13:19 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-a429cbfa-31b8-45fa-b3aa-61bc65e1fc4e tempest-SnapshotsActionsTest-339173462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6db16af4-d121-4d16-92c1-1da1ac2523f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:13:19 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-a429cbfa-31b8-45fa-b3aa-61bc65e1fc4e tempest-SnapshotsActionsTest-339173462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efdc52a1-a164-4679-82cc-e04b05cc9627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:13:19 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-a429cbfa-31b8-45fa-b3aa-61bc65e1fc4e tempest-SnapshotsActionsTest-339173462 None] Volume volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4 (daa4a945-abaf-45b3-818e-a0fa9206c6c4): created successfully Apr 29 15:13:19 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-a429cbfa-31b8-45fa-b3aa-61bc65e1fc4e tempest-SnapshotsActionsTest-339173462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efdc52a1-a164-4679-82cc-e04b05cc9627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:13:19 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-a429cbfa-31b8-45fa-b3aa-61bc65e1fc4e tempest-SnapshotsActionsTest-339173462 None] Flow 'volume_create_manager' (029a3584-40ba-42ee-b96b-80e77a82d92b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:13:19 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-a429cbfa-31b8-45fa-b3aa-61bc65e1fc4e tempest-SnapshotsActionsTest-339173462 None] Created volume successfully. Apr 29 15:13:20 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-cb8be83e-6aba-417a-aadb-aade63cf630b tempest-SnapshotsActionsTest-339173462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:13:20 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-cb8be83e-6aba-417a-aadb-aade63cf630b tempest-SnapshotsActionsTest-339173462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:13:20 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-cb8be83e-6aba-417a-aadb-aade63cf630b tempest-SnapshotsActionsTest-339173462 None] Creating offline snapshot f035a011-2e13-433a-8b3a-8685765c9bc8 of volume daa4a945-abaf-45b3-818e-a0fa9206c6c4 {{(pid=84448) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 15:13:20 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[327681ff-8a0d-4f4d-86a9-8cee9be985d8]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:13:20 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cb8be83e-6aba-417a-aadb-aade63cf630b tempest-SnapshotsActionsTest-339173462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:13:20 devstack sudo[94486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4 Apr 29 15:13:20 devstack sudo[94486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:13:21 devstack sudo[94486]: pam_unix(sudo:session): session closed for user root Apr 29 15:13:21 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cb8be83e-6aba-417a-aadb-aade63cf630b tempest-SnapshotsActionsTest-339173462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4" returned: 0 in 1.384s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:13:21 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cb8be83e-6aba-417a-aadb-aade63cf630b tempest-SnapshotsActionsTest-339173462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f035a011-2e13-433a-8b3a-8685765c9bc8 1G {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:13:21 devstack sudo[94576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f035a011-2e13-433a-8b3a-8685765c9bc8 1G Apr 29 15:13:21 devstack sudo[94576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:13:23 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cb8be83e-6aba-417a-aadb-aade63cf630b tempest-SnapshotsActionsTest-339173462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f035a011-2e13-433a-8b3a-8685765c9bc8 1G" returned: 0 in 1.608s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:13:23 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cb8be83e-6aba-417a-aadb-aade63cf630b tempest-SnapshotsActionsTest-339173462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4 -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f035a011-2e13-433a-8b3a-8685765c9bc8 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:13:23 devstack sudo[94576]: pam_unix(sudo:session): session closed for user root Apr 29 15:13:23 devstack sudo[94593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4 -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f035a011-2e13-433a-8b3a-8685765c9bc8 Apr 29 15:13:23 devstack sudo[94593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:13:24 devstack sudo[94593]: pam_unix(sudo:session): session closed for user root Apr 29 15:13:24 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cb8be83e-6aba-417a-aadb-aade63cf630b tempest-SnapshotsActionsTest-339173462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4 -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f035a011-2e13-433a-8b3a-8685765c9bc8" returned: 0 in 1.507s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:13:24 devstack cinder-volume[84448]: WARNING cinder.volume.drivers.remotefs [None req-cb8be83e-6aba-417a-aadb-aade63cf630b tempest-SnapshotsActionsTest-339173462 None] /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f035a011-2e13-433a-8b3a-8685765c9bc8 is being set with open permissions: ugo+rw Apr 29 15:13:24 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cb8be83e-6aba-417a-aadb-aade63cf630b tempest-SnapshotsActionsTest-339173462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f035a011-2e13-433a-8b3a-8685765c9bc8 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:13:24 devstack sudo[94668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f035a011-2e13-433a-8b3a-8685765c9bc8 Apr 29 15:13:24 devstack sudo[94668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:13:25 devstack sudo[94668]: pam_unix(sudo:session): session closed for user root Apr 29 15:13:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cb8be83e-6aba-417a-aadb-aade63cf630b tempest-SnapshotsActionsTest-339173462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f035a011-2e13-433a-8b3a-8685765c9bc8" returned: 0 in 1.287s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:13:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cb8be83e-6aba-417a-aadb-aade63cf630b tempest-SnapshotsActionsTest-339173462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.info {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:13:26 devstack sudo[94682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.info Apr 29 15:13:26 devstack sudo[94682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:13:27 devstack sudo[94682]: pam_unix(sudo:session): session closed for user root Apr 29 15:13:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cb8be83e-6aba-417a-aadb-aade63cf630b tempest-SnapshotsActionsTest-339173462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.info" returned: 0 in 1.220s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:13:27 devstack cinder-volume[84448]: WARNING cinder.volume.drivers.remotefs [None req-cb8be83e-6aba-417a-aadb-aade63cf630b tempest-SnapshotsActionsTest-339173462 None] /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.info is being set with open permissions: ugo+rw Apr 29 15:13:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cb8be83e-6aba-417a-aadb-aade63cf630b tempest-SnapshotsActionsTest-339173462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.info {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:13:27 devstack sudo[94702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.info Apr 29 15:13:27 devstack sudo[94702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:13:28 devstack sudo[94702]: pam_unix(sudo:session): session closed for user root Apr 29 15:13:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cb8be83e-6aba-417a-aadb-aade63cf630b tempest-SnapshotsActionsTest-339173462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.info" returned: 0 in 1.023s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:13:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-cb8be83e-6aba-417a-aadb-aade63cf630b tempest-SnapshotsActionsTest-339173462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 8.243s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:13:28 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-cb8be83e-6aba-417a-aadb-aade63cf630b tempest-SnapshotsActionsTest-339173462 None] Create snapshot completed successfully Apr 29 15:13:29 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-b0652737-8b64-494a-bd40-bbaef20c0f34 req-1d8f06e9-ccd7-4fb8-818f-af34afd59bfa tempest-ServerActionsTestOtherB-242761823 None] Terminate volume connection completed successfully. Apr 29 15:13:29 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-b0652737-8b64-494a-bd40-bbaef20c0f34 req-1d8f06e9-ccd7-4fb8-818f-af34afd59bfa tempest-ServerActionsTestOtherB-242761823 None] Deleting attachment ae5d7a91-3937-4ec7-8dbb-2a6adca843cf. {{(pid=84448) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 15:13:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-c89836f7-1b1a-41bb-98dc-ed563305b381 tempest-SnapshotsActionsTest-339173462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:13:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-c89836f7-1b1a-41bb-98dc-ed563305b381 tempest-SnapshotsActionsTest-339173462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:13:29 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-c89836f7-1b1a-41bb-98dc-ed563305b381 tempest-SnapshotsActionsTest-339173462 None] Creating offline snapshot 103ea5d4-86cb-4cd0-8bf4-4628cf9d8699 of volume daa4a945-abaf-45b3-818e-a0fa9206c6c4 {{(pid=84448) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 15:13:30 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[8075291a-dcb0-4324-bf60-38fd1cb664cd]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:13:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c89836f7-1b1a-41bb-98dc-ed563305b381 tempest-SnapshotsActionsTest-339173462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f035a011-2e13-433a-8b3a-8685765c9bc8 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:13:30 devstack sudo[94713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f035a011-2e13-433a-8b3a-8685765c9bc8 Apr 29 15:13:30 devstack sudo[94713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:13:30 devstack cinder-volume[84448]: DEBUG oslo_service.periodic_task [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84448) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 15:13:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:13:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:13:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:13:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:13:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:13:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:13:30 devstack sudo[94716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:13:30 devstack sudo[94716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:13:31 devstack sudo[94716]: pam_unix(sudo:session): session closed for user root Apr 29 15:13:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 1.521s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:13:31 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:13:31 devstack sudo[94713]: pam_unix(sudo:session): session closed for user root Apr 29 15:13:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c89836f7-1b1a-41bb-98dc-ed563305b381 tempest-SnapshotsActionsTest-339173462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f035a011-2e13-433a-8b3a-8685765c9bc8" returned: 0 in 1.923s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:13:31 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-c89836f7-1b1a-41bb-98dc-ed563305b381 tempest-SnapshotsActionsTest-339173462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84448) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 15:13:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c89836f7-1b1a-41bb-98dc-ed563305b381 tempest-SnapshotsActionsTest-339173462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f035a011-2e13-433a-8b3a-8685765c9bc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.103ea5d4-86cb-4cd0-8bf4-4628cf9d8699 1G {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:13:32 devstack sudo[94729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f035a011-2e13-433a-8b3a-8685765c9bc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.103ea5d4-86cb-4cd0-8bf4-4628cf9d8699 1G Apr 29 15:13:32 devstack sudo[94729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:13:33 devstack sudo[94729]: pam_unix(sudo:session): session closed for user root Apr 29 15:13:33 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c89836f7-1b1a-41bb-98dc-ed563305b381 tempest-SnapshotsActionsTest-339173462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f035a011-2e13-433a-8b3a-8685765c9bc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.103ea5d4-86cb-4cd0-8bf4-4628cf9d8699 1G" returned: 0 in 1.190s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:13:33 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c89836f7-1b1a-41bb-98dc-ed563305b381 tempest-SnapshotsActionsTest-339173462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f035a011-2e13-433a-8b3a-8685765c9bc8 -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.103ea5d4-86cb-4cd0-8bf4-4628cf9d8699 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:13:33 devstack sudo[94753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f035a011-2e13-433a-8b3a-8685765c9bc8 -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.103ea5d4-86cb-4cd0-8bf4-4628cf9d8699 Apr 29 15:13:33 devstack sudo[94753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:13:34 devstack sudo[94753]: pam_unix(sudo:session): session closed for user root Apr 29 15:13:34 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c89836f7-1b1a-41bb-98dc-ed563305b381 tempest-SnapshotsActionsTest-339173462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f035a011-2e13-433a-8b3a-8685765c9bc8 -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.103ea5d4-86cb-4cd0-8bf4-4628cf9d8699" returned: 0 in 1.018s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:13:34 devstack cinder-volume[84448]: WARNING cinder.volume.drivers.remotefs [None req-c89836f7-1b1a-41bb-98dc-ed563305b381 tempest-SnapshotsActionsTest-339173462 None] /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.103ea5d4-86cb-4cd0-8bf4-4628cf9d8699 is being set with open permissions: ugo+rw Apr 29 15:13:34 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c89836f7-1b1a-41bb-98dc-ed563305b381 tempest-SnapshotsActionsTest-339173462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.103ea5d4-86cb-4cd0-8bf4-4628cf9d8699 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:13:34 devstack sudo[94758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.103ea5d4-86cb-4cd0-8bf4-4628cf9d8699 Apr 29 15:13:34 devstack sudo[94758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:13:35 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c89836f7-1b1a-41bb-98dc-ed563305b381 tempest-SnapshotsActionsTest-339173462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.103ea5d4-86cb-4cd0-8bf4-4628cf9d8699" returned: 0 in 0.837s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:13:35 devstack sudo[94758]: pam_unix(sudo:session): session closed for user root Apr 29 15:13:35 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-c89836f7-1b1a-41bb-98dc-ed563305b381 tempest-SnapshotsActionsTest-339173462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.128s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:13:35 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-c89836f7-1b1a-41bb-98dc-ed563305b381 tempest-SnapshotsActionsTest-339173462 None] Create snapshot completed successfully Apr 29 15:13:35 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-1dd104f4-3130-465d-824e-7dc57fcf9991 tempest-SnapshotsActionsTest-1821736968 None] Acquiring lock "cinder-103ea5d4-86cb-4cd0-8bf4-4628cf9d8699-delete_snapshot" by "delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:13:35 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-1dd104f4-3130-465d-824e-7dc57fcf9991 tempest-SnapshotsActionsTest-1821736968 None] Lock "cinder-103ea5d4-86cb-4cd0-8bf4-4628cf9d8699-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:13:35 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-1dd104f4-3130-465d-824e-7dc57fcf9991 tempest-SnapshotsActionsTest-1821736968 None] Acquiring lock "cinder-quobyte-daa4a945-abaf-45b3-818e-a0fa9206c6c4" by "delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:13:35 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-1dd104f4-3130-465d-824e-7dc57fcf9991 tempest-SnapshotsActionsTest-1821736968 None] Lock "cinder-quobyte-daa4a945-abaf-45b3-818e-a0fa9206c6c4" acquired by "delete_snapshot" :: waited 0.024s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:13:35 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-1dd104f4-3130-465d-824e-7dc57fcf9991 tempest-SnapshotsActionsTest-1821736968 None] Acquiring lock "cinder-quobyte-103ea5d4-86cb-4cd0-8bf4-4628cf9d8699" by "_delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:13:35 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-1dd104f4-3130-465d-824e-7dc57fcf9991 tempest-SnapshotsActionsTest-1821736968 None] Lock "cinder-quobyte-103ea5d4-86cb-4cd0-8bf4-4628cf9d8699" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:13:35 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-1dd104f4-3130-465d-824e-7dc57fcf9991 tempest-SnapshotsActionsTest-1821736968 None] Deleting offline snapshot 103ea5d4-86cb-4cd0-8bf4-4628cf9d8699 of volume daa4a945-abaf-45b3-818e-a0fa9206c6c4 {{(pid=84448) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 15:13:35 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-1dd104f4-3130-465d-824e-7dc57fcf9991 tempest-SnapshotsActionsTest-1821736968 None] snapshot_file for this snap is: volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.103ea5d4-86cb-4cd0-8bf4-4628cf9d8699 {{(pid=84448) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 15:13:35 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3297f65-c081-4d6f-96ee-0f1c85cc4381]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:13:35 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1dd104f4-3130-465d-824e-7dc57fcf9991 tempest-SnapshotsActionsTest-1821736968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.103ea5d4-86cb-4cd0-8bf4-4628cf9d8699 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:13:35 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-c1a1acb4-cf7a-4f18-8f97-8a1fefbd38d9 tempest-ServerActionsTestOtherB-242761823 None] Acquiring lock "cinder-2dec142d-c8b2-4d90-aab1-d8cd5b0b5ed3-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:13:35 devstack sudo[94781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.103ea5d4-86cb-4cd0-8bf4-4628cf9d8699 Apr 29 15:13:35 devstack sudo[94781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:13:35 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-c1a1acb4-cf7a-4f18-8f97-8a1fefbd38d9 tempest-ServerActionsTestOtherB-242761823 None] Lock "cinder-2dec142d-c8b2-4d90-aab1-d8cd5b0b5ed3-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:13:36 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-c1a1acb4-cf7a-4f18-8f97-8a1fefbd38d9 tempest-ServerActionsTestOtherB-242761823 None] Acquiring lock "cinder-quobyte-2dec142d-c8b2-4d90-aab1-d8cd5b0b5ed3" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:13:36 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-c1a1acb4-cf7a-4f18-8f97-8a1fefbd38d9 tempest-ServerActionsTestOtherB-242761823 None] Lock "cinder-quobyte-2dec142d-c8b2-4d90-aab1-d8cd5b0b5ed3" acquired by "delete_volume" :: waited 0.016s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:13:36 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[cedf617b-5006-4792-887f-487f0dc1d7c8]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:13:36 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c1a1acb4-cf7a-4f18-8f97-8a1fefbd38d9 tempest-ServerActionsTestOtherB-242761823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2dec142d-c8b2-4d90-aab1-d8cd5b0b5ed3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:13:36 devstack sudo[94783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2dec142d-c8b2-4d90-aab1-d8cd5b0b5ed3 Apr 29 15:13:36 devstack sudo[94783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:13:36 devstack sudo[94781]: pam_unix(sudo:session): session closed for user root Apr 29 15:13:36 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1dd104f4-3130-465d-824e-7dc57fcf9991 tempest-SnapshotsActionsTest-1821736968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.103ea5d4-86cb-4cd0-8bf4-4628cf9d8699" returned: 0 in 1.040s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:13:36 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-1dd104f4-3130-465d-824e-7dc57fcf9991 tempest-SnapshotsActionsTest-1821736968 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84448) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 15:13:36 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d79187-6bba-4c80-a4a7-01d0d0a92af6]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:13:36 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1dd104f4-3130-465d-824e-7dc57fcf9991 tempest-SnapshotsActionsTest-1821736968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f035a011-2e13-433a-8b3a-8685765c9bc8 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:13:36 devstack sudo[94797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f035a011-2e13-433a-8b3a-8685765c9bc8 Apr 29 15:13:36 devstack sudo[94797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:13:36 devstack sudo[94783]: pam_unix(sudo:session): session closed for user root Apr 29 15:13:36 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c1a1acb4-cf7a-4f18-8f97-8a1fefbd38d9 tempest-ServerActionsTestOtherB-242761823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2dec142d-c8b2-4d90-aab1-d8cd5b0b5ed3" returned: 0 in 0.912s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:13:36 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c1a1acb4-cf7a-4f18-8f97-8a1fefbd38d9 tempest-ServerActionsTestOtherB-242761823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2dec142d-c8b2-4d90-aab1-d8cd5b0b5ed3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:13:37 devstack sudo[94802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2dec142d-c8b2-4d90-aab1-d8cd5b0b5ed3 Apr 29 15:13:37 devstack sudo[94802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:13:37 devstack sudo[94797]: pam_unix(sudo:session): session closed for user root Apr 29 15:13:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1dd104f4-3130-465d-824e-7dc57fcf9991 tempest-SnapshotsActionsTest-1821736968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f035a011-2e13-433a-8b3a-8685765c9bc8" returned: 0 in 0.925s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:13:37 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-1dd104f4-3130-465d-824e-7dc57fcf9991 tempest-SnapshotsActionsTest-1821736968 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84448) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 15:13:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1dd104f4-3130-465d-824e-7dc57fcf9991 tempest-SnapshotsActionsTest-1821736968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.103ea5d4-86cb-4cd0-8bf4-4628cf9d8699 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:13:37 devstack sudo[94809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.103ea5d4-86cb-4cd0-8bf4-4628cf9d8699 Apr 29 15:13:37 devstack sudo[94809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:13:37 devstack sudo[94802]: pam_unix(sudo:session): session closed for user root Apr 29 15:13:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c1a1acb4-cf7a-4f18-8f97-8a1fefbd38d9 tempest-ServerActionsTestOtherB-242761823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2dec142d-c8b2-4d90-aab1-d8cd5b0b5ed3" returned: 0 in 0.731s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:13:37 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-c1a1acb4-cf7a-4f18-8f97-8a1fefbd38d9 tempest-ServerActionsTestOtherB-242761823 None] Lock "cinder-quobyte-2dec142d-c8b2-4d90-aab1-d8cd5b0b5ed3" released by "delete_volume" :: held 1.715s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:13:37 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-c1a1acb4-cf7a-4f18-8f97-8a1fefbd38d9 tempest-ServerActionsTestOtherB-242761823 None] Created reservations ['d2b880de-1fef-494c-9265-b855bbefa4f5', '2583729d-c87d-4980-a462-6c06a4c7530c', 'd36f47fe-55bf-4026-b78f-600009280c47', 'e4ce2813-6b7f-4589-aee1-c9cc3dfc78ab'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:13:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-c1a1acb4-cf7a-4f18-8f97-8a1fefbd38d9 tempest-ServerActionsTestOtherB-242761823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:13:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-c1a1acb4-cf7a-4f18-8f97-8a1fefbd38d9 tempest-ServerActionsTestOtherB-242761823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:13:37 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-c1a1acb4-cf7a-4f18-8f97-8a1fefbd38d9 tempest-ServerActionsTestOtherB-242761823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:13:37 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-c1a1acb4-cf7a-4f18-8f97-8a1fefbd38d9 tempest-ServerActionsTestOtherB-242761823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:13:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-c1a1acb4-cf7a-4f18-8f97-8a1fefbd38d9 tempest-ServerActionsTestOtherB-242761823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:13:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c1a1acb4-cf7a-4f18-8f97-8a1fefbd38d9 tempest-ServerActionsTestOtherB-242761823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:13:37 devstack sudo[94811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:13:37 devstack sudo[94811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:13:38 devstack sudo[94809]: pam_unix(sudo:session): session closed for user root Apr 29 15:13:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1dd104f4-3130-465d-824e-7dc57fcf9991 tempest-SnapshotsActionsTest-1821736968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.103ea5d4-86cb-4cd0-8bf4-4628cf9d8699" returned: 0 in 0.947s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:13:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1dd104f4-3130-465d-824e-7dc57fcf9991 tempest-SnapshotsActionsTest-1821736968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.103ea5d4-86cb-4cd0-8bf4-4628cf9d8699 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:13:38 devstack sudo[94819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.103ea5d4-86cb-4cd0-8bf4-4628cf9d8699 Apr 29 15:13:38 devstack sudo[94819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:13:38 devstack sudo[94811]: pam_unix(sudo:session): session closed for user root Apr 29 15:13:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c1a1acb4-cf7a-4f18-8f97-8a1fefbd38d9 tempest-ServerActionsTestOtherB-242761823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.943s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:13:38 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-c1a1acb4-cf7a-4f18-8f97-8a1fefbd38d9 tempest-ServerActionsTestOtherB-242761823 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:13:38 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-c1a1acb4-cf7a-4f18-8f97-8a1fefbd38d9 tempest-ServerActionsTestOtherB-242761823 None] Deleted volume successfully. Apr 29 15:13:38 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-c1a1acb4-cf7a-4f18-8f97-8a1fefbd38d9 tempest-ServerActionsTestOtherB-242761823 None] Lock "cinder-2dec142d-c8b2-4d90-aab1-d8cd5b0b5ed3-delete_volume" released by "delete_volume" :: held 2.937s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:13:39 devstack sudo[94819]: pam_unix(sudo:session): session closed for user root Apr 29 15:13:39 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1dd104f4-3130-465d-824e-7dc57fcf9991 tempest-SnapshotsActionsTest-1821736968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.103ea5d4-86cb-4cd0-8bf4-4628cf9d8699" returned: 0 in 0.705s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:13:39 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-1dd104f4-3130-465d-824e-7dc57fcf9991 tempest-SnapshotsActionsTest-1821736968 None] Lock "cinder-quobyte-103ea5d4-86cb-4cd0-8bf4-4628cf9d8699" released by "_delete_snapshot" :: held 3.764s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:13:39 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-1dd104f4-3130-465d-824e-7dc57fcf9991 tempest-SnapshotsActionsTest-1821736968 None] Lock "cinder-quobyte-daa4a945-abaf-45b3-818e-a0fa9206c6c4" released by "delete_snapshot" :: held 3.807s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:13:39 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-1dd104f4-3130-465d-824e-7dc57fcf9991 tempest-SnapshotsActionsTest-1821736968 None] Created reservations ['a6cc9d4b-f998-4bc3-b981-a43c0bba46e5', '0086eba3-6620-4068-be84-799812ef0795', '462d6b5f-d982-4eab-9bb1-5f798396a72f', '399d7fd5-9367-49bd-80fb-6d40975a0b6a'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:13:39 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-1dd104f4-3130-465d-824e-7dc57fcf9991 tempest-SnapshotsActionsTest-1821736968 None] Delete snapshot completed successfully. Apr 29 15:13:39 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-1dd104f4-3130-465d-824e-7dc57fcf9991 tempest-SnapshotsActionsTest-1821736968 None] Lock "cinder-103ea5d4-86cb-4cd0-8bf4-4628cf9d8699-delete_snapshot" released by "delete_snapshot" :: held 3.990s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:13:40 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-fda5d1a1-5847-43fd-a537-979883dd4469 tempest-SnapshotsActionsTest-339173462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:13:40 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-fda5d1a1-5847-43fd-a537-979883dd4469 tempest-SnapshotsActionsTest-339173462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:13:40 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-fda5d1a1-5847-43fd-a537-979883dd4469 tempest-SnapshotsActionsTest-339173462 None] Creating offline snapshot f6a7f8fd-2c43-4425-bd0c-e8654b3eb22c of volume daa4a945-abaf-45b3-818e-a0fa9206c6c4 {{(pid=84448) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 15:13:40 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7afa09c-834d-46e1-8362-24e892eb09b0]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:13:40 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-fda5d1a1-5847-43fd-a537-979883dd4469 tempest-SnapshotsActionsTest-339173462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f035a011-2e13-433a-8b3a-8685765c9bc8 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:13:40 devstack sudo[94825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f035a011-2e13-433a-8b3a-8685765c9bc8 Apr 29 15:13:40 devstack sudo[94825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:13:41 devstack sudo[94825]: pam_unix(sudo:session): session closed for user root Apr 29 15:13:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-fda5d1a1-5847-43fd-a537-979883dd4469 tempest-SnapshotsActionsTest-339173462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f035a011-2e13-433a-8b3a-8685765c9bc8" returned: 0 in 0.836s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:13:41 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-fda5d1a1-5847-43fd-a537-979883dd4469 tempest-SnapshotsActionsTest-339173462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84448) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 15:13:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-fda5d1a1-5847-43fd-a537-979883dd4469 tempest-SnapshotsActionsTest-339173462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f035a011-2e13-433a-8b3a-8685765c9bc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f6a7f8fd-2c43-4425-bd0c-e8654b3eb22c 1G {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:13:41 devstack sudo[94831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f035a011-2e13-433a-8b3a-8685765c9bc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f6a7f8fd-2c43-4425-bd0c-e8654b3eb22c 1G Apr 29 15:13:41 devstack sudo[94831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:13:42 devstack sudo[94831]: pam_unix(sudo:session): session closed for user root Apr 29 15:13:42 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-fda5d1a1-5847-43fd-a537-979883dd4469 tempest-SnapshotsActionsTest-339173462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f035a011-2e13-433a-8b3a-8685765c9bc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f6a7f8fd-2c43-4425-bd0c-e8654b3eb22c 1G" returned: 0 in 1.052s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:13:42 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-fda5d1a1-5847-43fd-a537-979883dd4469 tempest-SnapshotsActionsTest-339173462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f035a011-2e13-433a-8b3a-8685765c9bc8 -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f6a7f8fd-2c43-4425-bd0c-e8654b3eb22c {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:13:42 devstack sudo[94838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f035a011-2e13-433a-8b3a-8685765c9bc8 -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f6a7f8fd-2c43-4425-bd0c-e8654b3eb22c Apr 29 15:13:42 devstack sudo[94838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:13:42 devstack sudo[94838]: pam_unix(sudo:session): session closed for user root Apr 29 15:13:42 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-fda5d1a1-5847-43fd-a537-979883dd4469 tempest-SnapshotsActionsTest-339173462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f035a011-2e13-433a-8b3a-8685765c9bc8 -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f6a7f8fd-2c43-4425-bd0c-e8654b3eb22c" returned: 0 in 0.828s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:13:42 devstack cinder-volume[84448]: WARNING cinder.volume.drivers.remotefs [None req-fda5d1a1-5847-43fd-a537-979883dd4469 tempest-SnapshotsActionsTest-339173462 None] /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f6a7f8fd-2c43-4425-bd0c-e8654b3eb22c is being set with open permissions: ugo+rw Apr 29 15:13:42 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-fda5d1a1-5847-43fd-a537-979883dd4469 tempest-SnapshotsActionsTest-339173462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f6a7f8fd-2c43-4425-bd0c-e8654b3eb22c {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:13:43 devstack sudo[94847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f6a7f8fd-2c43-4425-bd0c-e8654b3eb22c Apr 29 15:13:43 devstack sudo[94847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:13:43 devstack sudo[94847]: pam_unix(sudo:session): session closed for user root Apr 29 15:13:44 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-fda5d1a1-5847-43fd-a537-979883dd4469 tempest-SnapshotsActionsTest-339173462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f6a7f8fd-2c43-4425-bd0c-e8654b3eb22c" returned: 0 in 1.042s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:13:44 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-fda5d1a1-5847-43fd-a537-979883dd4469 tempest-SnapshotsActionsTest-339173462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.852s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:13:44 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-fda5d1a1-5847-43fd-a537-979883dd4469 tempest-SnapshotsActionsTest-339173462 None] Create snapshot completed successfully Apr 29 15:13:44 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-0835cb30-c980-4a09-9934-620c0646a2b4 tempest-SnapshotsActionsTest-1821736968 None] Acquiring lock "cinder-f6a7f8fd-2c43-4425-bd0c-e8654b3eb22c-delete_snapshot" by "delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:13:44 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-0835cb30-c980-4a09-9934-620c0646a2b4 tempest-SnapshotsActionsTest-1821736968 None] Lock "cinder-f6a7f8fd-2c43-4425-bd0c-e8654b3eb22c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:13:44 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-0835cb30-c980-4a09-9934-620c0646a2b4 tempest-SnapshotsActionsTest-1821736968 None] Acquiring lock "cinder-quobyte-daa4a945-abaf-45b3-818e-a0fa9206c6c4" by "delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:13:44 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-0835cb30-c980-4a09-9934-620c0646a2b4 tempest-SnapshotsActionsTest-1821736968 None] Lock "cinder-quobyte-daa4a945-abaf-45b3-818e-a0fa9206c6c4" acquired by "delete_snapshot" :: waited 0.021s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:13:44 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-0835cb30-c980-4a09-9934-620c0646a2b4 tempest-SnapshotsActionsTest-1821736968 None] Acquiring lock "cinder-quobyte-f6a7f8fd-2c43-4425-bd0c-e8654b3eb22c" by "_delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:13:44 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-0835cb30-c980-4a09-9934-620c0646a2b4 tempest-SnapshotsActionsTest-1821736968 None] Lock "cinder-quobyte-f6a7f8fd-2c43-4425-bd0c-e8654b3eb22c" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:13:44 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-0835cb30-c980-4a09-9934-620c0646a2b4 tempest-SnapshotsActionsTest-1821736968 None] Deleting offline snapshot f6a7f8fd-2c43-4425-bd0c-e8654b3eb22c of volume daa4a945-abaf-45b3-818e-a0fa9206c6c4 {{(pid=84448) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 15:13:44 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-0835cb30-c980-4a09-9934-620c0646a2b4 tempest-SnapshotsActionsTest-1821736968 None] snapshot_file for this snap is: volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f6a7f8fd-2c43-4425-bd0c-e8654b3eb22c {{(pid=84448) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 15:13:44 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[634150d4-0502-4c36-b8ab-a0a3ba63a149]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:13:44 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-0835cb30-c980-4a09-9934-620c0646a2b4 tempest-SnapshotsActionsTest-1821736968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f6a7f8fd-2c43-4425-bd0c-e8654b3eb22c {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:13:44 devstack sudo[94865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f6a7f8fd-2c43-4425-bd0c-e8654b3eb22c Apr 29 15:13:44 devstack sudo[94865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:13:46 devstack sudo[94865]: pam_unix(sudo:session): session closed for user root Apr 29 15:13:46 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-0835cb30-c980-4a09-9934-620c0646a2b4 tempest-SnapshotsActionsTest-1821736968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f6a7f8fd-2c43-4425-bd0c-e8654b3eb22c" returned: 0 in 1.243s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:13:46 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-0835cb30-c980-4a09-9934-620c0646a2b4 tempest-SnapshotsActionsTest-1821736968 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84448) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 15:13:46 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcdf4ca2-0ab3-4773-bac1-0f719ff82387]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:13:46 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-0835cb30-c980-4a09-9934-620c0646a2b4 tempest-SnapshotsActionsTest-1821736968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f035a011-2e13-433a-8b3a-8685765c9bc8 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:13:46 devstack sudo[94872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f035a011-2e13-433a-8b3a-8685765c9bc8 Apr 29 15:13:46 devstack sudo[94872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:13:46 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [req-3c48acb3-15ce-4c9a-b9e0-9020be63dfee req-91db616d-8f21-4c0c-98da-091baed94e3e tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:13:46 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-3c48acb3-15ce-4c9a-b9e0-9020be63dfee req-91db616d-8f21-4c0c-98da-091baed94e3e tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Flow 'volume_create_manager' (58ed4282-cef2-4c6b-9c64-17ecf01641a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:13:46 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-3c48acb3-15ce-4c9a-b9e0-9020be63dfee req-91db616d-8f21-4c0c-98da-091baed94e3e tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83278299-e4c9-496c-9ec2-4140998b04a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:13:46 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-3c48acb3-15ce-4c9a-b9e0-9020be63dfee req-91db616d-8f21-4c0c-98da-091baed94e3e tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83278299-e4c9-496c-9ec2-4140998b04a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:13:46Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15dd86bf-12c1-4c27-87da-0cbda7909f51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35dad894a21e475cb16f0eb9f2a959c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:13:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:13:46Z,use_quota=True,user_id='1bdf8feb2bba476a9253ccbe0ba9cf91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:13:46 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-3c48acb3-15ce-4c9a-b9e0-9020be63dfee req-91db616d-8f21-4c0c-98da-091baed94e3e tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75a02977-61b6-4823-aa60-13f685117209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:13:46 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-3c48acb3-15ce-4c9a-b9e0-9020be63dfee req-91db616d-8f21-4c0c-98da-091baed94e3e tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75a02977-61b6-4823-aa60-13f685117209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:13:46 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-3c48acb3-15ce-4c9a-b9e0-9020be63dfee req-91db616d-8f21-4c0c-98da-091baed94e3e tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64daae7b-c1bb-4eac-8f87-c373925919e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:13:46 devstack cinder-volume[84448]: DEBUG cinder.image.glance [req-3c48acb3-15ce-4c9a-b9e0-9020be63dfee req-91db616d-8f21-4c0c-98da-091baed94e3e tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Creating Keystone auth plugin from conf {{(pid=84448) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 29 15:13:47 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-3c48acb3-15ce-4c9a-b9e0-9020be63dfee req-91db616d-8f21-4c0c-98da-091baed94e3e tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64daae7b-c1bb-4eac-8f87-c373925919e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '15dd86bf-12c1-4c27-87da-0cbda7909f51', 'volume_name': 'volume-15dd86bf-12c1-4c27-87da-0cbda7909f51', 'volume_size': 1, 'image_id': 'ad86f424-7d2a-4f3b-9577-890075e7dc72', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ad86f424-7d2a-4f3b-9577-890075e7dc72', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '33db0ca5091747b1a3438d70bf53390c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ad86f424-7d2a-4f3b-9577-890075e7dc72', 'created_at': datetime.datetime(2026, 4, 29, 13, 0, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 13, 0, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ad86f424-7d2a-4f3b-9577-890075e7dc72/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:13:47 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-3c48acb3-15ce-4c9a-b9e0-9020be63dfee req-91db616d-8f21-4c0c-98da-091baed94e3e tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad6a9171-c7de-4faa-8def-10077cc59a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:13:47 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-3c48acb3-15ce-4c9a-b9e0-9020be63dfee req-91db616d-8f21-4c0c-98da-091baed94e3e tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad6a9171-c7de-4faa-8def-10077cc59a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:13:47 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-3c48acb3-15ce-4c9a-b9e0-9020be63dfee req-91db616d-8f21-4c0c-98da-091baed94e3e tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47f7cd03-e92d-4d9c-a482-e3dbb98529d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:13:47 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [req-3c48acb3-15ce-4c9a-b9e0-9020be63dfee req-91db616d-8f21-4c0c-98da-091baed94e3e tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Volume 15dd86bf-12c1-4c27-87da-0cbda7909f51: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-15dd86bf-12c1-4c27-87da-0cbda7909f51', 'volume_size': 1, 'image_id': 'ad86f424-7d2a-4f3b-9577-890075e7dc72', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ad86f424-7d2a-4f3b-9577-890075e7dc72', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '33db0ca5091747b1a3438d70bf53390c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ad86f424-7d2a-4f3b-9577-890075e7dc72', 'created_at': datetime.datetime(2026, 4, 29, 13, 0, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 13, 0, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ad86f424-7d2a-4f3b-9577-890075e7dc72/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 29 15:13:47 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [req-3c48acb3-15ce-4c9a-b9e0-9020be63dfee req-91db616d-8f21-4c0c-98da-091baed94e3e tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Trying to clone 15dd86bf-12c1-4c27-87da-0cbda7909f51 from image ad86f424-7d2a-4f3b-9577-890075e7dc72 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ad86f424-7d2a-4f3b-9577-890075e7dc72', 'metadata': {}}]). {{(pid=84448) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 29 15:13:47 devstack sudo[94872]: pam_unix(sudo:session): session closed for user root Apr 29 15:13:47 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-0835cb30-c980-4a09-9934-620c0646a2b4 tempest-SnapshotsActionsTest-1821736968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f035a011-2e13-433a-8b3a-8685765c9bc8" returned: 0 in 1.172s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:13:47 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-0835cb30-c980-4a09-9934-620c0646a2b4 tempest-SnapshotsActionsTest-1821736968 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84448) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 15:13:47 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-0835cb30-c980-4a09-9934-620c0646a2b4 tempest-SnapshotsActionsTest-1821736968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f6a7f8fd-2c43-4425-bd0c-e8654b3eb22c {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:13:47 devstack sudo[94881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f6a7f8fd-2c43-4425-bd0c-e8654b3eb22c Apr 29 15:13:47 devstack sudo[94881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:13:47 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [req-3c48acb3-15ce-4c9a-b9e0-9020be63dfee req-91db616d-8f21-4c0c-98da-091baed94e3e tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_ngui5odtdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84448) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 29 15:13:47 devstack cinder-volume[84448]: INFO cinder.image.image_utils [req-3c48acb3-15ce-4c9a-b9e0-9020be63dfee req-91db616d-8f21-4c0c-98da-091baed94e3e tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Image download 20.69 MB at 20.69 MB/s Apr 29 15:13:47 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[a608e868-b378-4bba-ac18-c098718236b6]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:13:47 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-3c48acb3-15ce-4c9a-b9e0-9020be63dfee req-91db616d-8f21-4c0c-98da-091baed94e3e tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_ngui5odtdevstack@QuobyteHD {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:13:47 devstack sudo[94888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_ngui5odtdevstack@QuobyteHD Apr 29 15:13:47 devstack sudo[94888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:13:48 devstack sudo[94881]: pam_unix(sudo:session): session closed for user root Apr 29 15:13:48 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-0835cb30-c980-4a09-9934-620c0646a2b4 tempest-SnapshotsActionsTest-1821736968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f6a7f8fd-2c43-4425-bd0c-e8654b3eb22c" returned: 0 in 1.038s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:13:48 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-0835cb30-c980-4a09-9934-620c0646a2b4 tempest-SnapshotsActionsTest-1821736968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f6a7f8fd-2c43-4425-bd0c-e8654b3eb22c {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:13:48 devstack sudo[94893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f6a7f8fd-2c43-4425-bd0c-e8654b3eb22c Apr 29 15:13:48 devstack sudo[94893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:13:48 devstack sudo[94888]: pam_unix(sudo:session): session closed for user root Apr 29 15:13:48 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-3c48acb3-15ce-4c9a-b9e0-9020be63dfee req-91db616d-8f21-4c0c-98da-091baed94e3e tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_ngui5odtdevstack@QuobyteHD" returned: 0 in 0.888s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:13:48 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [req-3c48acb3-15ce-4c9a-b9e0-9020be63dfee req-91db616d-8f21-4c0c-98da-091baed94e3e tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Temporary image ad86f424-7d2a-4f3b-9577-890075e7dc72 is fetched for user 1bdf8feb2bba476a9253ccbe0ba9cf91. {{(pid=84448) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 29 15:13:48 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ad8b9a-ab34-4174-8962-6e1acee2c206]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:13:48 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-3c48acb3-15ce-4c9a-b9e0-9020be63dfee req-91db616d-8f21-4c0c-98da-091baed94e3e tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_ngui5odtdevstack@QuobyteHD {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:13:48 devstack sudo[94898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_ngui5odtdevstack@QuobyteHD Apr 29 15:13:48 devstack sudo[94898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:13:49 devstack sudo[94893]: pam_unix(sudo:session): session closed for user root Apr 29 15:13:49 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-0835cb30-c980-4a09-9934-620c0646a2b4 tempest-SnapshotsActionsTest-1821736968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f6a7f8fd-2c43-4425-bd0c-e8654b3eb22c" returned: 0 in 1.340s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:13:49 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-0835cb30-c980-4a09-9934-620c0646a2b4 tempest-SnapshotsActionsTest-1821736968 None] Lock "cinder-quobyte-f6a7f8fd-2c43-4425-bd0c-e8654b3eb22c" released by "_delete_snapshot" :: held 4.957s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:13:49 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-0835cb30-c980-4a09-9934-620c0646a2b4 tempest-SnapshotsActionsTest-1821736968 None] Lock "cinder-quobyte-daa4a945-abaf-45b3-818e-a0fa9206c6c4" released by "delete_snapshot" :: held 4.997s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:13:49 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-0835cb30-c980-4a09-9934-620c0646a2b4 tempest-SnapshotsActionsTest-1821736968 None] Created reservations ['91d7c1f2-2b15-4c84-8964-5d8cc5768776', '837cf427-2f92-4d6a-8f5f-c6ceb4e22b53', '50db90ed-8156-44b1-a30e-f2cf6c74fda2', '2e3be898-c19f-4110-b150-c15bbef885a2'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:13:50 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-0835cb30-c980-4a09-9934-620c0646a2b4 tempest-SnapshotsActionsTest-1821736968 None] Delete snapshot completed successfully. Apr 29 15:13:50 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-0835cb30-c980-4a09-9934-620c0646a2b4 tempest-SnapshotsActionsTest-1821736968 None] Lock "cinder-f6a7f8fd-2c43-4425-bd0c-e8654b3eb22c-delete_snapshot" released by "delete_snapshot" :: held 5.332s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:13:50 devstack sudo[94898]: pam_unix(sudo:session): session closed for user root Apr 29 15:13:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-3c48acb3-15ce-4c9a-b9e0-9020be63dfee req-91db616d-8f21-4c0c-98da-091baed94e3e tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_ngui5odtdevstack@QuobyteHD" returned: 0 in 1.403s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:13:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-3c48acb3-15ce-4c9a-b9e0-9020be63dfee req-91db616d-8f21-4c0c-98da-091baed94e3e tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:13:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-3c48acb3-15ce-4c9a-b9e0-9020be63dfee req-91db616d-8f21-4c0c-98da-091baed94e3e tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:13:50 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [req-3c48acb3-15ce-4c9a-b9e0-9020be63dfee req-91db616d-8f21-4c0c-98da-091baed94e3e tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:13:46Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15dd86bf-12c1-4c27-87da-0cbda7909f51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35dad894a21e475cb16f0eb9f2a959c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:13:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:13:46Z,use_quota=True,user_id='1bdf8feb2bba476a9253ccbe0ba9cf91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:13:50 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [req-3c48acb3-15ce-4c9a-b9e0-9020be63dfee req-91db616d-8f21-4c0c-98da-091baed94e3e tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Creating volume 15dd86bf-12c1-4c27-87da-0cbda7909f51 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:13:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-3c48acb3-15ce-4c9a-b9e0-9020be63dfee req-91db616d-8f21-4c0c-98da-091baed94e3e tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:13:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-3c48acb3-15ce-4c9a-b9e0-9020be63dfee req-91db616d-8f21-4c0c-98da-091baed94e3e tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:13:50 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [req-3c48acb3-15ce-4c9a-b9e0-9020be63dfee req-91db616d-8f21-4c0c-98da-091baed94e3e tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:13:50 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [req-3c48acb3-15ce-4c9a-b9e0-9020be63dfee req-91db616d-8f21-4c0c-98da-091baed94e3e tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:13:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-3c48acb3-15ce-4c9a-b9e0-9020be63dfee req-91db616d-8f21-4c0c-98da-091baed94e3e tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:13:50 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [req-3c48acb3-15ce-4c9a-b9e0-9020be63dfee req-91db616d-8f21-4c0c-98da-091baed94e3e tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:13:50 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [req-3c48acb3-15ce-4c9a-b9e0-9020be63dfee req-91db616d-8f21-4c0c-98da-091baed94e3e tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:13:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-3c48acb3-15ce-4c9a-b9e0-9020be63dfee req-91db616d-8f21-4c0c-98da-091baed94e3e tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-15dd86bf-12c1-4c27-87da-0cbda7909f51 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:13:50 devstack sudo[94988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-15dd86bf-12c1-4c27-87da-0cbda7909f51 1073741824 Apr 29 15:13:50 devstack sudo[94988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:13:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-58fe032c-78b6-45e2-8e2e-6b9bd89427ec tempest-SnapshotsActionsTest-339173462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:13:51 devstack sudo[94988]: pam_unix(sudo:session): session closed for user root Apr 29 15:13:51 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-3c48acb3-15ce-4c9a-b9e0-9020be63dfee req-91db616d-8f21-4c0c-98da-091baed94e3e tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-15dd86bf-12c1-4c27-87da-0cbda7909f51 1073741824" returned: 0 in 1.408s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:13:51 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-3c48acb3-15ce-4c9a-b9e0-9020be63dfee req-91db616d-8f21-4c0c-98da-091baed94e3e tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-15dd86bf-12c1-4c27-87da-0cbda7909f51 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:13:51 devstack sudo[94998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-15dd86bf-12c1-4c27-87da-0cbda7909f51 Apr 29 15:13:51 devstack sudo[94998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:13:52 devstack sudo[94998]: pam_unix(sudo:session): session closed for user root Apr 29 15:13:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-3c48acb3-15ce-4c9a-b9e0-9020be63dfee req-91db616d-8f21-4c0c-98da-091baed94e3e tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-15dd86bf-12c1-4c27-87da-0cbda7909f51" returned: 0 in 1.017s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:13:52 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [req-3c48acb3-15ce-4c9a-b9e0-9020be63dfee req-91db616d-8f21-4c0c-98da-091baed94e3e tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] <== create_volume: return (2496ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:13:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-3c48acb3-15ce-4c9a-b9e0-9020be63dfee req-91db616d-8f21-4c0c-98da-091baed94e3e tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.502s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:13:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-58fe032c-78b6-45e2-8e2e-6b9bd89427ec tempest-SnapshotsActionsTest-339173462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.880s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:13:52 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-58fe032c-78b6-45e2-8e2e-6b9bd89427ec tempest-SnapshotsActionsTest-339173462 None] Creating offline snapshot 5cff0506-990c-4831-b350-7d2c6e4d9fc6 of volume daa4a945-abaf-45b3-818e-a0fa9206c6c4 {{(pid=84448) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 15:13:52 devstack cinder-volume[84448]: DEBUG cinder.volume.volume_utils [req-3c48acb3-15ce-4c9a-b9e0-9020be63dfee req-91db616d-8f21-4c0c-98da-091baed94e3e tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Attempting download of ad86f424-7d2a-4f3b-9577-890075e7dc72 ((None, [{'url': 'file:///opt/stack/data/glance/images/ad86f424-7d2a-4f3b-9577-890075e7dc72', 'metadata': {}}])) to volume 15dd86bf-12c1-4c27-87da-0cbda7909f51. {{(pid=84448) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 29 15:13:52 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c2f486-0bfd-4c75-a784-fd72cadfa5dc]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:13:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-58fe032c-78b6-45e2-8e2e-6b9bd89427ec tempest-SnapshotsActionsTest-339173462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f035a011-2e13-433a-8b3a-8685765c9bc8 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:13:52 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba5ade3d-e67e-4959-a6ef-f0a30b9b0834]: (4, 'raw') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:13:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-3c48acb3-15ce-4c9a-b9e0-9020be63dfee req-91db616d-8f21-4c0c-98da-091baed94e3e tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ad86f424-7d2a-4f3b-9577-890075e7dc72_gnekzmxa {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:13:53 devstack sudo[95001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f035a011-2e13-433a-8b3a-8685765c9bc8 Apr 29 15:13:53 devstack sudo[95001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:13:53 devstack sudo[95002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ad86f424-7d2a-4f3b-9577-890075e7dc72_gnekzmxa Apr 29 15:13:53 devstack sudo[95002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:13:53 devstack sudo[95001]: pam_unix(sudo:session): session closed for user root Apr 29 15:13:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-58fe032c-78b6-45e2-8e2e-6b9bd89427ec tempest-SnapshotsActionsTest-339173462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f035a011-2e13-433a-8b3a-8685765c9bc8" returned: 0 in 1.175s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:13:53 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-58fe032c-78b6-45e2-8e2e-6b9bd89427ec tempest-SnapshotsActionsTest-339173462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84448) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 15:13:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-58fe032c-78b6-45e2-8e2e-6b9bd89427ec tempest-SnapshotsActionsTest-339173462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f035a011-2e13-433a-8b3a-8685765c9bc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.5cff0506-990c-4831-b350-7d2c6e4d9fc6 1G {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:13:54 devstack sudo[95009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f035a011-2e13-433a-8b3a-8685765c9bc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.5cff0506-990c-4831-b350-7d2c6e4d9fc6 1G Apr 29 15:13:54 devstack sudo[95009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:13:54 devstack sudo[95002]: pam_unix(sudo:session): session closed for user root Apr 29 15:13:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-3c48acb3-15ce-4c9a-b9e0-9020be63dfee req-91db616d-8f21-4c0c-98da-091baed94e3e tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ad86f424-7d2a-4f3b-9577-890075e7dc72_gnekzmxa" returned: 0 in 1.455s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:13:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-3c48acb3-15ce-4c9a-b9e0-9020be63dfee req-91db616d-8f21-4c0c-98da-091baed94e3e tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ad86f424-7d2a-4f3b-9577-890075e7dc72_gnekzmxa {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:13:54 devstack sudo[95014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ad86f424-7d2a-4f3b-9577-890075e7dc72_gnekzmxa Apr 29 15:13:54 devstack sudo[95014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:13:55 devstack sudo[95009]: pam_unix(sudo:session): session closed for user root Apr 29 15:13:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-58fe032c-78b6-45e2-8e2e-6b9bd89427ec tempest-SnapshotsActionsTest-339173462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f035a011-2e13-433a-8b3a-8685765c9bc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.5cff0506-990c-4831-b350-7d2c6e4d9fc6 1G" returned: 0 in 1.130s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:13:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-58fe032c-78b6-45e2-8e2e-6b9bd89427ec tempest-SnapshotsActionsTest-339173462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f035a011-2e13-433a-8b3a-8685765c9bc8 -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.5cff0506-990c-4831-b350-7d2c6e4d9fc6 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:13:55 devstack sudo[95021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f035a011-2e13-433a-8b3a-8685765c9bc8 -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.5cff0506-990c-4831-b350-7d2c6e4d9fc6 Apr 29 15:13:55 devstack sudo[95021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:13:55 devstack sudo[95014]: pam_unix(sudo:session): session closed for user root Apr 29 15:13:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-3c48acb3-15ce-4c9a-b9e0-9020be63dfee req-91db616d-8f21-4c0c-98da-091baed94e3e tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ad86f424-7d2a-4f3b-9577-890075e7dc72_gnekzmxa" returned: 1 in 0.981s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:13:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-3c48acb3-15ce-4c9a-b9e0-9020be63dfee req-91db616d-8f21-4c0c-98da-091baed94e3e tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ad86f424-7d2a-4f3b-9577-890075e7dc72_gnekzmxa' failed. Not Retrying. {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 15:13:55 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c1f2503-662e-481e-bd02-8a9921324cc8]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:13:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-3c48acb3-15ce-4c9a-b9e0-9020be63dfee req-91db616d-8f21-4c0c-98da-091baed94e3e tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_ngui5odtdevstack@QuobyteHD {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:13:55 devstack sudo[95025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_ngui5odtdevstack@QuobyteHD Apr 29 15:13:55 devstack sudo[95025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:13:56 devstack sudo[95025]: pam_unix(sudo:session): session closed for user root Apr 29 15:13:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-3c48acb3-15ce-4c9a-b9e0-9020be63dfee req-91db616d-8f21-4c0c-98da-091baed94e3e tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_ngui5odtdevstack@QuobyteHD" returned: 0 in 0.846s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:13:56 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [req-3c48acb3-15ce-4c9a-b9e0-9020be63dfee req-91db616d-8f21-4c0c-98da-091baed94e3e tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] ad86f424-7d2a-4f3b-9577-890075e7dc72 was qcow2, converting to raw {{(pid=84448) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 29 15:13:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-3c48acb3-15ce-4c9a-b9e0-9020be63dfee req-91db616d-8f21-4c0c-98da-091baed94e3e tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_ngui5odtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-15dd86bf-12c1-4c27-87da-0cbda7909f51 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:13:56 devstack sudo[95034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_ngui5odtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-15dd86bf-12c1-4c27-87da-0cbda7909f51 Apr 29 15:13:56 devstack sudo[95034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:13:56 devstack sudo[95021]: pam_unix(sudo:session): session closed for user root Apr 29 15:13:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-58fe032c-78b6-45e2-8e2e-6b9bd89427ec tempest-SnapshotsActionsTest-339173462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f035a011-2e13-433a-8b3a-8685765c9bc8 -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.5cff0506-990c-4831-b350-7d2c6e4d9fc6" returned: 0 in 1.296s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:13:56 devstack cinder-volume[84448]: WARNING cinder.volume.drivers.remotefs [None req-58fe032c-78b6-45e2-8e2e-6b9bd89427ec tempest-SnapshotsActionsTest-339173462 None] /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.5cff0506-990c-4831-b350-7d2c6e4d9fc6 is being set with open permissions: ugo+rw Apr 29 15:13:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-58fe032c-78b6-45e2-8e2e-6b9bd89427ec tempest-SnapshotsActionsTest-339173462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.5cff0506-990c-4831-b350-7d2c6e4d9fc6 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:13:56 devstack sudo[95036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.5cff0506-990c-4831-b350-7d2c6e4d9fc6 Apr 29 15:13:56 devstack sudo[95036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:13:57 devstack sudo[95036]: pam_unix(sudo:session): session closed for user root Apr 29 15:13:57 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-58fe032c-78b6-45e2-8e2e-6b9bd89427ec tempest-SnapshotsActionsTest-339173462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.5cff0506-990c-4831-b350-7d2c6e4d9fc6" returned: 0 in 0.855s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:13:57 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-58fe032c-78b6-45e2-8e2e-6b9bd89427ec tempest-SnapshotsActionsTest-339173462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.637s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:13:57 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-58fe032c-78b6-45e2-8e2e-6b9bd89427ec tempest-SnapshotsActionsTest-339173462 None] Create snapshot completed successfully Apr 29 15:13:58 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-b4f60820-aed5-434a-9517-686b20c6ee30 tempest-SnapshotsActionsTest-1821736968 None] Acquiring lock "cinder-5cff0506-990c-4831-b350-7d2c6e4d9fc6-delete_snapshot" by "delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:13:58 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-b4f60820-aed5-434a-9517-686b20c6ee30 tempest-SnapshotsActionsTest-1821736968 None] Lock "cinder-5cff0506-990c-4831-b350-7d2c6e4d9fc6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:13:58 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-b4f60820-aed5-434a-9517-686b20c6ee30 tempest-SnapshotsActionsTest-1821736968 None] Acquiring lock "cinder-quobyte-daa4a945-abaf-45b3-818e-a0fa9206c6c4" by "delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:13:58 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-b4f60820-aed5-434a-9517-686b20c6ee30 tempest-SnapshotsActionsTest-1821736968 None] Lock "cinder-quobyte-daa4a945-abaf-45b3-818e-a0fa9206c6c4" acquired by "delete_snapshot" :: waited 0.131s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:13:58 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-b4f60820-aed5-434a-9517-686b20c6ee30 tempest-SnapshotsActionsTest-1821736968 None] Acquiring lock "cinder-quobyte-5cff0506-990c-4831-b350-7d2c6e4d9fc6" by "_delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:13:58 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-b4f60820-aed5-434a-9517-686b20c6ee30 tempest-SnapshotsActionsTest-1821736968 None] Lock "cinder-quobyte-5cff0506-990c-4831-b350-7d2c6e4d9fc6" acquired by "_delete_snapshot" :: waited 0.050s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:13:58 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-b4f60820-aed5-434a-9517-686b20c6ee30 tempest-SnapshotsActionsTest-1821736968 None] Deleting offline snapshot 5cff0506-990c-4831-b350-7d2c6e4d9fc6 of volume daa4a945-abaf-45b3-818e-a0fa9206c6c4 {{(pid=84448) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 15:13:58 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-b4f60820-aed5-434a-9517-686b20c6ee30 tempest-SnapshotsActionsTest-1821736968 None] snapshot_file for this snap is: volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.5cff0506-990c-4831-b350-7d2c6e4d9fc6 {{(pid=84448) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 15:13:58 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd8a0feb-a7cd-4d2e-a70b-17a46f96337b]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:13:58 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-b4f60820-aed5-434a-9517-686b20c6ee30 tempest-SnapshotsActionsTest-1821736968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.5cff0506-990c-4831-b350-7d2c6e4d9fc6 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:13:58 devstack sudo[95034]: pam_unix(sudo:session): session closed for user root Apr 29 15:13:58 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-3c48acb3-15ce-4c9a-b9e0-9020be63dfee req-91db616d-8f21-4c0c-98da-091baed94e3e tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_ngui5odtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-15dd86bf-12c1-4c27-87da-0cbda7909f51" returned: 0 in 2.757s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:13:58 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [req-3c48acb3-15ce-4c9a-b9e0-9020be63dfee req-91db616d-8f21-4c0c-98da-091baed94e3e tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_ngui5odtdevstack@QuobyteHD, size 112.00 MB, duration 2.76 sec, destination /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-15dd86bf-12c1-4c27-87da-0cbda7909f51 {{(pid=84448) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 15:13:58 devstack cinder-volume[84448]: INFO cinder.image.image_utils [req-3c48acb3-15ce-4c9a-b9e0-9020be63dfee req-91db616d-8f21-4c0c-98da-091baed94e3e tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Converted 112.00 MB image at 40.60 MB/s Apr 29 15:13:58 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-3c48acb3-15ce-4c9a-b9e0-9020be63dfee req-91db616d-8f21-4c0c-98da-091baed94e3e tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-15dd86bf-12c1-4c27-87da-0cbda7909f51 1G {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:13:59 devstack sudo[95046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-15dd86bf-12c1-4c27-87da-0cbda7909f51 1G Apr 29 15:13:59 devstack sudo[95046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:13:59 devstack sudo[95045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.5cff0506-990c-4831-b350-7d2c6e4d9fc6 Apr 29 15:13:59 devstack sudo[95045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:14:00 devstack sudo[95046]: pam_unix(sudo:session): session closed for user root Apr 29 15:14:00 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-3c48acb3-15ce-4c9a-b9e0-9020be63dfee req-91db616d-8f21-4c0c-98da-091baed94e3e tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-15dd86bf-12c1-4c27-87da-0cbda7909f51 1G" returned: 0 in 1.249s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:14:00 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[db261eee-b3c7-433e-af5e-d71fbbfd2793]: (4, 'raw') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:14:00 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-3c48acb3-15ce-4c9a-b9e0-9020be63dfee req-91db616d-8f21-4c0c-98da-091baed94e3e tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-15dd86bf-12c1-4c27-87da-0cbda7909f51 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:14:00 devstack sudo[95045]: pam_unix(sudo:session): session closed for user root Apr 29 15:14:00 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-b4f60820-aed5-434a-9517-686b20c6ee30 tempest-SnapshotsActionsTest-1821736968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.5cff0506-990c-4831-b350-7d2c6e4d9fc6" returned: 0 in 1.384s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:14:00 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-b4f60820-aed5-434a-9517-686b20c6ee30 tempest-SnapshotsActionsTest-1821736968 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84448) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 15:14:00 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba3f186-2773-483a-ba5d-7c39e1b7ab2f]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:14:00 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-b4f60820-aed5-434a-9517-686b20c6ee30 tempest-SnapshotsActionsTest-1821736968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f035a011-2e13-433a-8b3a-8685765c9bc8 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:14:00 devstack sudo[95055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-15dd86bf-12c1-4c27-87da-0cbda7909f51 Apr 29 15:14:00 devstack sudo[95055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:14:00 devstack sudo[95056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f035a011-2e13-433a-8b3a-8685765c9bc8 Apr 29 15:14:00 devstack sudo[95056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:14:01 devstack sudo[95056]: pam_unix(sudo:session): session closed for user root Apr 29 15:14:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-b4f60820-aed5-434a-9517-686b20c6ee30 tempest-SnapshotsActionsTest-1821736968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f035a011-2e13-433a-8b3a-8685765c9bc8" returned: 0 in 1.292s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:14:01 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-b4f60820-aed5-434a-9517-686b20c6ee30 tempest-SnapshotsActionsTest-1821736968 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84448) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 15:14:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-b4f60820-aed5-434a-9517-686b20c6ee30 tempest-SnapshotsActionsTest-1821736968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.5cff0506-990c-4831-b350-7d2c6e4d9fc6 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:14:01 devstack sudo[95064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.5cff0506-990c-4831-b350-7d2c6e4d9fc6 Apr 29 15:14:01 devstack sudo[95064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:14:01 devstack sudo[95055]: pam_unix(sudo:session): session closed for user root Apr 29 15:14:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-3c48acb3-15ce-4c9a-b9e0-9020be63dfee req-91db616d-8f21-4c0c-98da-091baed94e3e tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-15dd86bf-12c1-4c27-87da-0cbda7909f51" returned: 0 in 1.455s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:14:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-3c48acb3-15ce-4c9a-b9e0-9020be63dfee req-91db616d-8f21-4c0c-98da-091baed94e3e tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-15dd86bf-12c1-4c27-87da-0cbda7909f51 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:14:02 devstack sudo[95066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-15dd86bf-12c1-4c27-87da-0cbda7909f51 Apr 29 15:14:02 devstack sudo[95066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:14:03 devstack sudo[95064]: pam_unix(sudo:session): session closed for user root Apr 29 15:14:03 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-b4f60820-aed5-434a-9517-686b20c6ee30 tempest-SnapshotsActionsTest-1821736968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.5cff0506-990c-4831-b350-7d2c6e4d9fc6" returned: 0 in 1.444s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:14:03 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-b4f60820-aed5-434a-9517-686b20c6ee30 tempest-SnapshotsActionsTest-1821736968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.5cff0506-990c-4831-b350-7d2c6e4d9fc6 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:14:03 devstack sudo[95079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.5cff0506-990c-4831-b350-7d2c6e4d9fc6 Apr 29 15:14:03 devstack sudo[95079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:14:03 devstack sudo[95066]: pam_unix(sudo:session): session closed for user root Apr 29 15:14:03 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-3c48acb3-15ce-4c9a-b9e0-9020be63dfee req-91db616d-8f21-4c0c-98da-091baed94e3e tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-15dd86bf-12c1-4c27-87da-0cbda7909f51" returned: 1 in 1.515s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:14:03 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-3c48acb3-15ce-4c9a-b9e0-9020be63dfee req-91db616d-8f21-4c0c-98da-091baed94e3e tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-15dd86bf-12c1-4c27-87da-0cbda7909f51' failed. Not Retrying. {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 15:14:03 devstack cinder-volume[84448]: DEBUG cinder.volume.volume_utils [req-3c48acb3-15ce-4c9a-b9e0-9020be63dfee req-91db616d-8f21-4c0c-98da-091baed94e3e tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Downloaded image ad86f424-7d2a-4f3b-9577-890075e7dc72 ((None, [{'url': 'file:///opt/stack/data/glance/images/ad86f424-7d2a-4f3b-9577-890075e7dc72', 'metadata': {}}])) to volume 15dd86bf-12c1-4c27-87da-0cbda7909f51 successfully. {{(pid=84448) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 29 15:14:03 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [req-3c48acb3-15ce-4c9a-b9e0-9020be63dfee req-91db616d-8f21-4c0c-98da-091baed94e3e tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Temporary image ad86f424-7d2a-4f3b-9577-890075e7dc72 for user 1bdf8feb2bba476a9253ccbe0ba9cf91 is deleted. {{(pid=84448) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 29 15:14:03 devstack cinder-volume[84448]: DEBUG cinder.volume.volume_utils [req-3c48acb3-15ce-4c9a-b9e0-9020be63dfee req-91db616d-8f21-4c0c-98da-091baed94e3e tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Marking volume 15dd86bf-12c1-4c27-87da-0cbda7909f51 as bootable. {{(pid=84448) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 29 15:14:03 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [req-3c48acb3-15ce-4c9a-b9e0-9020be63dfee req-91db616d-8f21-4c0c-98da-091baed94e3e tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Copying metadata from image ad86f424-7d2a-4f3b-9577-890075e7dc72 to 15dd86bf-12c1-4c27-87da-0cbda7909f51. {{(pid=84448) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 29 15:14:03 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [req-3c48acb3-15ce-4c9a-b9e0-9020be63dfee req-91db616d-8f21-4c0c-98da-091baed94e3e tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Creating volume glance metadata for volume 15dd86bf-12c1-4c27-87da-0cbda7909f51 backed by image ad86f424-7d2a-4f3b-9577-890075e7dc72 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'ad86f424-7d2a-4f3b-9577-890075e7dc72', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84448) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 29 15:14:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-3c48acb3-15ce-4c9a-b9e0-9020be63dfee req-91db616d-8f21-4c0c-98da-091baed94e3e tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47f7cd03-e92d-4d9c-a482-e3dbb98529d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15dd86bf-12c1-4c27-87da-0cbda7909f51', 'volume_size': 1, 'image_id': 'ad86f424-7d2a-4f3b-9577-890075e7dc72', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ad86f424-7d2a-4f3b-9577-890075e7dc72', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '33db0ca5091747b1a3438d70bf53390c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ad86f424-7d2a-4f3b-9577-890075e7dc72', 'created_at': datetime.datetime(2026, 4, 29, 13, 0, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 13, 0, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ad86f424-7d2a-4f3b-9577-890075e7dc72/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:14:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-3c48acb3-15ce-4c9a-b9e0-9020be63dfee req-91db616d-8f21-4c0c-98da-091baed94e3e tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (621cc973-bff1-4fd2-b353-4e237669c568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:14:03 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [req-3c48acb3-15ce-4c9a-b9e0-9020be63dfee req-91db616d-8f21-4c0c-98da-091baed94e3e tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Volume volume-15dd86bf-12c1-4c27-87da-0cbda7909f51 (15dd86bf-12c1-4c27-87da-0cbda7909f51): created successfully Apr 29 15:14:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-3c48acb3-15ce-4c9a-b9e0-9020be63dfee req-91db616d-8f21-4c0c-98da-091baed94e3e tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (621cc973-bff1-4fd2-b353-4e237669c568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:14:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-3c48acb3-15ce-4c9a-b9e0-9020be63dfee req-91db616d-8f21-4c0c-98da-091baed94e3e tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Flow 'volume_create_manager' (58ed4282-cef2-4c6b-9c64-17ecf01641a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:14:03 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-3c48acb3-15ce-4c9a-b9e0-9020be63dfee req-91db616d-8f21-4c0c-98da-091baed94e3e tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Created volume successfully. Apr 29 15:14:03 devstack sudo[95079]: pam_unix(sudo:session): session closed for user root Apr 29 15:14:03 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-b4f60820-aed5-434a-9517-686b20c6ee30 tempest-SnapshotsActionsTest-1821736968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.5cff0506-990c-4831-b350-7d2c6e4d9fc6" returned: 0 in 0.770s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:14:03 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-b4f60820-aed5-434a-9517-686b20c6ee30 tempest-SnapshotsActionsTest-1821736968 None] Lock "cinder-quobyte-5cff0506-990c-4831-b350-7d2c6e4d9fc6" released by "_delete_snapshot" :: held 5.069s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:14:03 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-b4f60820-aed5-434a-9517-686b20c6ee30 tempest-SnapshotsActionsTest-1821736968 None] Lock "cinder-quobyte-daa4a945-abaf-45b3-818e-a0fa9206c6c4" released by "delete_snapshot" :: held 5.127s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:14:03 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-b4f60820-aed5-434a-9517-686b20c6ee30 tempest-SnapshotsActionsTest-1821736968 None] Created reservations ['9d1bfab3-f879-4999-9791-dbee7f2d0efa', 'd89459f9-eb29-4b56-b6f2-d2f117cfa6f7', 'ed862c3f-21a9-419f-a739-44095b06be33', '4c0e9d60-9332-4f65-b91d-40f942e93082'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:14:04 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-b4f60820-aed5-434a-9517-686b20c6ee30 tempest-SnapshotsActionsTest-1821736968 None] Delete snapshot completed successfully. Apr 29 15:14:04 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-b4f60820-aed5-434a-9517-686b20c6ee30 tempest-SnapshotsActionsTest-1821736968 None] Lock "cinder-5cff0506-990c-4831-b350-7d2c6e4d9fc6-delete_snapshot" released by "delete_snapshot" :: held 5.388s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:14:05 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-81a14194-2dd3-4813-9d4d-428d4a2cb861 tempest-SnapshotsActionsTest-339173462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:14:05 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-81a14194-2dd3-4813-9d4d-428d4a2cb861 tempest-SnapshotsActionsTest-339173462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:14:05 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-81a14194-2dd3-4813-9d4d-428d4a2cb861 tempest-SnapshotsActionsTest-339173462 None] Creating offline snapshot 2aad5824-dcb6-44d7-ac1d-89118f512cb6 of volume daa4a945-abaf-45b3-818e-a0fa9206c6c4 {{(pid=84448) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 15:14:05 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc55c94-ca0b-4530-bb98-4a7c5e25c60b]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:14:05 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-81a14194-2dd3-4813-9d4d-428d4a2cb861 tempest-SnapshotsActionsTest-339173462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f035a011-2e13-433a-8b3a-8685765c9bc8 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:14:05 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:UPDATE=49,cinder:SELECT=48,cinder:INSERT=18,cinder:DELETE=1 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:14:05 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:SELECT=58,cinder:INSERT=18,cinder:UPDATE=44,cinder:DELETE=7 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:14:05 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-3c48acb3-15ce-4c9a-b9e0-9020be63dfee req-82b69a6b-935b-4cb0-84ca-d9244c69492e tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:14:05 devstack sudo[95114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f035a011-2e13-433a-8b3a-8685765c9bc8 Apr 29 15:14:05 devstack sudo[95114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:14:06 devstack sudo[95114]: pam_unix(sudo:session): session closed for user root Apr 29 15:14:06 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-81a14194-2dd3-4813-9d4d-428d4a2cb861 tempest-SnapshotsActionsTest-339173462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f035a011-2e13-433a-8b3a-8685765c9bc8" returned: 0 in 0.758s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:14:06 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-81a14194-2dd3-4813-9d4d-428d4a2cb861 tempest-SnapshotsActionsTest-339173462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84448) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 15:14:06 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-81a14194-2dd3-4813-9d4d-428d4a2cb861 tempest-SnapshotsActionsTest-339173462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f035a011-2e13-433a-8b3a-8685765c9bc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.2aad5824-dcb6-44d7-ac1d-89118f512cb6 1G {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:14:06 devstack sudo[95120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f035a011-2e13-433a-8b3a-8685765c9bc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.2aad5824-dcb6-44d7-ac1d-89118f512cb6 1G Apr 29 15:14:06 devstack sudo[95120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:14:07 devstack sudo[95120]: pam_unix(sudo:session): session closed for user root Apr 29 15:14:07 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-81a14194-2dd3-4813-9d4d-428d4a2cb861 tempest-SnapshotsActionsTest-339173462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f035a011-2e13-433a-8b3a-8685765c9bc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.2aad5824-dcb6-44d7-ac1d-89118f512cb6 1G" returned: 0 in 0.806s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:14:07 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-81a14194-2dd3-4813-9d4d-428d4a2cb861 tempest-SnapshotsActionsTest-339173462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f035a011-2e13-433a-8b3a-8685765c9bc8 -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.2aad5824-dcb6-44d7-ac1d-89118f512cb6 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:14:07 devstack sudo[95127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f035a011-2e13-433a-8b3a-8685765c9bc8 -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.2aad5824-dcb6-44d7-ac1d-89118f512cb6 Apr 29 15:14:07 devstack sudo[95127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:14:07 devstack sudo[95127]: pam_unix(sudo:session): session closed for user root Apr 29 15:14:07 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-81a14194-2dd3-4813-9d4d-428d4a2cb861 tempest-SnapshotsActionsTest-339173462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f035a011-2e13-433a-8b3a-8685765c9bc8 -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.2aad5824-dcb6-44d7-ac1d-89118f512cb6" returned: 0 in 0.658s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:14:07 devstack cinder-volume[84448]: WARNING cinder.volume.drivers.remotefs [None req-81a14194-2dd3-4813-9d4d-428d4a2cb861 tempest-SnapshotsActionsTest-339173462 None] /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.2aad5824-dcb6-44d7-ac1d-89118f512cb6 is being set with open permissions: ugo+rw Apr 29 15:14:07 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-81a14194-2dd3-4813-9d4d-428d4a2cb861 tempest-SnapshotsActionsTest-339173462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.2aad5824-dcb6-44d7-ac1d-89118f512cb6 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:14:07 devstack sudo[95132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.2aad5824-dcb6-44d7-ac1d-89118f512cb6 Apr 29 15:14:07 devstack sudo[95132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:14:08 devstack sudo[95132]: pam_unix(sudo:session): session closed for user root Apr 29 15:14:08 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-81a14194-2dd3-4813-9d4d-428d4a2cb861 tempest-SnapshotsActionsTest-339173462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.2aad5824-dcb6-44d7-ac1d-89118f512cb6" returned: 0 in 0.629s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:14:08 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-81a14194-2dd3-4813-9d4d-428d4a2cb861 tempest-SnapshotsActionsTest-339173462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.985s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:14:08 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-3c48acb3-15ce-4c9a-b9e0-9020be63dfee req-82b69a6b-935b-4cb0-84ca-d9244c69492e tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.787s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:14:08 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-81a14194-2dd3-4813-9d4d-428d4a2cb861 tempest-SnapshotsActionsTest-339173462 None] Create snapshot completed successfully Apr 29 15:14:08 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[c19fcb90-58e2-4fdf-935b-24bd41da2a5a]: (4, 'raw') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:14:08 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-3c48acb3-15ce-4c9a-b9e0-9020be63dfee req-82b69a6b-935b-4cb0-84ca-d9244c69492e tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-15dd86bf-12c1-4c27-87da-0cbda7909f51 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:14:08 devstack sudo[95135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-15dd86bf-12c1-4c27-87da-0cbda7909f51 Apr 29 15:14:08 devstack sudo[95135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:14:08 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-2a0731c7-be8e-4989-91e9-b8e1c23f03a4 tempest-SnapshotsActionsTest-1821736968 None] Acquiring lock "cinder-2aad5824-dcb6-44d7-ac1d-89118f512cb6-delete_snapshot" by "delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:14:08 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-2a0731c7-be8e-4989-91e9-b8e1c23f03a4 tempest-SnapshotsActionsTest-1821736968 None] Lock "cinder-2aad5824-dcb6-44d7-ac1d-89118f512cb6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:14:08 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-2a0731c7-be8e-4989-91e9-b8e1c23f03a4 tempest-SnapshotsActionsTest-1821736968 None] Acquiring lock "cinder-quobyte-daa4a945-abaf-45b3-818e-a0fa9206c6c4" by "delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:14:08 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-2a0731c7-be8e-4989-91e9-b8e1c23f03a4 tempest-SnapshotsActionsTest-1821736968 None] Lock "cinder-quobyte-daa4a945-abaf-45b3-818e-a0fa9206c6c4" acquired by "delete_snapshot" :: waited 0.020s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:14:08 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-2a0731c7-be8e-4989-91e9-b8e1c23f03a4 tempest-SnapshotsActionsTest-1821736968 None] Acquiring lock "cinder-quobyte-2aad5824-dcb6-44d7-ac1d-89118f512cb6" by "_delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:14:08 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-2a0731c7-be8e-4989-91e9-b8e1c23f03a4 tempest-SnapshotsActionsTest-1821736968 None] Lock "cinder-quobyte-2aad5824-dcb6-44d7-ac1d-89118f512cb6" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:14:08 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-2a0731c7-be8e-4989-91e9-b8e1c23f03a4 tempest-SnapshotsActionsTest-1821736968 None] Deleting offline snapshot 2aad5824-dcb6-44d7-ac1d-89118f512cb6 of volume daa4a945-abaf-45b3-818e-a0fa9206c6c4 {{(pid=84448) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 15:14:08 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-2a0731c7-be8e-4989-91e9-b8e1c23f03a4 tempest-SnapshotsActionsTest-1821736968 None] snapshot_file for this snap is: volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.2aad5824-dcb6-44d7-ac1d-89118f512cb6 {{(pid=84448) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 15:14:08 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ab2f68-3be8-4496-956a-06bad84fe10d]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:14:08 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-2a0731c7-be8e-4989-91e9-b8e1c23f03a4 tempest-SnapshotsActionsTest-1821736968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.2aad5824-dcb6-44d7-ac1d-89118f512cb6 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:14:08 devstack sudo[95137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.2aad5824-dcb6-44d7-ac1d-89118f512cb6 Apr 29 15:14:08 devstack sudo[95137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:14:09 devstack sudo[95135]: pam_unix(sudo:session): session closed for user root Apr 29 15:14:09 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-3c48acb3-15ce-4c9a-b9e0-9020be63dfee req-82b69a6b-935b-4cb0-84ca-d9244c69492e tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-15dd86bf-12c1-4c27-87da-0cbda7909f51" returned: 0 in 0.754s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:14:09 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-3c48acb3-15ce-4c9a-b9e0-9020be63dfee req-82b69a6b-935b-4cb0-84ca-d9244c69492e tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-15dd86bf-12c1-4c27-87da-0cbda7909f51 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:14:09 devstack sudo[95141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-15dd86bf-12c1-4c27-87da-0cbda7909f51 Apr 29 15:14:09 devstack sudo[95141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:14:09 devstack sudo[95137]: pam_unix(sudo:session): session closed for user root Apr 29 15:14:09 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-2a0731c7-be8e-4989-91e9-b8e1c23f03a4 tempest-SnapshotsActionsTest-1821736968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.2aad5824-dcb6-44d7-ac1d-89118f512cb6" returned: 0 in 0.844s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:14:09 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-2a0731c7-be8e-4989-91e9-b8e1c23f03a4 tempest-SnapshotsActionsTest-1821736968 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84448) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 15:14:09 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb033bc-05e6-40d7-89db-f332420b5866]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:14:09 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-2a0731c7-be8e-4989-91e9-b8e1c23f03a4 tempest-SnapshotsActionsTest-1821736968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f035a011-2e13-433a-8b3a-8685765c9bc8 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:14:09 devstack sudo[95147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f035a011-2e13-433a-8b3a-8685765c9bc8 Apr 29 15:14:09 devstack sudo[95147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:14:10 devstack sudo[95141]: pam_unix(sudo:session): session closed for user root Apr 29 15:14:10 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-3c48acb3-15ce-4c9a-b9e0-9020be63dfee req-82b69a6b-935b-4cb0-84ca-d9244c69492e tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-15dd86bf-12c1-4c27-87da-0cbda7909f51" returned: 1 in 0.921s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:14:10 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-3c48acb3-15ce-4c9a-b9e0-9020be63dfee req-82b69a6b-935b-4cb0-84ca-d9244c69492e tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-15dd86bf-12c1-4c27-87da-0cbda7909f51' failed. Not Retrying. {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 15:14:10 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-3c48acb3-15ce-4c9a-b9e0-9020be63dfee req-82b69a6b-935b-4cb0-84ca-d9244c69492e tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.730s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:14:10 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-3c48acb3-15ce-4c9a-b9e0-9020be63dfee req-82b69a6b-935b-4cb0-84ca-d9244c69492e tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a', 'name': 'volume-15dd86bf-12c1-4c27-87da-0cbda7909f51', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1daa26f1-d4dc-4746-b436-504fc28ec1e2', 'enforce_multipath': True} {{(pid=84448) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 15:14:10 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-3c48acb3-15ce-4c9a-b9e0-9020be63dfee req-82b69a6b-935b-4cb0-84ca-d9244c69492e tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] attachment_update completed successfully. Apr 29 15:14:10 devstack sudo[95147]: pam_unix(sudo:session): session closed for user root Apr 29 15:14:10 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-2a0731c7-be8e-4989-91e9-b8e1c23f03a4 tempest-SnapshotsActionsTest-1821736968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f035a011-2e13-433a-8b3a-8685765c9bc8" returned: 0 in 0.845s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:14:10 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-2a0731c7-be8e-4989-91e9-b8e1c23f03a4 tempest-SnapshotsActionsTest-1821736968 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84448) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 15:14:10 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-2a0731c7-be8e-4989-91e9-b8e1c23f03a4 tempest-SnapshotsActionsTest-1821736968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.2aad5824-dcb6-44d7-ac1d-89118f512cb6 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:14:10 devstack sudo[95155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.2aad5824-dcb6-44d7-ac1d-89118f512cb6 Apr 29 15:14:10 devstack sudo[95155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:14:11 devstack sudo[95155]: pam_unix(sudo:session): session closed for user root Apr 29 15:14:11 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-2a0731c7-be8e-4989-91e9-b8e1c23f03a4 tempest-SnapshotsActionsTest-1821736968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.2aad5824-dcb6-44d7-ac1d-89118f512cb6" returned: 0 in 0.937s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:14:11 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-2a0731c7-be8e-4989-91e9-b8e1c23f03a4 tempest-SnapshotsActionsTest-1821736968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.2aad5824-dcb6-44d7-ac1d-89118f512cb6 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:14:11 devstack sudo[95170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.2aad5824-dcb6-44d7-ac1d-89118f512cb6 Apr 29 15:14:11 devstack sudo[95170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:14:12 devstack sudo[95170]: pam_unix(sudo:session): session closed for user root Apr 29 15:14:12 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-2a0731c7-be8e-4989-91e9-b8e1c23f03a4 tempest-SnapshotsActionsTest-1821736968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.2aad5824-dcb6-44d7-ac1d-89118f512cb6" returned: 0 in 0.716s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:14:12 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-2a0731c7-be8e-4989-91e9-b8e1c23f03a4 tempest-SnapshotsActionsTest-1821736968 None] Lock "cinder-quobyte-2aad5824-dcb6-44d7-ac1d-89118f512cb6" released by "_delete_snapshot" :: held 3.467s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:14:12 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-2a0731c7-be8e-4989-91e9-b8e1c23f03a4 tempest-SnapshotsActionsTest-1821736968 None] Lock "cinder-quobyte-daa4a945-abaf-45b3-818e-a0fa9206c6c4" released by "delete_snapshot" :: held 3.492s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:14:12 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-2a0731c7-be8e-4989-91e9-b8e1c23f03a4 tempest-SnapshotsActionsTest-1821736968 None] Created reservations ['89e5ba92-bae8-4453-9f4f-86517ef0f122', 'b59e64c5-d856-4ad7-912a-16fa41179ac5', '5bc67025-e135-4cbf-8836-92fdcab33cb7', 'a87d2d11-bd8e-4d08-bd5b-589666841204'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:14:12 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-2a0731c7-be8e-4989-91e9-b8e1c23f03a4 tempest-SnapshotsActionsTest-1821736968 None] Delete snapshot completed successfully. Apr 29 15:14:12 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-2a0731c7-be8e-4989-91e9-b8e1c23f03a4 tempest-SnapshotsActionsTest-1821736968 None] Lock "cinder-2aad5824-dcb6-44d7-ac1d-89118f512cb6-delete_snapshot" released by "delete_snapshot" :: held 3.683s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:14:13 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-bfe4cb47-2029-4e0a-8acd-55fa11635a9a tempest-SnapshotsActionsTest-339173462 None] Acquiring lock "cinder-f035a011-2e13-433a-8b3a-8685765c9bc8-delete_snapshot" by "delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:14:13 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-bfe4cb47-2029-4e0a-8acd-55fa11635a9a tempest-SnapshotsActionsTest-339173462 None] Lock "cinder-f035a011-2e13-433a-8b3a-8685765c9bc8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:14:13 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-bfe4cb47-2029-4e0a-8acd-55fa11635a9a tempest-SnapshotsActionsTest-339173462 None] Acquiring lock "cinder-quobyte-daa4a945-abaf-45b3-818e-a0fa9206c6c4" by "delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:14:13 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-bfe4cb47-2029-4e0a-8acd-55fa11635a9a tempest-SnapshotsActionsTest-339173462 None] Lock "cinder-quobyte-daa4a945-abaf-45b3-818e-a0fa9206c6c4" acquired by "delete_snapshot" :: waited 0.015s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:14:13 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-bfe4cb47-2029-4e0a-8acd-55fa11635a9a tempest-SnapshotsActionsTest-339173462 None] Acquiring lock "cinder-quobyte-f035a011-2e13-433a-8b3a-8685765c9bc8" by "_delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:14:13 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-bfe4cb47-2029-4e0a-8acd-55fa11635a9a tempest-SnapshotsActionsTest-339173462 None] Lock "cinder-quobyte-f035a011-2e13-433a-8b3a-8685765c9bc8" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:14:13 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-bfe4cb47-2029-4e0a-8acd-55fa11635a9a tempest-SnapshotsActionsTest-339173462 None] Deleting offline snapshot f035a011-2e13-433a-8b3a-8685765c9bc8 of volume daa4a945-abaf-45b3-818e-a0fa9206c6c4 {{(pid=84448) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 15:14:13 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-bfe4cb47-2029-4e0a-8acd-55fa11635a9a tempest-SnapshotsActionsTest-339173462 None] snapshot_file for this snap is: volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f035a011-2e13-433a-8b3a-8685765c9bc8 {{(pid=84448) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 15:14:13 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[a449628c-62f3-4034-af15-dbb378b5882b]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:14:13 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-bfe4cb47-2029-4e0a-8acd-55fa11635a9a tempest-SnapshotsActionsTest-339173462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f035a011-2e13-433a-8b3a-8685765c9bc8 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:14:13 devstack sudo[95248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f035a011-2e13-433a-8b3a-8685765c9bc8 Apr 29 15:14:13 devstack sudo[95248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:14:14 devstack sudo[95248]: pam_unix(sudo:session): session closed for user root Apr 29 15:14:14 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-bfe4cb47-2029-4e0a-8acd-55fa11635a9a tempest-SnapshotsActionsTest-339173462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f035a011-2e13-433a-8b3a-8685765c9bc8" returned: 0 in 0.762s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:14:14 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-bfe4cb47-2029-4e0a-8acd-55fa11635a9a tempest-SnapshotsActionsTest-339173462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84448) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 15:14:14 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7361d2f-49fe-47d5-9adf-5825bb8b883e]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:14:14 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-bfe4cb47-2029-4e0a-8acd-55fa11635a9a tempest-SnapshotsActionsTest-339173462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:14:14 devstack sudo[95263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4 Apr 29 15:14:14 devstack sudo[95263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:14:14 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-43958c97-af09-4682-9e68-c5f8b1a691c7 tempest-AttachVolumeNegativeTest-1321218953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:14:14 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-43958c97-af09-4682-9e68-c5f8b1a691c7 tempest-AttachVolumeNegativeTest-1321218953 None] Flow 'volume_create_manager' (24f0ce18-c9b3-4838-a50b-b4ca4b0b8c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:14:14 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-43958c97-af09-4682-9e68-c5f8b1a691c7 tempest-AttachVolumeNegativeTest-1321218953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c633b36-0d87-4511-be3b-7823621bc40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:14:14 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-43958c97-af09-4682-9e68-c5f8b1a691c7 tempest-AttachVolumeNegativeTest-1321218953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c633b36-0d87-4511-be3b-7823621bc40b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:14:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2044609315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ce1ca81-ef62-438c-9740-f002c0a6fda3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f80705dfae64e8cbfd0e0cbeacc682e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:14:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:14:15Z,use_quota=True,user_id='decaea8fffd2452eb3b2bb1bd5eff95f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:14:14 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-43958c97-af09-4682-9e68-c5f8b1a691c7 tempest-AttachVolumeNegativeTest-1321218953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f730e5cf-5baf-4d83-9943-17bf9c4def06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:14:14 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-43958c97-af09-4682-9e68-c5f8b1a691c7 tempest-AttachVolumeNegativeTest-1321218953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f730e5cf-5baf-4d83-9943-17bf9c4def06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:14:14 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-43958c97-af09-4682-9e68-c5f8b1a691c7 tempest-AttachVolumeNegativeTest-1321218953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6a7497f-044d-4b9f-8d85-d466f627d271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:14:14 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-43958c97-af09-4682-9e68-c5f8b1a691c7 tempest-AttachVolumeNegativeTest-1321218953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6a7497f-044d-4b9f-8d85-d466f627d271) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ce1ca81-ef62-438c-9740-f002c0a6fda3', 'volume_name': 'volume-1ce1ca81-ef62-438c-9740-f002c0a6fda3', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:14:14 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-43958c97-af09-4682-9e68-c5f8b1a691c7 tempest-AttachVolumeNegativeTest-1321218953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78215775-332a-4ba4-a86b-1f27f30a4552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:14:14 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-43958c97-af09-4682-9e68-c5f8b1a691c7 tempest-AttachVolumeNegativeTest-1321218953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78215775-332a-4ba4-a86b-1f27f30a4552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:14:14 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-43958c97-af09-4682-9e68-c5f8b1a691c7 tempest-AttachVolumeNegativeTest-1321218953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c63bf388-5746-412d-9512-85d2f8375e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:14:14 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-43958c97-af09-4682-9e68-c5f8b1a691c7 tempest-AttachVolumeNegativeTest-1321218953 None] Volume 1ce1ca81-ef62-438c-9740-f002c0a6fda3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ce1ca81-ef62-438c-9740-f002c0a6fda3', 'volume_size': 1} Apr 29 15:14:14 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-43958c97-af09-4682-9e68-c5f8b1a691c7 tempest-AttachVolumeNegativeTest-1321218953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:14:14 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-43958c97-af09-4682-9e68-c5f8b1a691c7 tempest-AttachVolumeNegativeTest-1321218953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:14:14 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-43958c97-af09-4682-9e68-c5f8b1a691c7 tempest-AttachVolumeNegativeTest-1321218953 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:14:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2044609315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ce1ca81-ef62-438c-9740-f002c0a6fda3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f80705dfae64e8cbfd0e0cbeacc682e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:14:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:14:15Z,use_quota=True,user_id='decaea8fffd2452eb3b2bb1bd5eff95f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:14:14 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-43958c97-af09-4682-9e68-c5f8b1a691c7 tempest-AttachVolumeNegativeTest-1321218953 None] Creating volume 1ce1ca81-ef62-438c-9740-f002c0a6fda3 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:14:14 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-43958c97-af09-4682-9e68-c5f8b1a691c7 tempest-AttachVolumeNegativeTest-1321218953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:14:14 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-43958c97-af09-4682-9e68-c5f8b1a691c7 tempest-AttachVolumeNegativeTest-1321218953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:14:14 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-43958c97-af09-4682-9e68-c5f8b1a691c7 tempest-AttachVolumeNegativeTest-1321218953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:14:14 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-43958c97-af09-4682-9e68-c5f8b1a691c7 tempest-AttachVolumeNegativeTest-1321218953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:14:14 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-43958c97-af09-4682-9e68-c5f8b1a691c7 tempest-AttachVolumeNegativeTest-1321218953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:14:14 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-43958c97-af09-4682-9e68-c5f8b1a691c7 tempest-AttachVolumeNegativeTest-1321218953 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:14:14 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-43958c97-af09-4682-9e68-c5f8b1a691c7 tempest-AttachVolumeNegativeTest-1321218953 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:14:14 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-43958c97-af09-4682-9e68-c5f8b1a691c7 tempest-AttachVolumeNegativeTest-1321218953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1ce1ca81-ef62-438c-9740-f002c0a6fda3 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:14:14 devstack sudo[95275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1ce1ca81-ef62-438c-9740-f002c0a6fda3 1073741824 Apr 29 15:14:14 devstack sudo[95275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:14:14 devstack sudo[95263]: pam_unix(sudo:session): session closed for user root Apr 29 15:14:14 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-bfe4cb47-2029-4e0a-8acd-55fa11635a9a tempest-SnapshotsActionsTest-339173462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4" returned: 0 in 0.781s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:14:14 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-bfe4cb47-2029-4e0a-8acd-55fa11635a9a tempest-SnapshotsActionsTest-339173462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f035a011-2e13-433a-8b3a-8685765c9bc8 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:14:14 devstack sudo[95280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f035a011-2e13-433a-8b3a-8685765c9bc8 Apr 29 15:14:14 devstack sudo[95280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:14:15 devstack sudo[95275]: pam_unix(sudo:session): session closed for user root Apr 29 15:14:15 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-43958c97-af09-4682-9e68-c5f8b1a691c7 tempest-AttachVolumeNegativeTest-1321218953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1ce1ca81-ef62-438c-9740-f002c0a6fda3 1073741824" returned: 0 in 1.182s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:14:16 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-43958c97-af09-4682-9e68-c5f8b1a691c7 tempest-AttachVolumeNegativeTest-1321218953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1ce1ca81-ef62-438c-9740-f002c0a6fda3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:14:16 devstack sudo[95280]: pam_unix(sudo:session): session closed for user root Apr 29 15:14:16 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-bfe4cb47-2029-4e0a-8acd-55fa11635a9a tempest-SnapshotsActionsTest-339173462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f035a011-2e13-433a-8b3a-8685765c9bc8" returned: 0 in 1.098s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:14:16 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-bfe4cb47-2029-4e0a-8acd-55fa11635a9a tempest-SnapshotsActionsTest-339173462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f035a011-2e13-433a-8b3a-8685765c9bc8 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:14:16 devstack sudo[95657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1ce1ca81-ef62-438c-9740-f002c0a6fda3 Apr 29 15:14:16 devstack sudo[95657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:14:16 devstack sudo[95658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f035a011-2e13-433a-8b3a-8685765c9bc8 Apr 29 15:14:16 devstack sudo[95658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:14:17 devstack sudo[95657]: pam_unix(sudo:session): session closed for user root Apr 29 15:14:17 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-43958c97-af09-4682-9e68-c5f8b1a691c7 tempest-AttachVolumeNegativeTest-1321218953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1ce1ca81-ef62-438c-9740-f002c0a6fda3" returned: 0 in 1.432s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:14:17 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-43958c97-af09-4682-9e68-c5f8b1a691c7 tempest-AttachVolumeNegativeTest-1321218953 None] <== create_volume: return (2724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:14:17 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-43958c97-af09-4682-9e68-c5f8b1a691c7 tempest-AttachVolumeNegativeTest-1321218953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.726s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:14:17 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-43958c97-af09-4682-9e68-c5f8b1a691c7 tempest-AttachVolumeNegativeTest-1321218953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c63bf388-5746-412d-9512-85d2f8375e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ce1ca81-ef62-438c-9740-f002c0a6fda3', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:14:17 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-43958c97-af09-4682-9e68-c5f8b1a691c7 tempest-AttachVolumeNegativeTest-1321218953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0447686a-a274-46cb-8d25-06c4d61a58e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:14:17 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-43958c97-af09-4682-9e68-c5f8b1a691c7 tempest-AttachVolumeNegativeTest-1321218953 None] Volume volume-1ce1ca81-ef62-438c-9740-f002c0a6fda3 (1ce1ca81-ef62-438c-9740-f002c0a6fda3): created successfully Apr 29 15:14:17 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-43958c97-af09-4682-9e68-c5f8b1a691c7 tempest-AttachVolumeNegativeTest-1321218953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0447686a-a274-46cb-8d25-06c4d61a58e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:14:17 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-43958c97-af09-4682-9e68-c5f8b1a691c7 tempest-AttachVolumeNegativeTest-1321218953 None] Flow 'volume_create_manager' (24f0ce18-c9b3-4838-a50b-b4ca4b0b8c78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:14:17 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-43958c97-af09-4682-9e68-c5f8b1a691c7 tempest-AttachVolumeNegativeTest-1321218953 None] Created volume successfully. Apr 29 15:14:17 devstack sudo[95658]: pam_unix(sudo:session): session closed for user root Apr 29 15:14:17 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-bfe4cb47-2029-4e0a-8acd-55fa11635a9a tempest-SnapshotsActionsTest-339173462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4.f035a011-2e13-433a-8b3a-8685765c9bc8" returned: 0 in 1.617s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:14:17 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-bfe4cb47-2029-4e0a-8acd-55fa11635a9a tempest-SnapshotsActionsTest-339173462 None] Lock "cinder-quobyte-f035a011-2e13-433a-8b3a-8685765c9bc8" released by "_delete_snapshot" :: held 4.448s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:14:17 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-bfe4cb47-2029-4e0a-8acd-55fa11635a9a tempest-SnapshotsActionsTest-339173462 None] Lock "cinder-quobyte-daa4a945-abaf-45b3-818e-a0fa9206c6c4" released by "delete_snapshot" :: held 4.483s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:14:17 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-bfe4cb47-2029-4e0a-8acd-55fa11635a9a tempest-SnapshotsActionsTest-339173462 None] Created reservations ['78d47111-b615-4ffa-8fb7-5d103c318d0b', '1b6e0abc-ec5a-4ae8-a5ab-7089cd97c451', 'e004446a-24d0-4252-80f1-8fa89bda90bf', '62175fae-5d6d-40a1-b5cf-8270e6f12eac'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:14:18 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-bfe4cb47-2029-4e0a-8acd-55fa11635a9a tempest-SnapshotsActionsTest-339173462 None] Delete snapshot completed successfully. Apr 29 15:14:18 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-bfe4cb47-2029-4e0a-8acd-55fa11635a9a tempest-SnapshotsActionsTest-339173462 None] Lock "cinder-f035a011-2e13-433a-8b3a-8685765c9bc8-delete_snapshot" released by "delete_snapshot" :: held 4.783s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:14:18 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-11b0e60f-edb3-4d2a-8399-815d4811b90f tempest-SnapshotsActionsTest-339173462 None] Acquiring lock "cinder-daa4a945-abaf-45b3-818e-a0fa9206c6c4-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:14:18 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-11b0e60f-edb3-4d2a-8399-815d4811b90f tempest-SnapshotsActionsTest-339173462 None] Lock "cinder-daa4a945-abaf-45b3-818e-a0fa9206c6c4-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:14:18 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-11b0e60f-edb3-4d2a-8399-815d4811b90f tempest-SnapshotsActionsTest-339173462 None] Acquiring lock "cinder-quobyte-daa4a945-abaf-45b3-818e-a0fa9206c6c4" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:14:18 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-11b0e60f-edb3-4d2a-8399-815d4811b90f tempest-SnapshotsActionsTest-339173462 None] Lock "cinder-quobyte-daa4a945-abaf-45b3-818e-a0fa9206c6c4" acquired by "delete_volume" :: waited 0.015s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:14:19 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[a12349c4-366d-4196-9e48-e21fbea7ab24]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:14:19 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-11b0e60f-edb3-4d2a-8399-815d4811b90f tempest-SnapshotsActionsTest-339173462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:14:19 devstack sudo[95748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4 Apr 29 15:14:19 devstack sudo[95748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:14:20 devstack sudo[95748]: pam_unix(sudo:session): session closed for user root Apr 29 15:14:20 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-11b0e60f-edb3-4d2a-8399-815d4811b90f tempest-SnapshotsActionsTest-339173462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4" returned: 0 in 1.514s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:14:20 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-11b0e60f-edb3-4d2a-8399-815d4811b90f tempest-SnapshotsActionsTest-339173462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:14:20 devstack sudo[95754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4 Apr 29 15:14:20 devstack sudo[95754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:14:21 devstack sudo[95754]: pam_unix(sudo:session): session closed for user root Apr 29 15:14:21 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-11b0e60f-edb3-4d2a-8399-815d4811b90f tempest-SnapshotsActionsTest-339173462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-daa4a945-abaf-45b3-818e-a0fa9206c6c4" returned: 0 in 1.420s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:14:22 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-11b0e60f-edb3-4d2a-8399-815d4811b90f tempest-SnapshotsActionsTest-339173462 None] Lock "cinder-quobyte-daa4a945-abaf-45b3-818e-a0fa9206c6c4" released by "delete_volume" :: held 3.077s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:14:22 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-11b0e60f-edb3-4d2a-8399-815d4811b90f tempest-SnapshotsActionsTest-339173462 None] Created reservations ['6d77cfc4-9ddc-4870-96dd-ebbacc135799', '33cc6cf3-434b-446b-90bc-961338e149c9', '5ae00f72-7cbb-4475-aa81-61a0403e6e1d', '6373b684-0828-4382-bbdd-f30f88389581'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:14:22 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-e9178ed8-4758-4c29-a94d-872007936983 req-f2366650-794f-43de-9c4b-539854a072fa tempest-AttachVolumeNegativeTest-1321218953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:14:22 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-e9178ed8-4758-4c29-a94d-872007936983 req-f2366650-794f-43de-9c4b-539854a072fa tempest-AttachVolumeNegativeTest-1321218953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:14:22 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d922b31-a0d3-4a26-a1e3-9a4562168b18]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:14:22 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-e9178ed8-4758-4c29-a94d-872007936983 req-f2366650-794f-43de-9c4b-539854a072fa tempest-AttachVolumeNegativeTest-1321218953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1ce1ca81-ef62-438c-9740-f002c0a6fda3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:14:22 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-11b0e60f-edb3-4d2a-8399-815d4811b90f tempest-SnapshotsActionsTest-339173462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:14:22 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-11b0e60f-edb3-4d2a-8399-815d4811b90f tempest-SnapshotsActionsTest-339173462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:14:22 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-11b0e60f-edb3-4d2a-8399-815d4811b90f tempest-SnapshotsActionsTest-339173462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:14:22 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-11b0e60f-edb3-4d2a-8399-815d4811b90f tempest-SnapshotsActionsTest-339173462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:14:22 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-11b0e60f-edb3-4d2a-8399-815d4811b90f tempest-SnapshotsActionsTest-339173462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:14:22 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-11b0e60f-edb3-4d2a-8399-815d4811b90f tempest-SnapshotsActionsTest-339173462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:14:22 devstack sudo[95800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:14:22 devstack sudo[95800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:14:22 devstack sudo[95799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1ce1ca81-ef62-438c-9740-f002c0a6fda3 Apr 29 15:14:22 devstack sudo[95799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:14:24 devstack sudo[95800]: pam_unix(sudo:session): session closed for user root Apr 29 15:14:24 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-11b0e60f-edb3-4d2a-8399-815d4811b90f tempest-SnapshotsActionsTest-339173462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 1.899s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:14:24 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-11b0e60f-edb3-4d2a-8399-815d4811b90f tempest-SnapshotsActionsTest-339173462 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:14:24 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-11b0e60f-edb3-4d2a-8399-815d4811b90f tempest-SnapshotsActionsTest-339173462 None] Deleted volume successfully. Apr 29 15:14:24 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-11b0e60f-edb3-4d2a-8399-815d4811b90f tempest-SnapshotsActionsTest-339173462 None] Lock "cinder-daa4a945-abaf-45b3-818e-a0fa9206c6c4-delete_volume" released by "delete_volume" :: held 5.637s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:14:24 devstack sudo[95799]: pam_unix(sudo:session): session closed for user root Apr 29 15:14:24 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-e9178ed8-4758-4c29-a94d-872007936983 req-f2366650-794f-43de-9c4b-539854a072fa tempest-AttachVolumeNegativeTest-1321218953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1ce1ca81-ef62-438c-9740-f002c0a6fda3" returned: 0 in 2.592s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:14:24 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-e9178ed8-4758-4c29-a94d-872007936983 req-f2366650-794f-43de-9c4b-539854a072fa tempest-AttachVolumeNegativeTest-1321218953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.628s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:14:24 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-e9178ed8-4758-4c29-a94d-872007936983 req-f2366650-794f-43de-9c4b-539854a072fa tempest-AttachVolumeNegativeTest-1321218953 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a', 'name': 'volume-1ce1ca81-ef62-438c-9740-f002c0a6fda3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3edd0939-fa02-4fd7-bf5f-3dd2297b5654', 'enforce_multipath': True} {{(pid=84448) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 15:14:25 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-e9178ed8-4758-4c29-a94d-872007936983 req-f2366650-794f-43de-9c4b-539854a072fa tempest-AttachVolumeNegativeTest-1321218953 None] attachment_update completed successfully. Apr 29 15:14:30 devstack cinder-volume[84448]: DEBUG oslo_service.periodic_task [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84448) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 15:14:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:14:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:14:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:14:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:14:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:14:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:14:30 devstack sudo[95888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:14:30 devstack sudo[95888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:14:31 devstack sudo[95888]: pam_unix(sudo:session): session closed for user root Apr 29 15:14:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.965s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:14:31 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:14:35 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:SELECT=31,cinder:UPDATE=26,cinder:INSERT=7 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:14:35 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:SELECT=26,cinder:UPDATE=25,cinder:DELETE=3,cinder:INSERT=6 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:14:44 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5879922-08c3-4f3f-a6cb-3cf284a014a8 tempest-VolumeQuotasNegativeTestJSON-836210321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:14:44 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c5879922-08c3-4f3f-a6cb-3cf284a014a8 tempest-VolumeQuotasNegativeTestJSON-836210321 None] Flow 'volume_create_manager' (330eb105-4c8c-4782-97fe-d2273669adc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:14:44 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c5879922-08c3-4f3f-a6cb-3cf284a014a8 tempest-VolumeQuotasNegativeTestJSON-836210321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22469353-5d12-47cd-bdd0-b13e0de90ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:14:44 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c5879922-08c3-4f3f-a6cb-3cf284a014a8 tempest-VolumeQuotasNegativeTestJSON-836210321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22469353-5d12-47cd-bdd0-b13e0de90ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:14:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1173348310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab3cb025-6cef-41df-878f-2e13c2478b21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee5d5bc9148840cd8133a27edbdae377',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:14:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:14:44Z,use_quota=True,user_id='7f1bfbad25064965a693fa5c303278a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:14:44 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c5879922-08c3-4f3f-a6cb-3cf284a014a8 tempest-VolumeQuotasNegativeTestJSON-836210321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d674ae97-e201-4556-a54e-687eb1c76484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:14:44 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c5879922-08c3-4f3f-a6cb-3cf284a014a8 tempest-VolumeQuotasNegativeTestJSON-836210321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d674ae97-e201-4556-a54e-687eb1c76484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:14:44 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c5879922-08c3-4f3f-a6cb-3cf284a014a8 tempest-VolumeQuotasNegativeTestJSON-836210321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26670f15-6cb2-4726-a80e-69c6c74d57f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:14:44 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c5879922-08c3-4f3f-a6cb-3cf284a014a8 tempest-VolumeQuotasNegativeTestJSON-836210321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26670f15-6cb2-4726-a80e-69c6c74d57f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab3cb025-6cef-41df-878f-2e13c2478b21', 'volume_name': 'volume-ab3cb025-6cef-41df-878f-2e13c2478b21', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:14:44 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c5879922-08c3-4f3f-a6cb-3cf284a014a8 tempest-VolumeQuotasNegativeTestJSON-836210321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57582f70-a152-44e6-9048-8cddf8751529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:14:44 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c5879922-08c3-4f3f-a6cb-3cf284a014a8 tempest-VolumeQuotasNegativeTestJSON-836210321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57582f70-a152-44e6-9048-8cddf8751529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:14:44 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c5879922-08c3-4f3f-a6cb-3cf284a014a8 tempest-VolumeQuotasNegativeTestJSON-836210321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a895fc50-b494-4c78-990b-920cc35b8721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:14:44 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-c5879922-08c3-4f3f-a6cb-3cf284a014a8 tempest-VolumeQuotasNegativeTestJSON-836210321 None] Volume ab3cb025-6cef-41df-878f-2e13c2478b21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab3cb025-6cef-41df-878f-2e13c2478b21', 'volume_size': 1} Apr 29 15:14:44 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-c5879922-08c3-4f3f-a6cb-3cf284a014a8 tempest-VolumeQuotasNegativeTestJSON-836210321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:14:44 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-c5879922-08c3-4f3f-a6cb-3cf284a014a8 tempest-VolumeQuotasNegativeTestJSON-836210321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:14:44 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-c5879922-08c3-4f3f-a6cb-3cf284a014a8 tempest-VolumeQuotasNegativeTestJSON-836210321 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:14:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1173348310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab3cb025-6cef-41df-878f-2e13c2478b21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee5d5bc9148840cd8133a27edbdae377',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:14:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:14:44Z,use_quota=True,user_id='7f1bfbad25064965a693fa5c303278a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:14:44 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-c5879922-08c3-4f3f-a6cb-3cf284a014a8 tempest-VolumeQuotasNegativeTestJSON-836210321 None] Creating volume ab3cb025-6cef-41df-878f-2e13c2478b21 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:14:44 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-c5879922-08c3-4f3f-a6cb-3cf284a014a8 tempest-VolumeQuotasNegativeTestJSON-836210321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:14:44 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-c5879922-08c3-4f3f-a6cb-3cf284a014a8 tempest-VolumeQuotasNegativeTestJSON-836210321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:14:44 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-c5879922-08c3-4f3f-a6cb-3cf284a014a8 tempest-VolumeQuotasNegativeTestJSON-836210321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:14:44 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-c5879922-08c3-4f3f-a6cb-3cf284a014a8 tempest-VolumeQuotasNegativeTestJSON-836210321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:14:44 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-c5879922-08c3-4f3f-a6cb-3cf284a014a8 tempest-VolumeQuotasNegativeTestJSON-836210321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:14:44 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-c5879922-08c3-4f3f-a6cb-3cf284a014a8 tempest-VolumeQuotasNegativeTestJSON-836210321 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:14:44 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-c5879922-08c3-4f3f-a6cb-3cf284a014a8 tempest-VolumeQuotasNegativeTestJSON-836210321 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:14:44 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c5879922-08c3-4f3f-a6cb-3cf284a014a8 tempest-VolumeQuotasNegativeTestJSON-836210321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ab3cb025-6cef-41df-878f-2e13c2478b21 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:14:44 devstack sudo[96207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ab3cb025-6cef-41df-878f-2e13c2478b21 1073741824 Apr 29 15:14:44 devstack sudo[96207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:14:45 devstack sudo[96207]: pam_unix(sudo:session): session closed for user root Apr 29 15:14:45 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c5879922-08c3-4f3f-a6cb-3cf284a014a8 tempest-VolumeQuotasNegativeTestJSON-836210321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ab3cb025-6cef-41df-878f-2e13c2478b21 1073741824" returned: 0 in 1.692s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:14:46 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c5879922-08c3-4f3f-a6cb-3cf284a014a8 tempest-VolumeQuotasNegativeTestJSON-836210321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ab3cb025-6cef-41df-878f-2e13c2478b21 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:14:46 devstack sudo[96229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ab3cb025-6cef-41df-878f-2e13c2478b21 Apr 29 15:14:46 devstack sudo[96229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:14:47 devstack sudo[96229]: pam_unix(sudo:session): session closed for user root Apr 29 15:14:47 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c5879922-08c3-4f3f-a6cb-3cf284a014a8 tempest-VolumeQuotasNegativeTestJSON-836210321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ab3cb025-6cef-41df-878f-2e13c2478b21" returned: 0 in 1.384s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:14:47 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-c5879922-08c3-4f3f-a6cb-3cf284a014a8 tempest-VolumeQuotasNegativeTestJSON-836210321 None] <== create_volume: return (3232ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:14:47 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-c5879922-08c3-4f3f-a6cb-3cf284a014a8 tempest-VolumeQuotasNegativeTestJSON-836210321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.236s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:14:47 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c5879922-08c3-4f3f-a6cb-3cf284a014a8 tempest-VolumeQuotasNegativeTestJSON-836210321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a895fc50-b494-4c78-990b-920cc35b8721) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab3cb025-6cef-41df-878f-2e13c2478b21', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:14:47 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c5879922-08c3-4f3f-a6cb-3cf284a014a8 tempest-VolumeQuotasNegativeTestJSON-836210321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc2ddd6c-3b3f-4bda-a1a3-bfaf58766560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:14:47 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-c5879922-08c3-4f3f-a6cb-3cf284a014a8 tempest-VolumeQuotasNegativeTestJSON-836210321 None] Volume volume-ab3cb025-6cef-41df-878f-2e13c2478b21 (ab3cb025-6cef-41df-878f-2e13c2478b21): created successfully Apr 29 15:14:47 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c5879922-08c3-4f3f-a6cb-3cf284a014a8 tempest-VolumeQuotasNegativeTestJSON-836210321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc2ddd6c-3b3f-4bda-a1a3-bfaf58766560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:14:47 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c5879922-08c3-4f3f-a6cb-3cf284a014a8 tempest-VolumeQuotasNegativeTestJSON-836210321 None] Flow 'volume_create_manager' (330eb105-4c8c-4782-97fe-d2273669adc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:14:47 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-c5879922-08c3-4f3f-a6cb-3cf284a014a8 tempest-VolumeQuotasNegativeTestJSON-836210321 None] Created volume successfully. Apr 29 15:14:49 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-adcb3ecc-78c3-4cf8-b678-75dd1d6f34ad tempest-VolumeQuotasNegativeTestJSON-836210321 None] Acquiring lock "cinder-ab3cb025-6cef-41df-878f-2e13c2478b21-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:14:49 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-adcb3ecc-78c3-4cf8-b678-75dd1d6f34ad tempest-VolumeQuotasNegativeTestJSON-836210321 None] Lock "cinder-ab3cb025-6cef-41df-878f-2e13c2478b21-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:14:49 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-adcb3ecc-78c3-4cf8-b678-75dd1d6f34ad tempest-VolumeQuotasNegativeTestJSON-836210321 None] Acquiring lock "cinder-quobyte-ab3cb025-6cef-41df-878f-2e13c2478b21" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:14:49 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-adcb3ecc-78c3-4cf8-b678-75dd1d6f34ad tempest-VolumeQuotasNegativeTestJSON-836210321 None] Lock "cinder-quobyte-ab3cb025-6cef-41df-878f-2e13c2478b21" acquired by "delete_volume" :: waited 0.018s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:14:49 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3e71ac-cd64-4fd3-813c-d20f4f6ef896]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:14:49 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-adcb3ecc-78c3-4cf8-b678-75dd1d6f34ad tempest-VolumeQuotasNegativeTestJSON-836210321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ab3cb025-6cef-41df-878f-2e13c2478b21 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:14:49 devstack sudo[96303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ab3cb025-6cef-41df-878f-2e13c2478b21 Apr 29 15:14:49 devstack sudo[96303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:14:50 devstack sudo[96303]: pam_unix(sudo:session): session closed for user root Apr 29 15:14:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-adcb3ecc-78c3-4cf8-b678-75dd1d6f34ad tempest-VolumeQuotasNegativeTestJSON-836210321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ab3cb025-6cef-41df-878f-2e13c2478b21" returned: 0 in 0.942s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:14:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-adcb3ecc-78c3-4cf8-b678-75dd1d6f34ad tempest-VolumeQuotasNegativeTestJSON-836210321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ab3cb025-6cef-41df-878f-2e13c2478b21 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:14:50 devstack sudo[96334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ab3cb025-6cef-41df-878f-2e13c2478b21 Apr 29 15:14:50 devstack sudo[96334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:14:51 devstack sudo[96334]: pam_unix(sudo:session): session closed for user root Apr 29 15:14:51 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-adcb3ecc-78c3-4cf8-b678-75dd1d6f34ad tempest-VolumeQuotasNegativeTestJSON-836210321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ab3cb025-6cef-41df-878f-2e13c2478b21" returned: 0 in 0.642s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:14:51 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-adcb3ecc-78c3-4cf8-b678-75dd1d6f34ad tempest-VolumeQuotasNegativeTestJSON-836210321 None] Lock "cinder-quobyte-ab3cb025-6cef-41df-878f-2e13c2478b21" released by "delete_volume" :: held 1.666s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:14:51 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-adcb3ecc-78c3-4cf8-b678-75dd1d6f34ad tempest-VolumeQuotasNegativeTestJSON-836210321 None] Created reservations ['c2bb2aeb-00a3-4655-85ba-a99f69ef080f', '575be2b1-a329-48bf-8a75-b5220d778d67', '06292421-3360-4c15-9e16-c5b913c95390', 'c9f8fcd6-0df5-4fce-aa62-b986656ea14f'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:14:51 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-adcb3ecc-78c3-4cf8-b678-75dd1d6f34ad tempest-VolumeQuotasNegativeTestJSON-836210321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:14:51 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-adcb3ecc-78c3-4cf8-b678-75dd1d6f34ad tempest-VolumeQuotasNegativeTestJSON-836210321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:14:51 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-adcb3ecc-78c3-4cf8-b678-75dd1d6f34ad tempest-VolumeQuotasNegativeTestJSON-836210321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:14:51 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-adcb3ecc-78c3-4cf8-b678-75dd1d6f34ad tempest-VolumeQuotasNegativeTestJSON-836210321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:14:51 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-adcb3ecc-78c3-4cf8-b678-75dd1d6f34ad tempest-VolumeQuotasNegativeTestJSON-836210321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:14:51 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-adcb3ecc-78c3-4cf8-b678-75dd1d6f34ad tempest-VolumeQuotasNegativeTestJSON-836210321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:14:51 devstack sudo[96342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:14:51 devstack sudo[96342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:14:52 devstack sudo[96342]: pam_unix(sudo:session): session closed for user root Apr 29 15:14:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-adcb3ecc-78c3-4cf8-b678-75dd1d6f34ad tempest-VolumeQuotasNegativeTestJSON-836210321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.773s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:14:52 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-adcb3ecc-78c3-4cf8-b678-75dd1d6f34ad tempest-VolumeQuotasNegativeTestJSON-836210321 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:14:52 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-adcb3ecc-78c3-4cf8-b678-75dd1d6f34ad tempest-VolumeQuotasNegativeTestJSON-836210321 None] Deleted volume successfully. Apr 29 15:14:52 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-adcb3ecc-78c3-4cf8-b678-75dd1d6f34ad tempest-VolumeQuotasNegativeTestJSON-836210321 None] Lock "cinder-ab3cb025-6cef-41df-878f-2e13c2478b21-delete_volume" released by "delete_volume" :: held 2.746s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:14:52 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-31355593-bf04-4e44-adc4-b4cba57aef2d req-9022d924-1b8e-42c7-9f67-16170f1058b4 tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Terminate volume connection completed successfully. Apr 29 15:14:52 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-31355593-bf04-4e44-adc4-b4cba57aef2d req-9022d924-1b8e-42c7-9f67-16170f1058b4 tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Deleting attachment 1daa26f1-d4dc-4746-b436-504fc28ec1e2. {{(pid=84448) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 15:14:53 devstack cinder-volume[84448]: DEBUG cinder.coordination [req-31355593-bf04-4e44-adc4-b4cba57aef2d req-ddafc1c4-25e9-42dc-b767-18bdf2d38a3f tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Acquiring lock "cinder-15dd86bf-12c1-4c27-87da-0cbda7909f51-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:14:53 devstack cinder-volume[84448]: DEBUG cinder.coordination [req-31355593-bf04-4e44-adc4-b4cba57aef2d req-ddafc1c4-25e9-42dc-b767-18bdf2d38a3f tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Lock "cinder-15dd86bf-12c1-4c27-87da-0cbda7909f51-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:14:53 devstack cinder-volume[84448]: DEBUG cinder.coordination [req-31355593-bf04-4e44-adc4-b4cba57aef2d req-ddafc1c4-25e9-42dc-b767-18bdf2d38a3f tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Acquiring lock "cinder-quobyte-15dd86bf-12c1-4c27-87da-0cbda7909f51" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:14:53 devstack cinder-volume[84448]: DEBUG cinder.coordination [req-31355593-bf04-4e44-adc4-b4cba57aef2d req-ddafc1c4-25e9-42dc-b767-18bdf2d38a3f tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Lock "cinder-quobyte-15dd86bf-12c1-4c27-87da-0cbda7909f51" acquired by "delete_volume" :: waited 0.032s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:14:53 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c4ef0cc-164c-4e1f-ac0b-937c29ca8063]: (4, 'raw') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:14:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-31355593-bf04-4e44-adc4-b4cba57aef2d req-ddafc1c4-25e9-42dc-b767-18bdf2d38a3f tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-15dd86bf-12c1-4c27-87da-0cbda7909f51 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:14:54 devstack sudo[96399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-15dd86bf-12c1-4c27-87da-0cbda7909f51 Apr 29 15:14:54 devstack sudo[96399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:14:54 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-56276ad5-4655-483f-9de8-f6d2562f95a8 tempest-ServersNegativeTestJSON-418094827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:14:54 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-56276ad5-4655-483f-9de8-f6d2562f95a8 tempest-ServersNegativeTestJSON-418094827 None] Flow 'volume_create_manager' (6ebf82c0-71f8-46e2-8e11-804e7bdc7e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:14:54 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-56276ad5-4655-483f-9de8-f6d2562f95a8 tempest-ServersNegativeTestJSON-418094827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8c3abc5-7ec4-4400-a965-f0f94fc2a08b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:14:54 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-56276ad5-4655-483f-9de8-f6d2562f95a8 tempest-ServersNegativeTestJSON-418094827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8c3abc5-7ec4-4400-a965-f0f94fc2a08b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:14:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1096214930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a165651d-3340-44cd-af62-8865facc0b50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c53a73940b4d449780b05a4ed78b5ebe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:14:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:14:55Z,use_quota=True,user_id='1c49a132024e4141ab49e12b146f9b9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:14:54 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-56276ad5-4655-483f-9de8-f6d2562f95a8 tempest-ServersNegativeTestJSON-418094827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eec7364b-e935-4286-94b0-8aa1280f4e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:14:54 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-56276ad5-4655-483f-9de8-f6d2562f95a8 tempest-ServersNegativeTestJSON-418094827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eec7364b-e935-4286-94b0-8aa1280f4e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:14:54 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-56276ad5-4655-483f-9de8-f6d2562f95a8 tempest-ServersNegativeTestJSON-418094827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c86fae5c-dfe9-4b84-b9dd-53e76cf41ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:14:54 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-56276ad5-4655-483f-9de8-f6d2562f95a8 tempest-ServersNegativeTestJSON-418094827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c86fae5c-dfe9-4b84-b9dd-53e76cf41ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a165651d-3340-44cd-af62-8865facc0b50', 'volume_name': 'volume-a165651d-3340-44cd-af62-8865facc0b50', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:14:54 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-56276ad5-4655-483f-9de8-f6d2562f95a8 tempest-ServersNegativeTestJSON-418094827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2fa76f4-8c53-4020-8029-aa423b6f2562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:14:54 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-56276ad5-4655-483f-9de8-f6d2562f95a8 tempest-ServersNegativeTestJSON-418094827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2fa76f4-8c53-4020-8029-aa423b6f2562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:14:54 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-56276ad5-4655-483f-9de8-f6d2562f95a8 tempest-ServersNegativeTestJSON-418094827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f63106bc-52ff-488c-a482-e5ceaacdb14b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:14:54 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-56276ad5-4655-483f-9de8-f6d2562f95a8 tempest-ServersNegativeTestJSON-418094827 None] Volume a165651d-3340-44cd-af62-8865facc0b50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a165651d-3340-44cd-af62-8865facc0b50', 'volume_size': 1} Apr 29 15:14:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-56276ad5-4655-483f-9de8-f6d2562f95a8 tempest-ServersNegativeTestJSON-418094827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:14:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-56276ad5-4655-483f-9de8-f6d2562f95a8 tempest-ServersNegativeTestJSON-418094827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:14:54 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-56276ad5-4655-483f-9de8-f6d2562f95a8 tempest-ServersNegativeTestJSON-418094827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:14:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1096214930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a165651d-3340-44cd-af62-8865facc0b50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c53a73940b4d449780b05a4ed78b5ebe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:14:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:14:55Z,use_quota=True,user_id='1c49a132024e4141ab49e12b146f9b9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:14:54 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-56276ad5-4655-483f-9de8-f6d2562f95a8 tempest-ServersNegativeTestJSON-418094827 None] Creating volume a165651d-3340-44cd-af62-8865facc0b50 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:14:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-56276ad5-4655-483f-9de8-f6d2562f95a8 tempest-ServersNegativeTestJSON-418094827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:14:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-56276ad5-4655-483f-9de8-f6d2562f95a8 tempest-ServersNegativeTestJSON-418094827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:14:54 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-56276ad5-4655-483f-9de8-f6d2562f95a8 tempest-ServersNegativeTestJSON-418094827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:14:54 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-56276ad5-4655-483f-9de8-f6d2562f95a8 tempest-ServersNegativeTestJSON-418094827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:14:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-56276ad5-4655-483f-9de8-f6d2562f95a8 tempest-ServersNegativeTestJSON-418094827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:14:54 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-56276ad5-4655-483f-9de8-f6d2562f95a8 tempest-ServersNegativeTestJSON-418094827 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:14:54 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-56276ad5-4655-483f-9de8-f6d2562f95a8 tempest-ServersNegativeTestJSON-418094827 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:14:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-56276ad5-4655-483f-9de8-f6d2562f95a8 tempest-ServersNegativeTestJSON-418094827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a165651d-3340-44cd-af62-8865facc0b50 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:14:54 devstack sudo[96402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a165651d-3340-44cd-af62-8865facc0b50 1073741824 Apr 29 15:14:54 devstack sudo[96402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:14:55 devstack sudo[96399]: pam_unix(sudo:session): session closed for user root Apr 29 15:14:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-31355593-bf04-4e44-adc4-b4cba57aef2d req-ddafc1c4-25e9-42dc-b767-18bdf2d38a3f tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-15dd86bf-12c1-4c27-87da-0cbda7909f51" returned: 0 in 1.522s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:14:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-31355593-bf04-4e44-adc4-b4cba57aef2d req-ddafc1c4-25e9-42dc-b767-18bdf2d38a3f tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-15dd86bf-12c1-4c27-87da-0cbda7909f51 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:14:55 devstack sudo[96409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-15dd86bf-12c1-4c27-87da-0cbda7909f51 Apr 29 15:14:55 devstack sudo[96409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:14:55 devstack sudo[96402]: pam_unix(sudo:session): session closed for user root Apr 29 15:14:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-56276ad5-4655-483f-9de8-f6d2562f95a8 tempest-ServersNegativeTestJSON-418094827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a165651d-3340-44cd-af62-8865facc0b50 1073741824" returned: 0 in 1.094s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:14:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-56276ad5-4655-483f-9de8-f6d2562f95a8 tempest-ServersNegativeTestJSON-418094827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a165651d-3340-44cd-af62-8865facc0b50 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:14:56 devstack sudo[96414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a165651d-3340-44cd-af62-8865facc0b50 Apr 29 15:14:56 devstack sudo[96414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:14:56 devstack sudo[96409]: pam_unix(sudo:session): session closed for user root Apr 29 15:14:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-31355593-bf04-4e44-adc4-b4cba57aef2d req-ddafc1c4-25e9-42dc-b767-18bdf2d38a3f tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-15dd86bf-12c1-4c27-87da-0cbda7909f51" returned: 1 in 1.460s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:14:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-31355593-bf04-4e44-adc4-b4cba57aef2d req-ddafc1c4-25e9-42dc-b767-18bdf2d38a3f tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-15dd86bf-12c1-4c27-87da-0cbda7909f51' failed. Not Retrying. {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 15:14:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-31355593-bf04-4e44-adc4-b4cba57aef2d req-ddafc1c4-25e9-42dc-b767-18bdf2d38a3f tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-15dd86bf-12c1-4c27-87da-0cbda7909f51 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:14:56 devstack sudo[96419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-15dd86bf-12c1-4c27-87da-0cbda7909f51 Apr 29 15:14:56 devstack sudo[96419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:14:57 devstack sudo[96414]: pam_unix(sudo:session): session closed for user root Apr 29 15:14:57 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-56276ad5-4655-483f-9de8-f6d2562f95a8 tempest-ServersNegativeTestJSON-418094827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a165651d-3340-44cd-af62-8865facc0b50" returned: 0 in 1.213s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:14:57 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-56276ad5-4655-483f-9de8-f6d2562f95a8 tempest-ServersNegativeTestJSON-418094827 None] <== create_volume: return (2408ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:14:57 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-56276ad5-4655-483f-9de8-f6d2562f95a8 tempest-ServersNegativeTestJSON-418094827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.415s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:14:57 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-56276ad5-4655-483f-9de8-f6d2562f95a8 tempest-ServersNegativeTestJSON-418094827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f63106bc-52ff-488c-a482-e5ceaacdb14b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a165651d-3340-44cd-af62-8865facc0b50', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:14:57 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-56276ad5-4655-483f-9de8-f6d2562f95a8 tempest-ServersNegativeTestJSON-418094827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4660ee1a-5cf9-4008-b367-7841c7478b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:14:57 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-56276ad5-4655-483f-9de8-f6d2562f95a8 tempest-ServersNegativeTestJSON-418094827 None] Volume volume-a165651d-3340-44cd-af62-8865facc0b50 (a165651d-3340-44cd-af62-8865facc0b50): created successfully Apr 29 15:14:57 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-56276ad5-4655-483f-9de8-f6d2562f95a8 tempest-ServersNegativeTestJSON-418094827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4660ee1a-5cf9-4008-b367-7841c7478b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:14:57 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-56276ad5-4655-483f-9de8-f6d2562f95a8 tempest-ServersNegativeTestJSON-418094827 None] Flow 'volume_create_manager' (6ebf82c0-71f8-46e2-8e11-804e7bdc7e0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:14:57 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-56276ad5-4655-483f-9de8-f6d2562f95a8 tempest-ServersNegativeTestJSON-418094827 None] Created volume successfully. Apr 29 15:14:57 devstack sudo[96419]: pam_unix(sudo:session): session closed for user root Apr 29 15:14:57 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-31355593-bf04-4e44-adc4-b4cba57aef2d req-ddafc1c4-25e9-42dc-b767-18bdf2d38a3f tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-15dd86bf-12c1-4c27-87da-0cbda7909f51" returned: 0 in 0.860s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:14:57 devstack cinder-volume[84448]: DEBUG cinder.coordination [req-31355593-bf04-4e44-adc4-b4cba57aef2d req-ddafc1c4-25e9-42dc-b767-18bdf2d38a3f tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Lock "cinder-quobyte-15dd86bf-12c1-4c27-87da-0cbda7909f51" released by "delete_volume" :: held 3.979s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:14:57 devstack cinder-volume[84448]: DEBUG cinder.quota [req-31355593-bf04-4e44-adc4-b4cba57aef2d req-ddafc1c4-25e9-42dc-b767-18bdf2d38a3f tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Created reservations ['27840efd-cf6b-4288-a203-5d19f067868c', 'a15fc029-fcf0-40eb-83c9-85307cc460bd', 'cc2a9332-e130-4447-b324-9e79a74e00ee', '706d4342-c8e5-4b66-8dcb-ea76e0a1a23a'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:14:57 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-31355593-bf04-4e44-adc4-b4cba57aef2d req-ddafc1c4-25e9-42dc-b767-18bdf2d38a3f tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:14:57 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-31355593-bf04-4e44-adc4-b4cba57aef2d req-ddafc1c4-25e9-42dc-b767-18bdf2d38a3f tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:14:57 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [req-31355593-bf04-4e44-adc4-b4cba57aef2d req-ddafc1c4-25e9-42dc-b767-18bdf2d38a3f tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:14:58 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [req-31355593-bf04-4e44-adc4-b4cba57aef2d req-ddafc1c4-25e9-42dc-b767-18bdf2d38a3f tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:14:58 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-31355593-bf04-4e44-adc4-b4cba57aef2d req-ddafc1c4-25e9-42dc-b767-18bdf2d38a3f tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.048s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:14:58 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-31355593-bf04-4e44-adc4-b4cba57aef2d req-ddafc1c4-25e9-42dc-b767-18bdf2d38a3f tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:14:58 devstack sudo[96423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:14:58 devstack sudo[96423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:14:59 devstack sudo[96423]: pam_unix(sudo:session): session closed for user root Apr 29 15:14:59 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-31355593-bf04-4e44-adc4-b4cba57aef2d req-ddafc1c4-25e9-42dc-b767-18bdf2d38a3f tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 1.128s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:14:59 devstack cinder-volume[84448]: DEBUG cinder.manager [req-31355593-bf04-4e44-adc4-b4cba57aef2d req-ddafc1c4-25e9-42dc-b767-18bdf2d38a3f tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:14:59 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-31355593-bf04-4e44-adc4-b4cba57aef2d req-ddafc1c4-25e9-42dc-b767-18bdf2d38a3f tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Deleted volume successfully. Apr 29 15:14:59 devstack cinder-volume[84448]: DEBUG cinder.coordination [req-31355593-bf04-4e44-adc4-b4cba57aef2d req-ddafc1c4-25e9-42dc-b767-18bdf2d38a3f tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Lock "cinder-15dd86bf-12c1-4c27-87da-0cbda7909f51-delete_volume" released by "delete_volume" :: held 5.625s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:15:00 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cd53566-0c6b-43ba-be8b-a930ffe3b8c9 tempest-ServersNegativeTestJSON-418094827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:15:00 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-7cd53566-0c6b-43ba-be8b-a930ffe3b8c9 tempest-ServersNegativeTestJSON-418094827 None] Flow 'volume_create_manager' (b0dd7381-04f5-47fc-9400-dd952584f0ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:15:00 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-7cd53566-0c6b-43ba-be8b-a930ffe3b8c9 tempest-ServersNegativeTestJSON-418094827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c974e180-47e6-43fc-9254-f729804e1e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:15:00 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-7cd53566-0c6b-43ba-be8b-a930ffe3b8c9 tempest-ServersNegativeTestJSON-418094827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c974e180-47e6-43fc-9254-f729804e1e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:15:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1237694166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f8c93f4-53f4-45e5-8643-20a8ff2ac24a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c53a73940b4d449780b05a4ed78b5ebe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:15:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:15:01Z,use_quota=True,user_id='1c49a132024e4141ab49e12b146f9b9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:15:00 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-7cd53566-0c6b-43ba-be8b-a930ffe3b8c9 tempest-ServersNegativeTestJSON-418094827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12de7dc2-eed1-46be-8a0e-f2b731392c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:15:00 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-7cd53566-0c6b-43ba-be8b-a930ffe3b8c9 tempest-ServersNegativeTestJSON-418094827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12de7dc2-eed1-46be-8a0e-f2b731392c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:15:00 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-7cd53566-0c6b-43ba-be8b-a930ffe3b8c9 tempest-ServersNegativeTestJSON-418094827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b8aa948-c3d8-4883-9f2d-97c256f634d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:15:00 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-7cd53566-0c6b-43ba-be8b-a930ffe3b8c9 tempest-ServersNegativeTestJSON-418094827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b8aa948-c3d8-4883-9f2d-97c256f634d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f8c93f4-53f4-45e5-8643-20a8ff2ac24a', 'volume_name': 'volume-3f8c93f4-53f4-45e5-8643-20a8ff2ac24a', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:15:00 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-7cd53566-0c6b-43ba-be8b-a930ffe3b8c9 tempest-ServersNegativeTestJSON-418094827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0340b47c-ac33-449e-9e1a-3252659cf119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:15:00 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-7cd53566-0c6b-43ba-be8b-a930ffe3b8c9 tempest-ServersNegativeTestJSON-418094827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0340b47c-ac33-449e-9e1a-3252659cf119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:15:00 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-7cd53566-0c6b-43ba-be8b-a930ffe3b8c9 tempest-ServersNegativeTestJSON-418094827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7543dd4b-cd95-41e3-8732-5418183151ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:15:00 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-7cd53566-0c6b-43ba-be8b-a930ffe3b8c9 tempest-ServersNegativeTestJSON-418094827 None] Volume 3f8c93f4-53f4-45e5-8643-20a8ff2ac24a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f8c93f4-53f4-45e5-8643-20a8ff2ac24a', 'volume_size': 1} Apr 29 15:15:00 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-7cd53566-0c6b-43ba-be8b-a930ffe3b8c9 tempest-ServersNegativeTestJSON-418094827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:15:00 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-7cd53566-0c6b-43ba-be8b-a930ffe3b8c9 tempest-ServersNegativeTestJSON-418094827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:15:00 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-7cd53566-0c6b-43ba-be8b-a930ffe3b8c9 tempest-ServersNegativeTestJSON-418094827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:15:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1237694166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f8c93f4-53f4-45e5-8643-20a8ff2ac24a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c53a73940b4d449780b05a4ed78b5ebe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:15:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:15:01Z,use_quota=True,user_id='1c49a132024e4141ab49e12b146f9b9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:15:00 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-7cd53566-0c6b-43ba-be8b-a930ffe3b8c9 tempest-ServersNegativeTestJSON-418094827 None] Creating volume 3f8c93f4-53f4-45e5-8643-20a8ff2ac24a {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:15:00 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-7cd53566-0c6b-43ba-be8b-a930ffe3b8c9 tempest-ServersNegativeTestJSON-418094827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:15:00 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-7cd53566-0c6b-43ba-be8b-a930ffe3b8c9 tempest-ServersNegativeTestJSON-418094827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:15:00 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-7cd53566-0c6b-43ba-be8b-a930ffe3b8c9 tempest-ServersNegativeTestJSON-418094827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:15:00 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-7cd53566-0c6b-43ba-be8b-a930ffe3b8c9 tempest-ServersNegativeTestJSON-418094827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:15:00 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-7cd53566-0c6b-43ba-be8b-a930ffe3b8c9 tempest-ServersNegativeTestJSON-418094827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:15:00 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-7cd53566-0c6b-43ba-be8b-a930ffe3b8c9 tempest-ServersNegativeTestJSON-418094827 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:15:00 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-7cd53566-0c6b-43ba-be8b-a930ffe3b8c9 tempest-ServersNegativeTestJSON-418094827 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:15:00 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7cd53566-0c6b-43ba-be8b-a930ffe3b8c9 tempest-ServersNegativeTestJSON-418094827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3f8c93f4-53f4-45e5-8643-20a8ff2ac24a 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:15:00 devstack sudo[96475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3f8c93f4-53f4-45e5-8643-20a8ff2ac24a 1073741824 Apr 29 15:15:00 devstack sudo[96475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:15:01 devstack sudo[96475]: pam_unix(sudo:session): session closed for user root Apr 29 15:15:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7cd53566-0c6b-43ba-be8b-a930ffe3b8c9 tempest-ServersNegativeTestJSON-418094827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3f8c93f4-53f4-45e5-8643-20a8ff2ac24a 1073741824" returned: 0 in 1.104s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:15:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7cd53566-0c6b-43ba-be8b-a930ffe3b8c9 tempest-ServersNegativeTestJSON-418094827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3f8c93f4-53f4-45e5-8643-20a8ff2ac24a {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:15:01 devstack sudo[96487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3f8c93f4-53f4-45e5-8643-20a8ff2ac24a Apr 29 15:15:01 devstack sudo[96487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:15:02 devstack sudo[96487]: pam_unix(sudo:session): session closed for user root Apr 29 15:15:02 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7cd53566-0c6b-43ba-be8b-a930ffe3b8c9 tempest-ServersNegativeTestJSON-418094827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3f8c93f4-53f4-45e5-8643-20a8ff2ac24a" returned: 0 in 0.671s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:15:02 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-7cd53566-0c6b-43ba-be8b-a930ffe3b8c9 tempest-ServersNegativeTestJSON-418094827 None] <== create_volume: return (1842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:15:02 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-7cd53566-0c6b-43ba-be8b-a930ffe3b8c9 tempest-ServersNegativeTestJSON-418094827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.854s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:15:02 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-7cd53566-0c6b-43ba-be8b-a930ffe3b8c9 tempest-ServersNegativeTestJSON-418094827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7543dd4b-cd95-41e3-8732-5418183151ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f8c93f4-53f4-45e5-8643-20a8ff2ac24a', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:15:02 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-7cd53566-0c6b-43ba-be8b-a930ffe3b8c9 tempest-ServersNegativeTestJSON-418094827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c3e7ec3-bfe9-468e-8669-4b1c9c2d7a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:15:02 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-7cd53566-0c6b-43ba-be8b-a930ffe3b8c9 tempest-ServersNegativeTestJSON-418094827 None] Volume volume-3f8c93f4-53f4-45e5-8643-20a8ff2ac24a (3f8c93f4-53f4-45e5-8643-20a8ff2ac24a): created successfully Apr 29 15:15:02 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-7cd53566-0c6b-43ba-be8b-a930ffe3b8c9 tempest-ServersNegativeTestJSON-418094827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c3e7ec3-bfe9-468e-8669-4b1c9c2d7a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:15:02 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-7cd53566-0c6b-43ba-be8b-a930ffe3b8c9 tempest-ServersNegativeTestJSON-418094827 None] Flow 'volume_create_manager' (b0dd7381-04f5-47fc-9400-dd952584f0ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:15:02 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-7cd53566-0c6b-43ba-be8b-a930ffe3b8c9 tempest-ServersNegativeTestJSON-418094827 None] Created volume successfully. Apr 29 15:15:03 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-f92643ee-a152-4938-8284-e8a2864c3d83 tempest-ServersNegativeTestJSON-418094827 None] Acquiring lock "cinder-3f8c93f4-53f4-45e5-8643-20a8ff2ac24a-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:15:03 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-f92643ee-a152-4938-8284-e8a2864c3d83 tempest-ServersNegativeTestJSON-418094827 None] Lock "cinder-3f8c93f4-53f4-45e5-8643-20a8ff2ac24a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:15:03 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-f92643ee-a152-4938-8284-e8a2864c3d83 tempest-ServersNegativeTestJSON-418094827 None] Acquiring lock "cinder-quobyte-3f8c93f4-53f4-45e5-8643-20a8ff2ac24a" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:15:03 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-f92643ee-a152-4938-8284-e8a2864c3d83 tempest-ServersNegativeTestJSON-418094827 None] Lock "cinder-quobyte-3f8c93f4-53f4-45e5-8643-20a8ff2ac24a" acquired by "delete_volume" :: waited 0.036s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:15:03 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb00aea-1de7-41f1-836c-3ccd52a0fa81]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:15:03 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f92643ee-a152-4938-8284-e8a2864c3d83 tempest-ServersNegativeTestJSON-418094827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3f8c93f4-53f4-45e5-8643-20a8ff2ac24a {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:15:03 devstack sudo[96490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3f8c93f4-53f4-45e5-8643-20a8ff2ac24a Apr 29 15:15:03 devstack sudo[96490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:15:04 devstack sudo[96490]: pam_unix(sudo:session): session closed for user root Apr 29 15:15:04 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f92643ee-a152-4938-8284-e8a2864c3d83 tempest-ServersNegativeTestJSON-418094827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3f8c93f4-53f4-45e5-8643-20a8ff2ac24a" returned: 0 in 0.937s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:15:04 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f92643ee-a152-4938-8284-e8a2864c3d83 tempest-ServersNegativeTestJSON-418094827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3f8c93f4-53f4-45e5-8643-20a8ff2ac24a {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:15:04 devstack sudo[96495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3f8c93f4-53f4-45e5-8643-20a8ff2ac24a Apr 29 15:15:04 devstack sudo[96495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:15:05 devstack sudo[96495]: pam_unix(sudo:session): session closed for user root Apr 29 15:15:05 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f92643ee-a152-4938-8284-e8a2864c3d83 tempest-ServersNegativeTestJSON-418094827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3f8c93f4-53f4-45e5-8643-20a8ff2ac24a" returned: 0 in 0.813s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:15:05 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-f92643ee-a152-4938-8284-e8a2864c3d83 tempest-ServersNegativeTestJSON-418094827 None] Lock "cinder-quobyte-3f8c93f4-53f4-45e5-8643-20a8ff2ac24a" released by "delete_volume" :: held 1.852s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:15:05 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-f92643ee-a152-4938-8284-e8a2864c3d83 tempest-ServersNegativeTestJSON-418094827 None] Created reservations ['9f164c7f-1d6f-46bd-8363-e0e103516498', '671c9585-53b8-45a5-bd51-dad574384393', '71a4232d-ff2a-48f6-9d4f-107bc20e1a2b', '6639fc7c-9791-4ae5-bfc0-f6ccfd25c085'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:15:05 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-f92643ee-a152-4938-8284-e8a2864c3d83 tempest-ServersNegativeTestJSON-418094827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:15:05 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-f92643ee-a152-4938-8284-e8a2864c3d83 tempest-ServersNegativeTestJSON-418094827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:15:05 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-f92643ee-a152-4938-8284-e8a2864c3d83 tempest-ServersNegativeTestJSON-418094827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:15:05 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-f92643ee-a152-4938-8284-e8a2864c3d83 tempest-ServersNegativeTestJSON-418094827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:15:05 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-f92643ee-a152-4938-8284-e8a2864c3d83 tempest-ServersNegativeTestJSON-418094827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:15:05 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f92643ee-a152-4938-8284-e8a2864c3d83 tempest-ServersNegativeTestJSON-418094827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:15:05 devstack sudo[96499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:15:05 devstack sudo[96499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:15:06 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-38249f49-0a9f-461b-b047-cfb4bd196cdd tempest-ServersNegativeTestJSON-418094827 None] Acquiring lock "cinder-a165651d-3340-44cd-af62-8865facc0b50-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:15:06 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-38249f49-0a9f-461b-b047-cfb4bd196cdd tempest-ServersNegativeTestJSON-418094827 None] Lock "cinder-a165651d-3340-44cd-af62-8865facc0b50-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:15:06 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-38249f49-0a9f-461b-b047-cfb4bd196cdd tempest-ServersNegativeTestJSON-418094827 None] Acquiring lock "cinder-quobyte-a165651d-3340-44cd-af62-8865facc0b50" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:15:06 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-38249f49-0a9f-461b-b047-cfb4bd196cdd tempest-ServersNegativeTestJSON-418094827 None] Lock "cinder-quobyte-a165651d-3340-44cd-af62-8865facc0b50" acquired by "delete_volume" :: waited 0.020s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:15:06 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[d43f5863-db9e-4b1e-9346-e5434a14adf3]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:15:06 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-38249f49-0a9f-461b-b047-cfb4bd196cdd tempest-ServersNegativeTestJSON-418094827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a165651d-3340-44cd-af62-8865facc0b50 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:15:06 devstack sudo[96501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a165651d-3340-44cd-af62-8865facc0b50 Apr 29 15:15:06 devstack sudo[96501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:15:06 devstack sudo[96499]: pam_unix(sudo:session): session closed for user root Apr 29 15:15:06 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f92643ee-a152-4938-8284-e8a2864c3d83 tempest-ServersNegativeTestJSON-418094827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 1.113s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:15:06 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-f92643ee-a152-4938-8284-e8a2864c3d83 tempest-ServersNegativeTestJSON-418094827 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:15:06 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-f92643ee-a152-4938-8284-e8a2864c3d83 tempest-ServersNegativeTestJSON-418094827 None] Deleted volume successfully. Apr 29 15:15:06 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-f92643ee-a152-4938-8284-e8a2864c3d83 tempest-ServersNegativeTestJSON-418094827 None] Lock "cinder-3f8c93f4-53f4-45e5-8643-20a8ff2ac24a-delete_volume" released by "delete_volume" :: held 3.251s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:15:07 devstack sudo[96501]: pam_unix(sudo:session): session closed for user root Apr 29 15:15:07 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-38249f49-0a9f-461b-b047-cfb4bd196cdd tempest-ServersNegativeTestJSON-418094827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a165651d-3340-44cd-af62-8865facc0b50" returned: 0 in 0.917s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:15:07 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-38249f49-0a9f-461b-b047-cfb4bd196cdd tempest-ServersNegativeTestJSON-418094827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a165651d-3340-44cd-af62-8865facc0b50 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:15:07 devstack sudo[96507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a165651d-3340-44cd-af62-8865facc0b50 Apr 29 15:15:07 devstack sudo[96507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:15:07 devstack sudo[96507]: pam_unix(sudo:session): session closed for user root Apr 29 15:15:07 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-38249f49-0a9f-461b-b047-cfb4bd196cdd tempest-ServersNegativeTestJSON-418094827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a165651d-3340-44cd-af62-8865facc0b50" returned: 0 in 0.781s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:15:08 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-38249f49-0a9f-461b-b047-cfb4bd196cdd tempest-ServersNegativeTestJSON-418094827 None] Lock "cinder-quobyte-a165651d-3340-44cd-af62-8865facc0b50" released by "delete_volume" :: held 1.755s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:15:08 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-38249f49-0a9f-461b-b047-cfb4bd196cdd tempest-ServersNegativeTestJSON-418094827 None] Created reservations ['9d0d918c-b320-48a6-9c55-1746dc391602', '18f868d5-068d-42d9-aef6-c27c81ceb380', '52f459f0-a1ad-46cb-9596-eca89535af33', '12d4dcdd-452d-4ee5-9973-bbb755f61bfd'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:15:08 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-38249f49-0a9f-461b-b047-cfb4bd196cdd tempest-ServersNegativeTestJSON-418094827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:15:08 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-38249f49-0a9f-461b-b047-cfb4bd196cdd tempest-ServersNegativeTestJSON-418094827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:15:08 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-38249f49-0a9f-461b-b047-cfb4bd196cdd tempest-ServersNegativeTestJSON-418094827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:15:08 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-38249f49-0a9f-461b-b047-cfb4bd196cdd tempest-ServersNegativeTestJSON-418094827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:15:08 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-38249f49-0a9f-461b-b047-cfb4bd196cdd tempest-ServersNegativeTestJSON-418094827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:15:08 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-38249f49-0a9f-461b-b047-cfb4bd196cdd tempest-ServersNegativeTestJSON-418094827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:15:08 devstack sudo[96551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:15:08 devstack sudo[96551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:15:09 devstack sudo[96551]: pam_unix(sudo:session): session closed for user root Apr 29 15:15:09 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-38249f49-0a9f-461b-b047-cfb4bd196cdd tempest-ServersNegativeTestJSON-418094827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.983s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:15:09 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-38249f49-0a9f-461b-b047-cfb4bd196cdd tempest-ServersNegativeTestJSON-418094827 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:15:09 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-38249f49-0a9f-461b-b047-cfb4bd196cdd tempest-ServersNegativeTestJSON-418094827 None] Deleted volume successfully. Apr 29 15:15:09 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-38249f49-0a9f-461b-b047-cfb4bd196cdd tempest-ServersNegativeTestJSON-418094827 None] Lock "cinder-a165651d-3340-44cd-af62-8865facc0b50-delete_volume" released by "delete_volume" :: held 3.118s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:15:10 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-e222816a-3bab-4509-95a8-852320e2c4f4 req-f08d0bd3-d496-428b-b8f7-17feda5efd7c tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Terminate volume connection completed successfully. Apr 29 15:15:10 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-e222816a-3bab-4509-95a8-852320e2c4f4 req-f08d0bd3-d496-428b-b8f7-17feda5efd7c tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Deleting attachment e8004ef4-6f22-4fc4-9b2c-6f93b7138739. {{(pid=84448) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 15:15:11 devstack cinder-volume[84448]: DEBUG cinder.coordination [req-e222816a-3bab-4509-95a8-852320e2c4f4 req-dcfab3cf-afe9-45b8-9b4f-38d99dfb2166 tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Acquiring lock "cinder-d04ea0f4-4cb2-4e64-a05f-3208620dfbe1-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:15:11 devstack cinder-volume[84448]: DEBUG cinder.coordination [req-e222816a-3bab-4509-95a8-852320e2c4f4 req-dcfab3cf-afe9-45b8-9b4f-38d99dfb2166 tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Lock "cinder-d04ea0f4-4cb2-4e64-a05f-3208620dfbe1-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:15:11 devstack cinder-volume[84448]: DEBUG cinder.coordination [req-e222816a-3bab-4509-95a8-852320e2c4f4 req-dcfab3cf-afe9-45b8-9b4f-38d99dfb2166 tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Acquiring lock "cinder-quobyte-d04ea0f4-4cb2-4e64-a05f-3208620dfbe1" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:15:11 devstack cinder-volume[84448]: DEBUG cinder.coordination [req-e222816a-3bab-4509-95a8-852320e2c4f4 req-dcfab3cf-afe9-45b8-9b4f-38d99dfb2166 tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Lock "cinder-quobyte-d04ea0f4-4cb2-4e64-a05f-3208620dfbe1" acquired by "delete_volume" :: waited 0.024s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:15:11 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e77bc76-7a69-4364-a2aa-6b7e68787a80]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:15:11 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-e222816a-3bab-4509-95a8-852320e2c4f4 req-dcfab3cf-afe9-45b8-9b4f-38d99dfb2166 tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d04ea0f4-4cb2-4e64-a05f-3208620dfbe1 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:15:11 devstack sudo[96635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d04ea0f4-4cb2-4e64-a05f-3208620dfbe1 Apr 29 15:15:11 devstack sudo[96635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:15:12 devstack sudo[96635]: pam_unix(sudo:session): session closed for user root Apr 29 15:15:12 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-e222816a-3bab-4509-95a8-852320e2c4f4 req-dcfab3cf-afe9-45b8-9b4f-38d99dfb2166 tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d04ea0f4-4cb2-4e64-a05f-3208620dfbe1" returned: 0 in 0.891s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:15:12 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-e222816a-3bab-4509-95a8-852320e2c4f4 req-dcfab3cf-afe9-45b8-9b4f-38d99dfb2166 tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d04ea0f4-4cb2-4e64-a05f-3208620dfbe1 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:15:12 devstack sudo[96642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d04ea0f4-4cb2-4e64-a05f-3208620dfbe1 Apr 29 15:15:12 devstack sudo[96642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:15:12 devstack sudo[96642]: pam_unix(sudo:session): session closed for user root Apr 29 15:15:12 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-e222816a-3bab-4509-95a8-852320e2c4f4 req-dcfab3cf-afe9-45b8-9b4f-38d99dfb2166 tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d04ea0f4-4cb2-4e64-a05f-3208620dfbe1" returned: 0 in 0.716s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:15:12 devstack cinder-volume[84448]: DEBUG cinder.coordination [req-e222816a-3bab-4509-95a8-852320e2c4f4 req-dcfab3cf-afe9-45b8-9b4f-38d99dfb2166 tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Lock "cinder-quobyte-d04ea0f4-4cb2-4e64-a05f-3208620dfbe1" released by "delete_volume" :: held 1.668s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:15:12 devstack cinder-volume[84448]: DEBUG cinder.quota [req-e222816a-3bab-4509-95a8-852320e2c4f4 req-dcfab3cf-afe9-45b8-9b4f-38d99dfb2166 tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Created reservations ['5b015a48-1910-43f7-8bad-62927827708c', '6f1e8eca-09a2-4884-b28e-3d1b9f0552a2', 'a52b9c1b-02e6-40f7-bb35-de1d3d730a90', 'd687ef12-d088-43f0-baf2-d47678b11dd0'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:15:12 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-e222816a-3bab-4509-95a8-852320e2c4f4 req-dcfab3cf-afe9-45b8-9b4f-38d99dfb2166 tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:15:12 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-e222816a-3bab-4509-95a8-852320e2c4f4 req-dcfab3cf-afe9-45b8-9b4f-38d99dfb2166 tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:15:12 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [req-e222816a-3bab-4509-95a8-852320e2c4f4 req-dcfab3cf-afe9-45b8-9b4f-38d99dfb2166 tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:15:12 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [req-e222816a-3bab-4509-95a8-852320e2c4f4 req-dcfab3cf-afe9-45b8-9b4f-38d99dfb2166 tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:15:12 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-e222816a-3bab-4509-95a8-852320e2c4f4 req-dcfab3cf-afe9-45b8-9b4f-38d99dfb2166 tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:15:12 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-e222816a-3bab-4509-95a8-852320e2c4f4 req-dcfab3cf-afe9-45b8-9b4f-38d99dfb2166 tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:15:12 devstack sudo[96646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:15:12 devstack sudo[96646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:15:13 devstack sudo[96646]: pam_unix(sudo:session): session closed for user root Apr 29 15:15:13 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-e222816a-3bab-4509-95a8-852320e2c4f4 req-dcfab3cf-afe9-45b8-9b4f-38d99dfb2166 tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.704s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:15:13 devstack cinder-volume[84448]: DEBUG cinder.manager [req-e222816a-3bab-4509-95a8-852320e2c4f4 req-dcfab3cf-afe9-45b8-9b4f-38d99dfb2166 tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:15:13 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-e222816a-3bab-4509-95a8-852320e2c4f4 req-dcfab3cf-afe9-45b8-9b4f-38d99dfb2166 tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Deleted volume successfully. Apr 29 15:15:13 devstack cinder-volume[84448]: DEBUG cinder.coordination [req-e222816a-3bab-4509-95a8-852320e2c4f4 req-dcfab3cf-afe9-45b8-9b4f-38d99dfb2166 tempest-ServerBootFromVolumeStableRescueTest-1324557987 None] Lock "cinder-d04ea0f4-4cb2-4e64-a05f-3208620dfbe1-delete_volume" released by "delete_volume" :: held 2.620s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:15:16 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-f046f341-dadf-4423-a512-af7489ecd02b tempest-VolumesImageMetadata-973235884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:15:16 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-f046f341-dadf-4423-a512-af7489ecd02b tempest-VolumesImageMetadata-973235884 None] Flow 'volume_create_manager' (b56eb258-9579-4038-9153-d2b997f5591a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:15:16 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-f046f341-dadf-4423-a512-af7489ecd02b tempest-VolumesImageMetadata-973235884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef2633b2-cf43-4203-a427-b2f73753f7c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:15:16 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-f046f341-dadf-4423-a512-af7489ecd02b tempest-VolumesImageMetadata-973235884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef2633b2-cf43-4203-a427-b2f73753f7c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:15:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1232083099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffab1ce3-0d76-43d1-925c-87504ce04178,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38c19ef7a606478a99fef6792c5d2b90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:15:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:15:17Z,use_quota=True,user_id='69dd8a3d53804b6f83735cac4d41b370',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:15:16 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-f046f341-dadf-4423-a512-af7489ecd02b tempest-VolumesImageMetadata-973235884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (480a0f7a-0210-46fb-a983-475fc7e0fce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:15:16 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-f046f341-dadf-4423-a512-af7489ecd02b tempest-VolumesImageMetadata-973235884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (480a0f7a-0210-46fb-a983-475fc7e0fce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:15:16 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-f046f341-dadf-4423-a512-af7489ecd02b tempest-VolumesImageMetadata-973235884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (885c6b00-876e-40b1-b98a-554830381155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:15:16 devstack cinder-volume[84448]: DEBUG cinder.image.glance [None req-f046f341-dadf-4423-a512-af7489ecd02b tempest-VolumesImageMetadata-973235884 None] Creating Keystone auth plugin from conf {{(pid=84448) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 29 15:15:17 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-f046f341-dadf-4423-a512-af7489ecd02b tempest-VolumesImageMetadata-973235884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (885c6b00-876e-40b1-b98a-554830381155) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ffab1ce3-0d76-43d1-925c-87504ce04178', 'volume_name': 'volume-ffab1ce3-0d76-43d1-925c-87504ce04178', 'volume_size': 1, 'image_id': 'ad86f424-7d2a-4f3b-9577-890075e7dc72', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ad86f424-7d2a-4f3b-9577-890075e7dc72', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '33db0ca5091747b1a3438d70bf53390c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ad86f424-7d2a-4f3b-9577-890075e7dc72', 'created_at': datetime.datetime(2026, 4, 29, 13, 0, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 13, 0, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ad86f424-7d2a-4f3b-9577-890075e7dc72/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:15:17 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-f046f341-dadf-4423-a512-af7489ecd02b tempest-VolumesImageMetadata-973235884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0d49b55-36a8-4593-92b1-f0f03ad06a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:15:17 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-f046f341-dadf-4423-a512-af7489ecd02b tempest-VolumesImageMetadata-973235884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0d49b55-36a8-4593-92b1-f0f03ad06a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:15:17 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-f046f341-dadf-4423-a512-af7489ecd02b tempest-VolumesImageMetadata-973235884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f589561e-810e-4e98-b80f-706dcbcf80f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:15:17 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-f046f341-dadf-4423-a512-af7489ecd02b tempest-VolumesImageMetadata-973235884 None] Volume ffab1ce3-0d76-43d1-925c-87504ce04178: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ffab1ce3-0d76-43d1-925c-87504ce04178', 'volume_size': 1, 'image_id': 'ad86f424-7d2a-4f3b-9577-890075e7dc72', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ad86f424-7d2a-4f3b-9577-890075e7dc72', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '33db0ca5091747b1a3438d70bf53390c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ad86f424-7d2a-4f3b-9577-890075e7dc72', 'created_at': datetime.datetime(2026, 4, 29, 13, 0, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 13, 0, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ad86f424-7d2a-4f3b-9577-890075e7dc72/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 29 15:15:17 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-f046f341-dadf-4423-a512-af7489ecd02b tempest-VolumesImageMetadata-973235884 None] Trying to clone ffab1ce3-0d76-43d1-925c-87504ce04178 from image ad86f424-7d2a-4f3b-9577-890075e7dc72 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ad86f424-7d2a-4f3b-9577-890075e7dc72', 'metadata': {}}]). {{(pid=84448) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 29 15:15:17 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [None req-f046f341-dadf-4423-a512-af7489ecd02b tempest-VolumesImageMetadata-973235884 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_hdt18e1odevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84448) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 29 15:15:17 devstack cinder-volume[84448]: INFO cinder.image.image_utils [None req-f046f341-dadf-4423-a512-af7489ecd02b tempest-VolumesImageMetadata-973235884 None] Image download 20.69 MB at 20.69 MB/s Apr 29 15:15:17 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[b34669bb-d9cb-4b7a-94aa-8641d7d7ac02]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:15:17 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f046f341-dadf-4423-a512-af7489ecd02b tempest-VolumesImageMetadata-973235884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_hdt18e1odevstack@QuobyteHD {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:15:17 devstack sudo[96666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_hdt18e1odevstack@QuobyteHD Apr 29 15:15:17 devstack sudo[96666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:15:18 devstack sudo[96666]: pam_unix(sudo:session): session closed for user root Apr 29 15:15:18 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f046f341-dadf-4423-a512-af7489ecd02b tempest-VolumesImageMetadata-973235884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_hdt18e1odevstack@QuobyteHD" returned: 0 in 0.731s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:15:18 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [None req-f046f341-dadf-4423-a512-af7489ecd02b tempest-VolumesImageMetadata-973235884 None] Temporary image ad86f424-7d2a-4f3b-9577-890075e7dc72 is fetched for user 69dd8a3d53804b6f83735cac4d41b370. {{(pid=84448) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 29 15:15:18 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[91cc8873-e09a-4143-8e7a-114d0ffdd9fd]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:15:18 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f046f341-dadf-4423-a512-af7489ecd02b tempest-VolumesImageMetadata-973235884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_hdt18e1odevstack@QuobyteHD {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:15:18 devstack sudo[96671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_hdt18e1odevstack@QuobyteHD Apr 29 15:15:18 devstack sudo[96671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:15:19 devstack sudo[96671]: pam_unix(sudo:session): session closed for user root Apr 29 15:15:19 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f046f341-dadf-4423-a512-af7489ecd02b tempest-VolumesImageMetadata-973235884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_hdt18e1odevstack@QuobyteHD" returned: 0 in 0.832s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:15:19 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-f046f341-dadf-4423-a512-af7489ecd02b tempest-VolumesImageMetadata-973235884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:15:19 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-f046f341-dadf-4423-a512-af7489ecd02b tempest-VolumesImageMetadata-973235884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:15:19 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-f046f341-dadf-4423-a512-af7489ecd02b tempest-VolumesImageMetadata-973235884 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:15:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1232083099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffab1ce3-0d76-43d1-925c-87504ce04178,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38c19ef7a606478a99fef6792c5d2b90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:15:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:15:17Z,use_quota=True,user_id='69dd8a3d53804b6f83735cac4d41b370',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:15:19 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-f046f341-dadf-4423-a512-af7489ecd02b tempest-VolumesImageMetadata-973235884 None] Creating volume ffab1ce3-0d76-43d1-925c-87504ce04178 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:15:19 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-f046f341-dadf-4423-a512-af7489ecd02b tempest-VolumesImageMetadata-973235884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:15:19 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-f046f341-dadf-4423-a512-af7489ecd02b tempest-VolumesImageMetadata-973235884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:15:19 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-f046f341-dadf-4423-a512-af7489ecd02b tempest-VolumesImageMetadata-973235884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:15:19 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-f046f341-dadf-4423-a512-af7489ecd02b tempest-VolumesImageMetadata-973235884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:15:19 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-f046f341-dadf-4423-a512-af7489ecd02b tempest-VolumesImageMetadata-973235884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:15:19 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-f046f341-dadf-4423-a512-af7489ecd02b tempest-VolumesImageMetadata-973235884 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:15:19 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-f046f341-dadf-4423-a512-af7489ecd02b tempest-VolumesImageMetadata-973235884 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:15:19 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f046f341-dadf-4423-a512-af7489ecd02b tempest-VolumesImageMetadata-973235884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ffab1ce3-0d76-43d1-925c-87504ce04178 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:15:19 devstack sudo[96677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ffab1ce3-0d76-43d1-925c-87504ce04178 1073741824 Apr 29 15:15:19 devstack sudo[96677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:15:20 devstack sudo[96677]: pam_unix(sudo:session): session closed for user root Apr 29 15:15:20 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f046f341-dadf-4423-a512-af7489ecd02b tempest-VolumesImageMetadata-973235884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ffab1ce3-0d76-43d1-925c-87504ce04178 1073741824" returned: 0 in 1.006s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:15:20 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f046f341-dadf-4423-a512-af7489ecd02b tempest-VolumesImageMetadata-973235884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ffab1ce3-0d76-43d1-925c-87504ce04178 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:15:20 devstack sudo[96683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ffab1ce3-0d76-43d1-925c-87504ce04178 Apr 29 15:15:20 devstack sudo[96683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:15:21 devstack sudo[96683]: pam_unix(sudo:session): session closed for user root Apr 29 15:15:21 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f046f341-dadf-4423-a512-af7489ecd02b tempest-VolumesImageMetadata-973235884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ffab1ce3-0d76-43d1-925c-87504ce04178" returned: 0 in 0.719s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:15:21 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-f046f341-dadf-4423-a512-af7489ecd02b tempest-VolumesImageMetadata-973235884 None] <== create_volume: return (1783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:15:21 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-f046f341-dadf-4423-a512-af7489ecd02b tempest-VolumesImageMetadata-973235884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.788s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:15:21 devstack cinder-volume[84448]: DEBUG cinder.volume.volume_utils [None req-f046f341-dadf-4423-a512-af7489ecd02b tempest-VolumesImageMetadata-973235884 None] Attempting download of ad86f424-7d2a-4f3b-9577-890075e7dc72 ((None, [{'url': 'file:///opt/stack/data/glance/images/ad86f424-7d2a-4f3b-9577-890075e7dc72', 'metadata': {}}])) to volume ffab1ce3-0d76-43d1-925c-87504ce04178. {{(pid=84448) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 29 15:15:21 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[976226a0-4f9e-483c-b1e7-e59815da9bf0]: (4, 'raw') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:15:21 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f046f341-dadf-4423-a512-af7489ecd02b tempest-VolumesImageMetadata-973235884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ad86f424-7d2a-4f3b-9577-890075e7dc72_wcmaoqy9 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:15:21 devstack sudo[96688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ad86f424-7d2a-4f3b-9577-890075e7dc72_wcmaoqy9 Apr 29 15:15:21 devstack sudo[96688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:15:22 devstack sudo[96688]: pam_unix(sudo:session): session closed for user root Apr 29 15:15:22 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f046f341-dadf-4423-a512-af7489ecd02b tempest-VolumesImageMetadata-973235884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ad86f424-7d2a-4f3b-9577-890075e7dc72_wcmaoqy9" returned: 0 in 0.836s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:15:22 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f046f341-dadf-4423-a512-af7489ecd02b tempest-VolumesImageMetadata-973235884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ad86f424-7d2a-4f3b-9577-890075e7dc72_wcmaoqy9 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:15:22 devstack sudo[96692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ad86f424-7d2a-4f3b-9577-890075e7dc72_wcmaoqy9 Apr 29 15:15:22 devstack sudo[96692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:15:23 devstack sudo[96692]: pam_unix(sudo:session): session closed for user root Apr 29 15:15:23 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f046f341-dadf-4423-a512-af7489ecd02b tempest-VolumesImageMetadata-973235884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ad86f424-7d2a-4f3b-9577-890075e7dc72_wcmaoqy9" returned: 1 in 1.323s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:15:23 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f046f341-dadf-4423-a512-af7489ecd02b tempest-VolumesImageMetadata-973235884 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ad86f424-7d2a-4f3b-9577-890075e7dc72_wcmaoqy9' failed. Not Retrying. {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 15:15:23 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e8276e3-075f-457e-9909-a7ea5f62525a]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:15:23 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f046f341-dadf-4423-a512-af7489ecd02b tempest-VolumesImageMetadata-973235884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_hdt18e1odevstack@QuobyteHD {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:15:23 devstack sudo[96744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_hdt18e1odevstack@QuobyteHD Apr 29 15:15:23 devstack sudo[96744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:15:24 devstack sudo[96744]: pam_unix(sudo:session): session closed for user root Apr 29 15:15:24 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f046f341-dadf-4423-a512-af7489ecd02b tempest-VolumesImageMetadata-973235884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_hdt18e1odevstack@QuobyteHD" returned: 0 in 0.817s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:15:24 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [None req-f046f341-dadf-4423-a512-af7489ecd02b tempest-VolumesImageMetadata-973235884 None] ad86f424-7d2a-4f3b-9577-890075e7dc72 was qcow2, converting to raw {{(pid=84448) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 29 15:15:24 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f046f341-dadf-4423-a512-af7489ecd02b tempest-VolumesImageMetadata-973235884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_hdt18e1odevstack@QuobyteHD /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ffab1ce3-0d76-43d1-925c-87504ce04178 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:15:24 devstack sudo[96750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_hdt18e1odevstack@QuobyteHD /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ffab1ce3-0d76-43d1-925c-87504ce04178 Apr 29 15:15:24 devstack sudo[96750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:15:26 devstack sudo[96750]: pam_unix(sudo:session): session closed for user root Apr 29 15:15:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f046f341-dadf-4423-a512-af7489ecd02b tempest-VolumesImageMetadata-973235884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_hdt18e1odevstack@QuobyteHD /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ffab1ce3-0d76-43d1-925c-87504ce04178" returned: 0 in 2.624s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:15:26 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [None req-f046f341-dadf-4423-a512-af7489ecd02b tempest-VolumesImageMetadata-973235884 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_hdt18e1odevstack@QuobyteHD, size 112.00 MB, duration 2.63 sec, destination /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ffab1ce3-0d76-43d1-925c-87504ce04178 {{(pid=84448) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 15:15:26 devstack cinder-volume[84448]: INFO cinder.image.image_utils [None req-f046f341-dadf-4423-a512-af7489ecd02b tempest-VolumesImageMetadata-973235884 None] Converted 112.00 MB image at 42.66 MB/s Apr 29 15:15:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f046f341-dadf-4423-a512-af7489ecd02b tempest-VolumesImageMetadata-973235884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ffab1ce3-0d76-43d1-925c-87504ce04178 1G {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:15:26 devstack sudo[96798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ffab1ce3-0d76-43d1-925c-87504ce04178 1G Apr 29 15:15:26 devstack sudo[96798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:15:27 devstack sudo[96798]: pam_unix(sudo:session): session closed for user root Apr 29 15:15:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f046f341-dadf-4423-a512-af7489ecd02b tempest-VolumesImageMetadata-973235884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ffab1ce3-0d76-43d1-925c-87504ce04178 1G" returned: 0 in 0.822s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:15:27 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f265d9b-552e-411e-a76d-96c8abd442f5]: (4, 'raw') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:15:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f046f341-dadf-4423-a512-af7489ecd02b tempest-VolumesImageMetadata-973235884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ffab1ce3-0d76-43d1-925c-87504ce04178 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:15:27 devstack sudo[96809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ffab1ce3-0d76-43d1-925c-87504ce04178 Apr 29 15:15:27 devstack sudo[96809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:15:28 devstack sudo[96809]: pam_unix(sudo:session): session closed for user root Apr 29 15:15:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f046f341-dadf-4423-a512-af7489ecd02b tempest-VolumesImageMetadata-973235884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ffab1ce3-0d76-43d1-925c-87504ce04178" returned: 0 in 0.882s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:15:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f046f341-dadf-4423-a512-af7489ecd02b tempest-VolumesImageMetadata-973235884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ffab1ce3-0d76-43d1-925c-87504ce04178 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:15:28 devstack sudo[96813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ffab1ce3-0d76-43d1-925c-87504ce04178 Apr 29 15:15:28 devstack sudo[96813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:15:29 devstack sudo[96813]: pam_unix(sudo:session): session closed for user root Apr 29 15:15:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f046f341-dadf-4423-a512-af7489ecd02b tempest-VolumesImageMetadata-973235884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ffab1ce3-0d76-43d1-925c-87504ce04178" returned: 1 in 0.988s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:15:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f046f341-dadf-4423-a512-af7489ecd02b tempest-VolumesImageMetadata-973235884 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ffab1ce3-0d76-43d1-925c-87504ce04178' failed. Not Retrying. {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 15:15:29 devstack cinder-volume[84448]: DEBUG cinder.volume.volume_utils [None req-f046f341-dadf-4423-a512-af7489ecd02b tempest-VolumesImageMetadata-973235884 None] Downloaded image ad86f424-7d2a-4f3b-9577-890075e7dc72 ((None, [{'url': 'file:///opt/stack/data/glance/images/ad86f424-7d2a-4f3b-9577-890075e7dc72', 'metadata': {}}])) to volume ffab1ce3-0d76-43d1-925c-87504ce04178 successfully. {{(pid=84448) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 29 15:15:29 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [None req-f046f341-dadf-4423-a512-af7489ecd02b tempest-VolumesImageMetadata-973235884 None] Temporary image ad86f424-7d2a-4f3b-9577-890075e7dc72 for user 69dd8a3d53804b6f83735cac4d41b370 is deleted. {{(pid=84448) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 29 15:15:29 devstack cinder-volume[84448]: DEBUG cinder.volume.volume_utils [None req-f046f341-dadf-4423-a512-af7489ecd02b tempest-VolumesImageMetadata-973235884 None] Marking volume ffab1ce3-0d76-43d1-925c-87504ce04178 as bootable. {{(pid=84448) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 29 15:15:29 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-f046f341-dadf-4423-a512-af7489ecd02b tempest-VolumesImageMetadata-973235884 None] Copying metadata from image ad86f424-7d2a-4f3b-9577-890075e7dc72 to ffab1ce3-0d76-43d1-925c-87504ce04178. {{(pid=84448) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 29 15:15:29 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-f046f341-dadf-4423-a512-af7489ecd02b tempest-VolumesImageMetadata-973235884 None] Creating volume glance metadata for volume ffab1ce3-0d76-43d1-925c-87504ce04178 backed by image ad86f424-7d2a-4f3b-9577-890075e7dc72 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'ad86f424-7d2a-4f3b-9577-890075e7dc72', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84448) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 29 15:15:29 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-f046f341-dadf-4423-a512-af7489ecd02b tempest-VolumesImageMetadata-973235884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f589561e-810e-4e98-b80f-706dcbcf80f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffab1ce3-0d76-43d1-925c-87504ce04178', 'volume_size': 1, 'image_id': 'ad86f424-7d2a-4f3b-9577-890075e7dc72', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ad86f424-7d2a-4f3b-9577-890075e7dc72', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '33db0ca5091747b1a3438d70bf53390c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ad86f424-7d2a-4f3b-9577-890075e7dc72', 'created_at': datetime.datetime(2026, 4, 29, 13, 0, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 13, 0, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ad86f424-7d2a-4f3b-9577-890075e7dc72/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:15:29 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-f046f341-dadf-4423-a512-af7489ecd02b tempest-VolumesImageMetadata-973235884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aed0f66-bbbc-4339-a0a8-6c4ff23fc52f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:15:29 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-f046f341-dadf-4423-a512-af7489ecd02b tempest-VolumesImageMetadata-973235884 None] Volume volume-ffab1ce3-0d76-43d1-925c-87504ce04178 (ffab1ce3-0d76-43d1-925c-87504ce04178): created successfully Apr 29 15:15:29 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-f046f341-dadf-4423-a512-af7489ecd02b tempest-VolumesImageMetadata-973235884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aed0f66-bbbc-4339-a0a8-6c4ff23fc52f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:15:29 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-f046f341-dadf-4423-a512-af7489ecd02b tempest-VolumesImageMetadata-973235884 None] Flow 'volume_create_manager' (b56eb258-9579-4038-9153-d2b997f5591a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:15:29 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-f046f341-dadf-4423-a512-af7489ecd02b tempest-VolumesImageMetadata-973235884 None] Created volume successfully. Apr 29 15:15:30 devstack cinder-volume[84448]: DEBUG oslo_service.periodic_task [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84448) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 15:15:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:15:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:15:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:15:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:15:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:15:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:15:30 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-7e700277-0d57-4a47-81c1-79ff6c8503ca tempest-VolumesImageMetadata-973235884 None] Acquiring lock "cinder-ffab1ce3-0d76-43d1-925c-87504ce04178-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:15:30 devstack sudo[96825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:15:30 devstack sudo[96825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:15:30 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-7e700277-0d57-4a47-81c1-79ff6c8503ca tempest-VolumesImageMetadata-973235884 None] Lock "cinder-ffab1ce3-0d76-43d1-925c-87504ce04178-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:15:30 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-7e700277-0d57-4a47-81c1-79ff6c8503ca tempest-VolumesImageMetadata-973235884 None] Acquiring lock "cinder-quobyte-ffab1ce3-0d76-43d1-925c-87504ce04178" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:15:30 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-7e700277-0d57-4a47-81c1-79ff6c8503ca tempest-VolumesImageMetadata-973235884 None] Lock "cinder-quobyte-ffab1ce3-0d76-43d1-925c-87504ce04178" acquired by "delete_volume" :: waited 0.029s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:15:30 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d0c06de-64ba-44b6-b925-d462ece9ef0b]: (4, 'raw') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:15:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7e700277-0d57-4a47-81c1-79ff6c8503ca tempest-VolumesImageMetadata-973235884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ffab1ce3-0d76-43d1-925c-87504ce04178 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:15:30 devstack sudo[96827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ffab1ce3-0d76-43d1-925c-87504ce04178 Apr 29 15:15:30 devstack sudo[96827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:15:31 devstack sudo[96825]: pam_unix(sudo:session): session closed for user root Apr 29 15:15:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.773s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:15:31 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:15:31 devstack sudo[96827]: pam_unix(sudo:session): session closed for user root Apr 29 15:15:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7e700277-0d57-4a47-81c1-79ff6c8503ca tempest-VolumesImageMetadata-973235884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ffab1ce3-0d76-43d1-925c-87504ce04178" returned: 0 in 0.818s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:15:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7e700277-0d57-4a47-81c1-79ff6c8503ca tempest-VolumesImageMetadata-973235884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ffab1ce3-0d76-43d1-925c-87504ce04178 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:15:31 devstack sudo[96832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ffab1ce3-0d76-43d1-925c-87504ce04178 Apr 29 15:15:31 devstack sudo[96832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:15:32 devstack sudo[96832]: pam_unix(sudo:session): session closed for user root Apr 29 15:15:32 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7e700277-0d57-4a47-81c1-79ff6c8503ca tempest-VolumesImageMetadata-973235884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ffab1ce3-0d76-43d1-925c-87504ce04178" returned: 1 in 0.844s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:15:32 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7e700277-0d57-4a47-81c1-79ff6c8503ca tempest-VolumesImageMetadata-973235884 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ffab1ce3-0d76-43d1-925c-87504ce04178' failed. Not Retrying. {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 15:15:32 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7e700277-0d57-4a47-81c1-79ff6c8503ca tempest-VolumesImageMetadata-973235884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ffab1ce3-0d76-43d1-925c-87504ce04178 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:15:32 devstack sudo[96837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ffab1ce3-0d76-43d1-925c-87504ce04178 Apr 29 15:15:32 devstack sudo[96837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:15:33 devstack sudo[96837]: pam_unix(sudo:session): session closed for user root Apr 29 15:15:33 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7e700277-0d57-4a47-81c1-79ff6c8503ca tempest-VolumesImageMetadata-973235884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ffab1ce3-0d76-43d1-925c-87504ce04178" returned: 0 in 0.737s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:15:33 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-7e700277-0d57-4a47-81c1-79ff6c8503ca tempest-VolumesImageMetadata-973235884 None] Lock "cinder-quobyte-ffab1ce3-0d76-43d1-925c-87504ce04178" released by "delete_volume" :: held 2.488s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:15:33 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-7e700277-0d57-4a47-81c1-79ff6c8503ca tempest-VolumesImageMetadata-973235884 None] Created reservations ['698a9907-7893-4e3e-a7a0-6324f9067ff3', '9e284893-b07e-48fb-aca8-76a3e4fcf773', 'a4a690e3-900e-4f4e-84db-b8d40117c1bb', '998768c4-c3aa-460e-8ecb-f53ea93b7588'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:15:33 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-7e700277-0d57-4a47-81c1-79ff6c8503ca tempest-VolumesImageMetadata-973235884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:15:33 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-7e700277-0d57-4a47-81c1-79ff6c8503ca tempest-VolumesImageMetadata-973235884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:15:33 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-7e700277-0d57-4a47-81c1-79ff6c8503ca tempest-VolumesImageMetadata-973235884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:15:33 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-7e700277-0d57-4a47-81c1-79ff6c8503ca tempest-VolumesImageMetadata-973235884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:15:33 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-7e700277-0d57-4a47-81c1-79ff6c8503ca tempest-VolumesImageMetadata-973235884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:15:33 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7e700277-0d57-4a47-81c1-79ff6c8503ca tempest-VolumesImageMetadata-973235884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:15:33 devstack sudo[96840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:15:33 devstack sudo[96840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:15:33 devstack sudo[96840]: pam_unix(sudo:session): session closed for user root Apr 29 15:15:33 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7e700277-0d57-4a47-81c1-79ff6c8503ca tempest-VolumesImageMetadata-973235884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.678s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:15:33 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-7e700277-0d57-4a47-81c1-79ff6c8503ca tempest-VolumesImageMetadata-973235884 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:15:33 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-7e700277-0d57-4a47-81c1-79ff6c8503ca tempest-VolumesImageMetadata-973235884 None] Deleted volume successfully. Apr 29 15:15:33 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-7e700277-0d57-4a47-81c1-79ff6c8503ca tempest-VolumesImageMetadata-973235884 None] Lock "cinder-ffab1ce3-0d76-43d1-925c-87504ce04178-delete_volume" released by "delete_volume" :: held 3.439s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:15:37 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:SELECT=45,cinder:UPDATE=67,cinder:DELETE=3,cinder:INSERT=16 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:15:37 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:UPDATE=57,cinder:SELECT=53,cinder:INSERT=25,cinder:DELETE=7 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:15:37 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-85067989-86e3-4000-a757-4a7a9becf9e7 req-567df9cb-d02e-4369-9d61-5a89387f4164 tempest-AttachVolumeNegativeTest-1321218953 None] Terminate volume connection completed successfully. Apr 29 15:15:37 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-85067989-86e3-4000-a757-4a7a9becf9e7 req-567df9cb-d02e-4369-9d61-5a89387f4164 tempest-AttachVolumeNegativeTest-1321218953 None] Deleting attachment 3edd0939-fa02-4fd7-bf5f-3dd2297b5654. {{(pid=84448) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 15:15:39 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1548383-e891-4877-aca4-423271219352 tempest-SnapshotMetadataTestJSON-19757804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:15:39 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e1548383-e891-4877-aca4-423271219352 tempest-SnapshotMetadataTestJSON-19757804 None] Flow 'volume_create_manager' (fe900966-ad7a-43cb-a9f9-7b3ced2df1d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:15:39 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e1548383-e891-4877-aca4-423271219352 tempest-SnapshotMetadataTestJSON-19757804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (577c1352-451e-47c1-bacd-cef1d368bbe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:15:39 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e1548383-e891-4877-aca4-423271219352 tempest-SnapshotMetadataTestJSON-19757804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (577c1352-451e-47c1-bacd-cef1d368bbe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:15:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-296879326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a84f027c-be69-4bb5-a5a2-652674c6a46b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f90d877c3de4e0cb70477ef2eec090c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:15:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:15:39Z,use_quota=True,user_id='9f54cc49e40b42e296dc6ce40fe7e2ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:15:39 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e1548383-e891-4877-aca4-423271219352 tempest-SnapshotMetadataTestJSON-19757804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (465f02e5-799a-4c2d-9ec7-3ead121670d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:15:39 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e1548383-e891-4877-aca4-423271219352 tempest-SnapshotMetadataTestJSON-19757804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (465f02e5-799a-4c2d-9ec7-3ead121670d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:15:39 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e1548383-e891-4877-aca4-423271219352 tempest-SnapshotMetadataTestJSON-19757804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7364603-74f0-45f4-b1d9-81b81c0d063f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:15:39 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e1548383-e891-4877-aca4-423271219352 tempest-SnapshotMetadataTestJSON-19757804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7364603-74f0-45f4-b1d9-81b81c0d063f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a84f027c-be69-4bb5-a5a2-652674c6a46b', 'volume_name': 'volume-a84f027c-be69-4bb5-a5a2-652674c6a46b', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:15:39 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e1548383-e891-4877-aca4-423271219352 tempest-SnapshotMetadataTestJSON-19757804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e93023f6-c509-489a-b0f4-327281938f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:15:39 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e1548383-e891-4877-aca4-423271219352 tempest-SnapshotMetadataTestJSON-19757804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e93023f6-c509-489a-b0f4-327281938f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:15:39 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e1548383-e891-4877-aca4-423271219352 tempest-SnapshotMetadataTestJSON-19757804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8663aef7-5ebc-40ac-b821-62f6b21e33c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:15:39 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-e1548383-e891-4877-aca4-423271219352 tempest-SnapshotMetadataTestJSON-19757804 None] Volume a84f027c-be69-4bb5-a5a2-652674c6a46b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a84f027c-be69-4bb5-a5a2-652674c6a46b', 'volume_size': 1} Apr 29 15:15:39 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-e1548383-e891-4877-aca4-423271219352 tempest-SnapshotMetadataTestJSON-19757804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:15:39 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-e1548383-e891-4877-aca4-423271219352 tempest-SnapshotMetadataTestJSON-19757804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:15:39 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-e1548383-e891-4877-aca4-423271219352 tempest-SnapshotMetadataTestJSON-19757804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:15:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-296879326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a84f027c-be69-4bb5-a5a2-652674c6a46b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f90d877c3de4e0cb70477ef2eec090c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:15:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:15:39Z,use_quota=True,user_id='9f54cc49e40b42e296dc6ce40fe7e2ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:15:39 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-e1548383-e891-4877-aca4-423271219352 tempest-SnapshotMetadataTestJSON-19757804 None] Creating volume a84f027c-be69-4bb5-a5a2-652674c6a46b {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:15:39 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-e1548383-e891-4877-aca4-423271219352 tempest-SnapshotMetadataTestJSON-19757804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:15:39 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-e1548383-e891-4877-aca4-423271219352 tempest-SnapshotMetadataTestJSON-19757804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:15:39 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-e1548383-e891-4877-aca4-423271219352 tempest-SnapshotMetadataTestJSON-19757804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:15:39 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-e1548383-e891-4877-aca4-423271219352 tempest-SnapshotMetadataTestJSON-19757804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:15:39 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-e1548383-e891-4877-aca4-423271219352 tempest-SnapshotMetadataTestJSON-19757804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:15:39 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-e1548383-e891-4877-aca4-423271219352 tempest-SnapshotMetadataTestJSON-19757804 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:15:39 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-e1548383-e891-4877-aca4-423271219352 tempest-SnapshotMetadataTestJSON-19757804 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:15:39 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-e1548383-e891-4877-aca4-423271219352 tempest-SnapshotMetadataTestJSON-19757804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a84f027c-be69-4bb5-a5a2-652674c6a46b 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:15:39 devstack sudo[96848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a84f027c-be69-4bb5-a5a2-652674c6a46b 1073741824 Apr 29 15:15:39 devstack sudo[96848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:15:40 devstack sudo[96848]: pam_unix(sudo:session): session closed for user root Apr 29 15:15:40 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-e1548383-e891-4877-aca4-423271219352 tempest-SnapshotMetadataTestJSON-19757804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a84f027c-be69-4bb5-a5a2-652674c6a46b 1073741824" returned: 0 in 0.998s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:15:40 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-e1548383-e891-4877-aca4-423271219352 tempest-SnapshotMetadataTestJSON-19757804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a84f027c-be69-4bb5-a5a2-652674c6a46b {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:15:40 devstack sudo[96869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a84f027c-be69-4bb5-a5a2-652674c6a46b Apr 29 15:15:40 devstack sudo[96869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:15:41 devstack sudo[96869]: pam_unix(sudo:session): session closed for user root Apr 29 15:15:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-e1548383-e891-4877-aca4-423271219352 tempest-SnapshotMetadataTestJSON-19757804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a84f027c-be69-4bb5-a5a2-652674c6a46b" returned: 0 in 0.998s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:15:41 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-e1548383-e891-4877-aca4-423271219352 tempest-SnapshotMetadataTestJSON-19757804 None] <== create_volume: return (2058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:15:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-e1548383-e891-4877-aca4-423271219352 tempest-SnapshotMetadataTestJSON-19757804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.064s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:15:41 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e1548383-e891-4877-aca4-423271219352 tempest-SnapshotMetadataTestJSON-19757804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8663aef7-5ebc-40ac-b821-62f6b21e33c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a84f027c-be69-4bb5-a5a2-652674c6a46b', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:15:41 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e1548383-e891-4877-aca4-423271219352 tempest-SnapshotMetadataTestJSON-19757804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37cabeaa-2614-4578-b5b6-cb1ef26bbb1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:15:41 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-e1548383-e891-4877-aca4-423271219352 tempest-SnapshotMetadataTestJSON-19757804 None] Volume volume-a84f027c-be69-4bb5-a5a2-652674c6a46b (a84f027c-be69-4bb5-a5a2-652674c6a46b): created successfully Apr 29 15:15:41 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e1548383-e891-4877-aca4-423271219352 tempest-SnapshotMetadataTestJSON-19757804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37cabeaa-2614-4578-b5b6-cb1ef26bbb1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:15:41 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e1548383-e891-4877-aca4-423271219352 tempest-SnapshotMetadataTestJSON-19757804 None] Flow 'volume_create_manager' (fe900966-ad7a-43cb-a9f9-7b3ced2df1d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:15:41 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-e1548383-e891-4877-aca4-423271219352 tempest-SnapshotMetadataTestJSON-19757804 None] Created volume successfully. Apr 29 15:15:42 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-1b3e7e33-219d-4f7a-8a34-f7657f0881ed tempest-SnapshotMetadataTestJSON-19757804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:15:42 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-1b3e7e33-219d-4f7a-8a34-f7657f0881ed tempest-SnapshotMetadataTestJSON-19757804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:15:42 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-1b3e7e33-219d-4f7a-8a34-f7657f0881ed tempest-SnapshotMetadataTestJSON-19757804 None] Creating offline snapshot f30ef5f2-3e19-40f0-825c-20e9691e437f of volume a84f027c-be69-4bb5-a5a2-652674c6a46b {{(pid=84448) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 15:15:42 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[31eae414-722f-456f-9a41-02425267bff1]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:15:42 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1b3e7e33-219d-4f7a-8a34-f7657f0881ed tempest-SnapshotMetadataTestJSON-19757804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a84f027c-be69-4bb5-a5a2-652674c6a46b {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:15:43 devstack sudo[96903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a84f027c-be69-4bb5-a5a2-652674c6a46b Apr 29 15:15:43 devstack sudo[96903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:15:43 devstack sudo[96903]: pam_unix(sudo:session): session closed for user root Apr 29 15:15:43 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1b3e7e33-219d-4f7a-8a34-f7657f0881ed tempest-SnapshotMetadataTestJSON-19757804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a84f027c-be69-4bb5-a5a2-652674c6a46b" returned: 0 in 1.021s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:15:43 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1b3e7e33-219d-4f7a-8a34-f7657f0881ed tempest-SnapshotMetadataTestJSON-19757804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a84f027c-be69-4bb5-a5a2-652674c6a46b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a84f027c-be69-4bb5-a5a2-652674c6a46b.f30ef5f2-3e19-40f0-825c-20e9691e437f 1G {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:15:43 devstack sudo[96909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a84f027c-be69-4bb5-a5a2-652674c6a46b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a84f027c-be69-4bb5-a5a2-652674c6a46b.f30ef5f2-3e19-40f0-825c-20e9691e437f 1G Apr 29 15:15:43 devstack sudo[96909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:15:44 devstack sudo[96909]: pam_unix(sudo:session): session closed for user root Apr 29 15:15:44 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1b3e7e33-219d-4f7a-8a34-f7657f0881ed tempest-SnapshotMetadataTestJSON-19757804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a84f027c-be69-4bb5-a5a2-652674c6a46b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a84f027c-be69-4bb5-a5a2-652674c6a46b.f30ef5f2-3e19-40f0-825c-20e9691e437f 1G" returned: 0 in 0.845s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:15:44 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1b3e7e33-219d-4f7a-8a34-f7657f0881ed tempest-SnapshotMetadataTestJSON-19757804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a84f027c-be69-4bb5-a5a2-652674c6a46b -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a84f027c-be69-4bb5-a5a2-652674c6a46b.f30ef5f2-3e19-40f0-825c-20e9691e437f {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:15:44 devstack sudo[96917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a84f027c-be69-4bb5-a5a2-652674c6a46b -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a84f027c-be69-4bb5-a5a2-652674c6a46b.f30ef5f2-3e19-40f0-825c-20e9691e437f Apr 29 15:15:44 devstack sudo[96917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:15:45 devstack sudo[96917]: pam_unix(sudo:session): session closed for user root Apr 29 15:15:45 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1b3e7e33-219d-4f7a-8a34-f7657f0881ed tempest-SnapshotMetadataTestJSON-19757804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a84f027c-be69-4bb5-a5a2-652674c6a46b -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a84f027c-be69-4bb5-a5a2-652674c6a46b.f30ef5f2-3e19-40f0-825c-20e9691e437f" returned: 0 in 0.811s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:15:45 devstack cinder-volume[84448]: WARNING cinder.volume.drivers.remotefs [None req-1b3e7e33-219d-4f7a-8a34-f7657f0881ed tempest-SnapshotMetadataTestJSON-19757804 None] /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a84f027c-be69-4bb5-a5a2-652674c6a46b.f30ef5f2-3e19-40f0-825c-20e9691e437f is being set with open permissions: ugo+rw Apr 29 15:15:45 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1b3e7e33-219d-4f7a-8a34-f7657f0881ed tempest-SnapshotMetadataTestJSON-19757804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a84f027c-be69-4bb5-a5a2-652674c6a46b.f30ef5f2-3e19-40f0-825c-20e9691e437f {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:15:45 devstack sudo[96925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a84f027c-be69-4bb5-a5a2-652674c6a46b.f30ef5f2-3e19-40f0-825c-20e9691e437f Apr 29 15:15:45 devstack sudo[96925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:15:46 devstack sudo[96925]: pam_unix(sudo:session): session closed for user root Apr 29 15:15:46 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1b3e7e33-219d-4f7a-8a34-f7657f0881ed tempest-SnapshotMetadataTestJSON-19757804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a84f027c-be69-4bb5-a5a2-652674c6a46b.f30ef5f2-3e19-40f0-825c-20e9691e437f" returned: 0 in 0.701s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:15:46 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1b3e7e33-219d-4f7a-8a34-f7657f0881ed tempest-SnapshotMetadataTestJSON-19757804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a84f027c-be69-4bb5-a5a2-652674c6a46b.info {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:15:46 devstack sudo[96928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a84f027c-be69-4bb5-a5a2-652674c6a46b.info Apr 29 15:15:46 devstack sudo[96928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:15:47 devstack sudo[96928]: pam_unix(sudo:session): session closed for user root Apr 29 15:15:47 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1b3e7e33-219d-4f7a-8a34-f7657f0881ed tempest-SnapshotMetadataTestJSON-19757804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a84f027c-be69-4bb5-a5a2-652674c6a46b.info" returned: 0 in 0.792s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:15:47 devstack cinder-volume[84448]: WARNING cinder.volume.drivers.remotefs [None req-1b3e7e33-219d-4f7a-8a34-f7657f0881ed tempest-SnapshotMetadataTestJSON-19757804 None] /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a84f027c-be69-4bb5-a5a2-652674c6a46b.info is being set with open permissions: ugo+rw Apr 29 15:15:47 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1b3e7e33-219d-4f7a-8a34-f7657f0881ed tempest-SnapshotMetadataTestJSON-19757804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a84f027c-be69-4bb5-a5a2-652674c6a46b.info {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:15:47 devstack sudo[96931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a84f027c-be69-4bb5-a5a2-652674c6a46b.info Apr 29 15:15:47 devstack sudo[96931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:15:47 devstack sudo[96931]: pam_unix(sudo:session): session closed for user root Apr 29 15:15:47 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1b3e7e33-219d-4f7a-8a34-f7657f0881ed tempest-SnapshotMetadataTestJSON-19757804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a84f027c-be69-4bb5-a5a2-652674c6a46b.info" returned: 0 in 0.718s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:15:47 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-1b3e7e33-219d-4f7a-8a34-f7657f0881ed tempest-SnapshotMetadataTestJSON-19757804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.027s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:15:47 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-1b3e7e33-219d-4f7a-8a34-f7657f0881ed tempest-SnapshotMetadataTestJSON-19757804 None] Create snapshot completed successfully Apr 29 15:15:48 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-1e0a9073-0fc0-476f-9a3d-6a9f71b63558 tempest-SnapshotMetadataTestJSON-19757804 None] Acquiring lock "cinder-f30ef5f2-3e19-40f0-825c-20e9691e437f-delete_snapshot" by "delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:15:49 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-1e0a9073-0fc0-476f-9a3d-6a9f71b63558 tempest-SnapshotMetadataTestJSON-19757804 None] Lock "cinder-f30ef5f2-3e19-40f0-825c-20e9691e437f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:15:49 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-1e0a9073-0fc0-476f-9a3d-6a9f71b63558 tempest-SnapshotMetadataTestJSON-19757804 None] Acquiring lock "cinder-quobyte-a84f027c-be69-4bb5-a5a2-652674c6a46b" by "delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:15:49 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-1e0a9073-0fc0-476f-9a3d-6a9f71b63558 tempest-SnapshotMetadataTestJSON-19757804 None] Lock "cinder-quobyte-a84f027c-be69-4bb5-a5a2-652674c6a46b" acquired by "delete_snapshot" :: waited 0.024s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:15:49 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-1e0a9073-0fc0-476f-9a3d-6a9f71b63558 tempest-SnapshotMetadataTestJSON-19757804 None] Acquiring lock "cinder-quobyte-f30ef5f2-3e19-40f0-825c-20e9691e437f" by "_delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:15:49 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-1e0a9073-0fc0-476f-9a3d-6a9f71b63558 tempest-SnapshotMetadataTestJSON-19757804 None] Lock "cinder-quobyte-f30ef5f2-3e19-40f0-825c-20e9691e437f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:15:49 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-1e0a9073-0fc0-476f-9a3d-6a9f71b63558 tempest-SnapshotMetadataTestJSON-19757804 None] Deleting offline snapshot f30ef5f2-3e19-40f0-825c-20e9691e437f of volume a84f027c-be69-4bb5-a5a2-652674c6a46b {{(pid=84448) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 15:15:49 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-1e0a9073-0fc0-476f-9a3d-6a9f71b63558 tempest-SnapshotMetadataTestJSON-19757804 None] snapshot_file for this snap is: volume-a84f027c-be69-4bb5-a5a2-652674c6a46b.f30ef5f2-3e19-40f0-825c-20e9691e437f {{(pid=84448) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 15:15:49 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[40df3a2e-3162-496e-a15c-33a9a763a425]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:15:49 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1e0a9073-0fc0-476f-9a3d-6a9f71b63558 tempest-SnapshotMetadataTestJSON-19757804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a84f027c-be69-4bb5-a5a2-652674c6a46b.f30ef5f2-3e19-40f0-825c-20e9691e437f {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:15:49 devstack sudo[96950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a84f027c-be69-4bb5-a5a2-652674c6a46b.f30ef5f2-3e19-40f0-825c-20e9691e437f Apr 29 15:15:49 devstack sudo[96950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:15:50 devstack sudo[96950]: pam_unix(sudo:session): session closed for user root Apr 29 15:15:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1e0a9073-0fc0-476f-9a3d-6a9f71b63558 tempest-SnapshotMetadataTestJSON-19757804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a84f027c-be69-4bb5-a5a2-652674c6a46b.f30ef5f2-3e19-40f0-825c-20e9691e437f" returned: 0 in 1.024s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:15:50 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-1e0a9073-0fc0-476f-9a3d-6a9f71b63558 tempest-SnapshotMetadataTestJSON-19757804 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a84f027c-be69-4bb5-a5a2-652674c6a46b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84448) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 15:15:50 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc286ac-ba6e-49dd-ba9e-a24a6ff69021]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:15:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1e0a9073-0fc0-476f-9a3d-6a9f71b63558 tempest-SnapshotMetadataTestJSON-19757804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a84f027c-be69-4bb5-a5a2-652674c6a46b {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:15:50 devstack sudo[96955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a84f027c-be69-4bb5-a5a2-652674c6a46b Apr 29 15:15:50 devstack sudo[96955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:15:51 devstack sudo[96955]: pam_unix(sudo:session): session closed for user root Apr 29 15:15:51 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1e0a9073-0fc0-476f-9a3d-6a9f71b63558 tempest-SnapshotMetadataTestJSON-19757804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a84f027c-be69-4bb5-a5a2-652674c6a46b" returned: 0 in 1.000s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:15:51 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1e0a9073-0fc0-476f-9a3d-6a9f71b63558 tempest-SnapshotMetadataTestJSON-19757804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a84f027c-be69-4bb5-a5a2-652674c6a46b.f30ef5f2-3e19-40f0-825c-20e9691e437f {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:15:51 devstack sudo[96960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a84f027c-be69-4bb5-a5a2-652674c6a46b.f30ef5f2-3e19-40f0-825c-20e9691e437f Apr 29 15:15:51 devstack sudo[96960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:15:52 devstack sudo[96960]: pam_unix(sudo:session): session closed for user root Apr 29 15:15:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1e0a9073-0fc0-476f-9a3d-6a9f71b63558 tempest-SnapshotMetadataTestJSON-19757804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a84f027c-be69-4bb5-a5a2-652674c6a46b.f30ef5f2-3e19-40f0-825c-20e9691e437f" returned: 0 in 0.920s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:15:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1e0a9073-0fc0-476f-9a3d-6a9f71b63558 tempest-SnapshotMetadataTestJSON-19757804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a84f027c-be69-4bb5-a5a2-652674c6a46b.f30ef5f2-3e19-40f0-825c-20e9691e437f {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:15:52 devstack sudo[96982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a84f027c-be69-4bb5-a5a2-652674c6a46b.f30ef5f2-3e19-40f0-825c-20e9691e437f Apr 29 15:15:52 devstack sudo[96982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:15:52 devstack sudo[96982]: pam_unix(sudo:session): session closed for user root Apr 29 15:15:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1e0a9073-0fc0-476f-9a3d-6a9f71b63558 tempest-SnapshotMetadataTestJSON-19757804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a84f027c-be69-4bb5-a5a2-652674c6a46b.f30ef5f2-3e19-40f0-825c-20e9691e437f" returned: 0 in 0.851s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:15:53 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-1e0a9073-0fc0-476f-9a3d-6a9f71b63558 tempest-SnapshotMetadataTestJSON-19757804 None] Lock "cinder-quobyte-f30ef5f2-3e19-40f0-825c-20e9691e437f" released by "_delete_snapshot" :: held 3.945s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:15:53 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-1e0a9073-0fc0-476f-9a3d-6a9f71b63558 tempest-SnapshotMetadataTestJSON-19757804 None] Lock "cinder-quobyte-a84f027c-be69-4bb5-a5a2-652674c6a46b" released by "delete_snapshot" :: held 3.978s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:15:53 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-1e0a9073-0fc0-476f-9a3d-6a9f71b63558 tempest-SnapshotMetadataTestJSON-19757804 None] Created reservations ['7eff003f-8e4b-4bc2-afcd-ef072db22b0a', '509a7e8a-a735-4302-ad14-f38e0a82f13e', '28859e9f-6059-4057-8fae-641345f9528d', 'b00759ae-fdae-4e59-b20c-78ca9fc8e08a'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:15:53 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-1e0a9073-0fc0-476f-9a3d-6a9f71b63558 tempest-SnapshotMetadataTestJSON-19757804 None] Delete snapshot completed successfully. Apr 29 15:15:53 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-1e0a9073-0fc0-476f-9a3d-6a9f71b63558 tempest-SnapshotMetadataTestJSON-19757804 None] Lock "cinder-f30ef5f2-3e19-40f0-825c-20e9691e437f-delete_snapshot" released by "delete_snapshot" :: held 4.203s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:15:53 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-bfd1ccdb-71ef-4ff9-8884-5dfbdc490ccb tempest-SnapshotMetadataTestJSON-19757804 None] Acquiring lock "cinder-a84f027c-be69-4bb5-a5a2-652674c6a46b-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:15:53 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-bfd1ccdb-71ef-4ff9-8884-5dfbdc490ccb tempest-SnapshotMetadataTestJSON-19757804 None] Lock "cinder-a84f027c-be69-4bb5-a5a2-652674c6a46b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:15:53 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-bfd1ccdb-71ef-4ff9-8884-5dfbdc490ccb tempest-SnapshotMetadataTestJSON-19757804 None] Acquiring lock "cinder-quobyte-a84f027c-be69-4bb5-a5a2-652674c6a46b" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:15:53 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-bfd1ccdb-71ef-4ff9-8884-5dfbdc490ccb tempest-SnapshotMetadataTestJSON-19757804 None] Lock "cinder-quobyte-a84f027c-be69-4bb5-a5a2-652674c6a46b" acquired by "delete_volume" :: waited 0.034s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:15:53 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[bceb741e-2b1c-4ebe-b287-5bd58fbd899f]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:15:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-bfd1ccdb-71ef-4ff9-8884-5dfbdc490ccb tempest-SnapshotMetadataTestJSON-19757804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a84f027c-be69-4bb5-a5a2-652674c6a46b {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:15:53 devstack sudo[96993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a84f027c-be69-4bb5-a5a2-652674c6a46b Apr 29 15:15:53 devstack sudo[96993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:15:54 devstack sudo[96993]: pam_unix(sudo:session): session closed for user root Apr 29 15:15:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-bfd1ccdb-71ef-4ff9-8884-5dfbdc490ccb tempest-SnapshotMetadataTestJSON-19757804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a84f027c-be69-4bb5-a5a2-652674c6a46b" returned: 0 in 1.273s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:15:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-bfd1ccdb-71ef-4ff9-8884-5dfbdc490ccb tempest-SnapshotMetadataTestJSON-19757804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a84f027c-be69-4bb5-a5a2-652674c6a46b {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:15:54 devstack sudo[97064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a84f027c-be69-4bb5-a5a2-652674c6a46b Apr 29 15:15:54 devstack sudo[97064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:15:55 devstack sudo[97064]: pam_unix(sudo:session): session closed for user root Apr 29 15:15:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-bfd1ccdb-71ef-4ff9-8884-5dfbdc490ccb tempest-SnapshotMetadataTestJSON-19757804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a84f027c-be69-4bb5-a5a2-652674c6a46b" returned: 0 in 1.041s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:15:55 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-bfd1ccdb-71ef-4ff9-8884-5dfbdc490ccb tempest-SnapshotMetadataTestJSON-19757804 None] Lock "cinder-quobyte-a84f027c-be69-4bb5-a5a2-652674c6a46b" released by "delete_volume" :: held 2.412s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:15:55 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-bfd1ccdb-71ef-4ff9-8884-5dfbdc490ccb tempest-SnapshotMetadataTestJSON-19757804 None] Created reservations ['178c881c-de0d-4b09-84d8-911a0e8f4f86', '7a422501-64b1-40ca-b19e-9ce94fd93398', '02a0b13e-2301-4747-9ca4-42fc4bc33edf', '15181b33-70f7-47b4-b510-602cd2e96848'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:15:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-bfd1ccdb-71ef-4ff9-8884-5dfbdc490ccb tempest-SnapshotMetadataTestJSON-19757804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:15:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-bfd1ccdb-71ef-4ff9-8884-5dfbdc490ccb tempest-SnapshotMetadataTestJSON-19757804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:15:56 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-bfd1ccdb-71ef-4ff9-8884-5dfbdc490ccb tempest-SnapshotMetadataTestJSON-19757804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:15:56 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-bfd1ccdb-71ef-4ff9-8884-5dfbdc490ccb tempest-SnapshotMetadataTestJSON-19757804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:15:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-bfd1ccdb-71ef-4ff9-8884-5dfbdc490ccb tempest-SnapshotMetadataTestJSON-19757804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:15:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-bfd1ccdb-71ef-4ff9-8884-5dfbdc490ccb tempest-SnapshotMetadataTestJSON-19757804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:15:56 devstack sudo[97080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:15:56 devstack sudo[97080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:15:56 devstack sudo[97080]: pam_unix(sudo:session): session closed for user root Apr 29 15:15:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-bfd1ccdb-71ef-4ff9-8884-5dfbdc490ccb tempest-SnapshotMetadataTestJSON-19757804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.632s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:15:56 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-bfd1ccdb-71ef-4ff9-8884-5dfbdc490ccb tempest-SnapshotMetadataTestJSON-19757804 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:15:56 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-bfd1ccdb-71ef-4ff9-8884-5dfbdc490ccb tempest-SnapshotMetadataTestJSON-19757804 None] Deleted volume successfully. Apr 29 15:15:56 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-bfd1ccdb-71ef-4ff9-8884-5dfbdc490ccb tempest-SnapshotMetadataTestJSON-19757804 None] Lock "cinder-a84f027c-be69-4bb5-a5a2-652674c6a46b-delete_volume" released by "delete_volume" :: held 3.307s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:16:06 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:SELECT=15,cinder:INSERT=7,cinder:UPDATE=18,cinder:DELETE=1 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:16:06 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:UPDATE=18,cinder:SELECT=17,cinder:DELETE=2,cinder:INSERT=3 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:16:24 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-f377b996-b444-4527-9901-ada176211f99 tempest-AttachVolumeTestJSON-1394496241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:16:24 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-f377b996-b444-4527-9901-ada176211f99 tempest-AttachVolumeTestJSON-1394496241 None] Flow 'volume_create_manager' (7859e9c5-729e-44a4-ab07-f82ea38a51fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:16:24 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-f377b996-b444-4527-9901-ada176211f99 tempest-AttachVolumeTestJSON-1394496241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d62e954-0c17-464c-9858-93fdee2be475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:16:24 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-f377b996-b444-4527-9901-ada176211f99 tempest-AttachVolumeTestJSON-1394496241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d62e954-0c17-464c-9858-93fdee2be475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:16:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-373200776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf511176-359d-4e94-80d1-a4a3dbb97949,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33c47d81199440e5bdd459bf2f392652',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:16:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:16:25Z,use_quota=True,user_id='2fc15cf20cbc4e259b61500747485de0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:16:24 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-f377b996-b444-4527-9901-ada176211f99 tempest-AttachVolumeTestJSON-1394496241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a371db67-ba06-49d6-9b20-87303287d423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:16:24 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-f377b996-b444-4527-9901-ada176211f99 tempest-AttachVolumeTestJSON-1394496241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a371db67-ba06-49d6-9b20-87303287d423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:16:24 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-f377b996-b444-4527-9901-ada176211f99 tempest-AttachVolumeTestJSON-1394496241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (293e64aa-db3a-4d37-8657-8552a9d7a31d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:16:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-f377b996-b444-4527-9901-ada176211f99 tempest-AttachVolumeTestJSON-1394496241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (293e64aa-db3a-4d37-8657-8552a9d7a31d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf511176-359d-4e94-80d1-a4a3dbb97949', 'volume_name': 'volume-bf511176-359d-4e94-80d1-a4a3dbb97949', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:16:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-f377b996-b444-4527-9901-ada176211f99 tempest-AttachVolumeTestJSON-1394496241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cec00760-1621-4180-9b6e-3839c2f55d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:16:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-f377b996-b444-4527-9901-ada176211f99 tempest-AttachVolumeTestJSON-1394496241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cec00760-1621-4180-9b6e-3839c2f55d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:16:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-f377b996-b444-4527-9901-ada176211f99 tempest-AttachVolumeTestJSON-1394496241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc0a8d32-1fe8-480d-b9c1-0cff1fbd254b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:16:25 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-f377b996-b444-4527-9901-ada176211f99 tempest-AttachVolumeTestJSON-1394496241 None] Volume bf511176-359d-4e94-80d1-a4a3dbb97949: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf511176-359d-4e94-80d1-a4a3dbb97949', 'volume_size': 1} Apr 29 15:16:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-f377b996-b444-4527-9901-ada176211f99 tempest-AttachVolumeTestJSON-1394496241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:16:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-f377b996-b444-4527-9901-ada176211f99 tempest-AttachVolumeTestJSON-1394496241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:16:25 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-f377b996-b444-4527-9901-ada176211f99 tempest-AttachVolumeTestJSON-1394496241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:16:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-373200776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf511176-359d-4e94-80d1-a4a3dbb97949,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33c47d81199440e5bdd459bf2f392652',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:16:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:16:25Z,use_quota=True,user_id='2fc15cf20cbc4e259b61500747485de0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:16:25 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-f377b996-b444-4527-9901-ada176211f99 tempest-AttachVolumeTestJSON-1394496241 None] Creating volume bf511176-359d-4e94-80d1-a4a3dbb97949 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:16:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-f377b996-b444-4527-9901-ada176211f99 tempest-AttachVolumeTestJSON-1394496241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:16:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-f377b996-b444-4527-9901-ada176211f99 tempest-AttachVolumeTestJSON-1394496241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:16:25 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-f377b996-b444-4527-9901-ada176211f99 tempest-AttachVolumeTestJSON-1394496241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:16:25 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-f377b996-b444-4527-9901-ada176211f99 tempest-AttachVolumeTestJSON-1394496241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:16:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-f377b996-b444-4527-9901-ada176211f99 tempest-AttachVolumeTestJSON-1394496241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:16:25 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-f377b996-b444-4527-9901-ada176211f99 tempest-AttachVolumeTestJSON-1394496241 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:16:25 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-f377b996-b444-4527-9901-ada176211f99 tempest-AttachVolumeTestJSON-1394496241 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:16:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f377b996-b444-4527-9901-ada176211f99 tempest-AttachVolumeTestJSON-1394496241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-bf511176-359d-4e94-80d1-a4a3dbb97949 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:16:25 devstack sudo[97499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-bf511176-359d-4e94-80d1-a4a3dbb97949 1073741824 Apr 29 15:16:25 devstack sudo[97499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:16:26 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3f96f2d-928a-4357-bb4b-9589a461a5c7 tempest-ServerRescueNegativeTestJSON-1253271205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:16:26 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e3f96f2d-928a-4357-bb4b-9589a461a5c7 tempest-ServerRescueNegativeTestJSON-1253271205 None] Flow 'volume_create_manager' (7b3f59f3-d66d-4887-8ffc-3a7daa22c26d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:16:26 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e3f96f2d-928a-4357-bb4b-9589a461a5c7 tempest-ServerRescueNegativeTestJSON-1253271205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14394513-d469-454c-9783-cd22402a82eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:16:26 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e3f96f2d-928a-4357-bb4b-9589a461a5c7 tempest-ServerRescueNegativeTestJSON-1253271205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14394513-d469-454c-9783-cd22402a82eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:16:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-345662977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cebb93e5-5b0c-4815-9431-d7b2f3c83123,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f349d34e72c04da18a92e0b3e24f5628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:16:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:16:27Z,use_quota=True,user_id='f02358bc56244b6db119be5ca65aa45c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:16:26 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e3f96f2d-928a-4357-bb4b-9589a461a5c7 tempest-ServerRescueNegativeTestJSON-1253271205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b331500-9351-4316-addc-79b322f1f464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:16:27 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e3f96f2d-928a-4357-bb4b-9589a461a5c7 tempest-ServerRescueNegativeTestJSON-1253271205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b331500-9351-4316-addc-79b322f1f464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:16:27 devstack sudo[97499]: pam_unix(sudo:session): session closed for user root Apr 29 15:16:27 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e3f96f2d-928a-4357-bb4b-9589a461a5c7 tempest-ServerRescueNegativeTestJSON-1253271205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e706d96b-43ae-4a18-86e8-e0e3f0efaca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:16:27 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e3f96f2d-928a-4357-bb4b-9589a461a5c7 tempest-ServerRescueNegativeTestJSON-1253271205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e706d96b-43ae-4a18-86e8-e0e3f0efaca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cebb93e5-5b0c-4815-9431-d7b2f3c83123', 'volume_name': 'volume-cebb93e5-5b0c-4815-9431-d7b2f3c83123', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:16:27 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e3f96f2d-928a-4357-bb4b-9589a461a5c7 tempest-ServerRescueNegativeTestJSON-1253271205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d06bf8f7-740d-404a-ac76-446d95c5881f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:16:27 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e3f96f2d-928a-4357-bb4b-9589a461a5c7 tempest-ServerRescueNegativeTestJSON-1253271205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d06bf8f7-740d-404a-ac76-446d95c5881f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:16:27 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e3f96f2d-928a-4357-bb4b-9589a461a5c7 tempest-ServerRescueNegativeTestJSON-1253271205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3f7b9c7-6e65-49f7-b835-316fc1028c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:16:27 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-e3f96f2d-928a-4357-bb4b-9589a461a5c7 tempest-ServerRescueNegativeTestJSON-1253271205 None] Volume cebb93e5-5b0c-4815-9431-d7b2f3c83123: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cebb93e5-5b0c-4815-9431-d7b2f3c83123', 'volume_size': 1} Apr 29 15:16:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-e3f96f2d-928a-4357-bb4b-9589a461a5c7 tempest-ServerRescueNegativeTestJSON-1253271205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:16:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f377b996-b444-4527-9901-ada176211f99 tempest-AttachVolumeTestJSON-1394496241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-bf511176-359d-4e94-80d1-a4a3dbb97949 1073741824" returned: 0 in 2.024s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:16:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f377b996-b444-4527-9901-ada176211f99 tempest-AttachVolumeTestJSON-1394496241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-bf511176-359d-4e94-80d1-a4a3dbb97949 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:16:27 devstack sudo[97543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-bf511176-359d-4e94-80d1-a4a3dbb97949 Apr 29 15:16:27 devstack sudo[97543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:16:28 devstack sudo[97543]: pam_unix(sudo:session): session closed for user root Apr 29 15:16:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f377b996-b444-4527-9901-ada176211f99 tempest-AttachVolumeTestJSON-1394496241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-bf511176-359d-4e94-80d1-a4a3dbb97949" returned: 0 in 1.177s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:16:28 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-f377b996-b444-4527-9901-ada176211f99 tempest-AttachVolumeTestJSON-1394496241 None] <== create_volume: return (3274ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:16:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-f377b996-b444-4527-9901-ada176211f99 tempest-AttachVolumeTestJSON-1394496241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.281s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:16:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-e3f96f2d-928a-4357-bb4b-9589a461a5c7 tempest-ServerRescueNegativeTestJSON-1253271205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.257s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:16:28 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-e3f96f2d-928a-4357-bb4b-9589a461a5c7 tempest-ServerRescueNegativeTestJSON-1253271205 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:16:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-345662977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cebb93e5-5b0c-4815-9431-d7b2f3c83123,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f349d34e72c04da18a92e0b3e24f5628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:16:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:16:27Z,use_quota=True,user_id='f02358bc56244b6db119be5ca65aa45c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:16:28 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-e3f96f2d-928a-4357-bb4b-9589a461a5c7 tempest-ServerRescueNegativeTestJSON-1253271205 None] Creating volume cebb93e5-5b0c-4815-9431-d7b2f3c83123 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:16:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-e3f96f2d-928a-4357-bb4b-9589a461a5c7 tempest-ServerRescueNegativeTestJSON-1253271205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:16:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-e3f96f2d-928a-4357-bb4b-9589a461a5c7 tempest-ServerRescueNegativeTestJSON-1253271205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:16:28 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-e3f96f2d-928a-4357-bb4b-9589a461a5c7 tempest-ServerRescueNegativeTestJSON-1253271205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:16:28 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-e3f96f2d-928a-4357-bb4b-9589a461a5c7 tempest-ServerRescueNegativeTestJSON-1253271205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:16:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-e3f96f2d-928a-4357-bb4b-9589a461a5c7 tempest-ServerRescueNegativeTestJSON-1253271205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:16:28 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-e3f96f2d-928a-4357-bb4b-9589a461a5c7 tempest-ServerRescueNegativeTestJSON-1253271205 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:16:28 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-e3f96f2d-928a-4357-bb4b-9589a461a5c7 tempest-ServerRescueNegativeTestJSON-1253271205 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:16:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-e3f96f2d-928a-4357-bb4b-9589a461a5c7 tempest-ServerRescueNegativeTestJSON-1253271205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cebb93e5-5b0c-4815-9431-d7b2f3c83123 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:16:28 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-f377b996-b444-4527-9901-ada176211f99 tempest-AttachVolumeTestJSON-1394496241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc0a8d32-1fe8-480d-b9c1-0cff1fbd254b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf511176-359d-4e94-80d1-a4a3dbb97949', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:16:28 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-f377b996-b444-4527-9901-ada176211f99 tempest-AttachVolumeTestJSON-1394496241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fbf4a60-e2b8-4b88-a4f7-f7d4acb8a057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:16:28 devstack sudo[97572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cebb93e5-5b0c-4815-9431-d7b2f3c83123 1073741824 Apr 29 15:16:28 devstack sudo[97572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:16:28 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-f377b996-b444-4527-9901-ada176211f99 tempest-AttachVolumeTestJSON-1394496241 None] Volume volume-bf511176-359d-4e94-80d1-a4a3dbb97949 (bf511176-359d-4e94-80d1-a4a3dbb97949): created successfully Apr 29 15:16:28 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-f377b996-b444-4527-9901-ada176211f99 tempest-AttachVolumeTestJSON-1394496241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fbf4a60-e2b8-4b88-a4f7-f7d4acb8a057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:16:28 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-f377b996-b444-4527-9901-ada176211f99 tempest-AttachVolumeTestJSON-1394496241 None] Flow 'volume_create_manager' (7859e9c5-729e-44a4-ab07-f82ea38a51fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:16:28 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-f377b996-b444-4527-9901-ada176211f99 tempest-AttachVolumeTestJSON-1394496241 None] Created volume successfully. Apr 29 15:16:29 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-83731e05-782a-4dca-b55a-8d47d7d04d3d tempest-VolumesActionsTest-62398517 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:16:29 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-83731e05-782a-4dca-b55a-8d47d7d04d3d tempest-VolumesActionsTest-62398517 None] Flow 'volume_create_manager' (195702f9-0cc5-42f4-83cc-374ab2647f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:16:29 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-83731e05-782a-4dca-b55a-8d47d7d04d3d tempest-VolumesActionsTest-62398517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92276527-5bc1-4146-824a-cf290bd75b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:16:29 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-83731e05-782a-4dca-b55a-8d47d7d04d3d tempest-VolumesActionsTest-62398517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92276527-5bc1-4146-824a-cf290bd75b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:16:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-709146288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acec608c-4bb1-43ad-b598-b33d0ce50938,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db1397ab70024dfdbd8d2476b7a556e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:16:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:16:29Z,use_quota=True,user_id='e15b634389634195a8fd918d3b0dad27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:16:29 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-83731e05-782a-4dca-b55a-8d47d7d04d3d tempest-VolumesActionsTest-62398517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bd0d6cc-2b26-4922-9366-98e3fc5564f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:16:29 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-83731e05-782a-4dca-b55a-8d47d7d04d3d tempest-VolumesActionsTest-62398517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bd0d6cc-2b26-4922-9366-98e3fc5564f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:16:29 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-83731e05-782a-4dca-b55a-8d47d7d04d3d tempest-VolumesActionsTest-62398517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b76761f-742a-44ef-9798-843b89d0b051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:16:29 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-83731e05-782a-4dca-b55a-8d47d7d04d3d tempest-VolumesActionsTest-62398517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b76761f-742a-44ef-9798-843b89d0b051) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acec608c-4bb1-43ad-b598-b33d0ce50938', 'volume_name': 'volume-acec608c-4bb1-43ad-b598-b33d0ce50938', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:16:29 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-83731e05-782a-4dca-b55a-8d47d7d04d3d tempest-VolumesActionsTest-62398517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96c25d37-969d-48b1-a568-abd3119f8220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:16:29 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-83731e05-782a-4dca-b55a-8d47d7d04d3d tempest-VolumesActionsTest-62398517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96c25d37-969d-48b1-a568-abd3119f8220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:16:29 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-83731e05-782a-4dca-b55a-8d47d7d04d3d tempest-VolumesActionsTest-62398517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d894f6b6-d86c-440c-9ef3-ee746bc071ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:16:29 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-83731e05-782a-4dca-b55a-8d47d7d04d3d tempest-VolumesActionsTest-62398517 None] Volume acec608c-4bb1-43ad-b598-b33d0ce50938: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acec608c-4bb1-43ad-b598-b33d0ce50938', 'volume_size': 1} Apr 29 15:16:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-83731e05-782a-4dca-b55a-8d47d7d04d3d tempest-VolumesActionsTest-62398517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:16:29 devstack sudo[97572]: pam_unix(sudo:session): session closed for user root Apr 29 15:16:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-e3f96f2d-928a-4357-bb4b-9589a461a5c7 tempest-ServerRescueNegativeTestJSON-1253271205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cebb93e5-5b0c-4815-9431-d7b2f3c83123 1073741824" returned: 0 in 1.195s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:16:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-e3f96f2d-928a-4357-bb4b-9589a461a5c7 tempest-ServerRescueNegativeTestJSON-1253271205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cebb93e5-5b0c-4815-9431-d7b2f3c83123 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:16:29 devstack sudo[97607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cebb93e5-5b0c-4815-9431-d7b2f3c83123 Apr 29 15:16:29 devstack sudo[97607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:16:30 devstack sudo[97607]: pam_unix(sudo:session): session closed for user root Apr 29 15:16:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-e3f96f2d-928a-4357-bb4b-9589a461a5c7 tempest-ServerRescueNegativeTestJSON-1253271205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cebb93e5-5b0c-4815-9431-d7b2f3c83123" returned: 0 in 0.635s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:16:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-e3f96f2d-928a-4357-bb4b-9589a461a5c7 tempest-ServerRescueNegativeTestJSON-1253271205 None] <== create_volume: return (1902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:16:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-e3f96f2d-928a-4357-bb4b-9589a461a5c7 tempest-ServerRescueNegativeTestJSON-1253271205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.904s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:16:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-83731e05-782a-4dca-b55a-8d47d7d04d3d tempest-VolumesActionsTest-62398517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.779s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:16:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-83731e05-782a-4dca-b55a-8d47d7d04d3d tempest-VolumesActionsTest-62398517 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:16:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-709146288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acec608c-4bb1-43ad-b598-b33d0ce50938,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db1397ab70024dfdbd8d2476b7a556e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:16:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:16:29Z,use_quota=True,user_id='e15b634389634195a8fd918d3b0dad27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:16:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-83731e05-782a-4dca-b55a-8d47d7d04d3d tempest-VolumesActionsTest-62398517 None] Creating volume acec608c-4bb1-43ad-b598-b33d0ce50938 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:16:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-83731e05-782a-4dca-b55a-8d47d7d04d3d tempest-VolumesActionsTest-62398517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:16:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-83731e05-782a-4dca-b55a-8d47d7d04d3d tempest-VolumesActionsTest-62398517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:16:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-83731e05-782a-4dca-b55a-8d47d7d04d3d tempest-VolumesActionsTest-62398517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:16:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-83731e05-782a-4dca-b55a-8d47d7d04d3d tempest-VolumesActionsTest-62398517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:16:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-83731e05-782a-4dca-b55a-8d47d7d04d3d tempest-VolumesActionsTest-62398517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:16:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-83731e05-782a-4dca-b55a-8d47d7d04d3d tempest-VolumesActionsTest-62398517 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:16:30 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-83731e05-782a-4dca-b55a-8d47d7d04d3d tempest-VolumesActionsTest-62398517 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:16:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-83731e05-782a-4dca-b55a-8d47d7d04d3d tempest-VolumesActionsTest-62398517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-acec608c-4bb1-43ad-b598-b33d0ce50938 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:16:30 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e3f96f2d-928a-4357-bb4b-9589a461a5c7 tempest-ServerRescueNegativeTestJSON-1253271205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3f7b9c7-6e65-49f7-b835-316fc1028c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cebb93e5-5b0c-4815-9431-d7b2f3c83123', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:16:30 devstack sudo[97615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-acec608c-4bb1-43ad-b598-b33d0ce50938 1073741824 Apr 29 15:16:30 devstack sudo[97615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:16:30 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e3f96f2d-928a-4357-bb4b-9589a461a5c7 tempest-ServerRescueNegativeTestJSON-1253271205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dcfbf50-dcd4-4807-918c-ecc9748d9a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:16:30 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-e3f96f2d-928a-4357-bb4b-9589a461a5c7 tempest-ServerRescueNegativeTestJSON-1253271205 None] Volume volume-cebb93e5-5b0c-4815-9431-d7b2f3c83123 (cebb93e5-5b0c-4815-9431-d7b2f3c83123): created successfully Apr 29 15:16:30 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e3f96f2d-928a-4357-bb4b-9589a461a5c7 tempest-ServerRescueNegativeTestJSON-1253271205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dcfbf50-dcd4-4807-918c-ecc9748d9a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:16:30 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e3f96f2d-928a-4357-bb4b-9589a461a5c7 tempest-ServerRescueNegativeTestJSON-1253271205 None] Flow 'volume_create_manager' (7b3f59f3-d66d-4887-8ffc-3a7daa22c26d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:16:30 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-e3f96f2d-928a-4357-bb4b-9589a461a5c7 tempest-ServerRescueNegativeTestJSON-1253271205 None] Created volume successfully. Apr 29 15:16:30 devstack cinder-volume[84448]: DEBUG oslo_service.periodic_task [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84448) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 15:16:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:16:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:16:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:16:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:16:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:16:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:16:30 devstack sudo[97620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:16:30 devstack sudo[97620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:16:31 devstack sudo[97620]: pam_unix(sudo:session): session closed for user root Apr 29 15:16:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.833s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:16:31 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:16:31 devstack sudo[97615]: pam_unix(sudo:session): session closed for user root Apr 29 15:16:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-83731e05-782a-4dca-b55a-8d47d7d04d3d tempest-VolumesActionsTest-62398517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-acec608c-4bb1-43ad-b598-b33d0ce50938 1073741824" returned: 0 in 1.140s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:16:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-83731e05-782a-4dca-b55a-8d47d7d04d3d tempest-VolumesActionsTest-62398517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-acec608c-4bb1-43ad-b598-b33d0ce50938 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:16:31 devstack sudo[97631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-acec608c-4bb1-43ad-b598-b33d0ce50938 Apr 29 15:16:31 devstack sudo[97631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:16:32 devstack sudo[97631]: pam_unix(sudo:session): session closed for user root Apr 29 15:16:32 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-83731e05-782a-4dca-b55a-8d47d7d04d3d tempest-VolumesActionsTest-62398517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-acec608c-4bb1-43ad-b598-b33d0ce50938" returned: 0 in 0.679s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:16:32 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-83731e05-782a-4dca-b55a-8d47d7d04d3d tempest-VolumesActionsTest-62398517 None] <== create_volume: return (1869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:16:32 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-83731e05-782a-4dca-b55a-8d47d7d04d3d tempest-VolumesActionsTest-62398517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.871s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:16:32 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-83731e05-782a-4dca-b55a-8d47d7d04d3d tempest-VolumesActionsTest-62398517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d894f6b6-d86c-440c-9ef3-ee746bc071ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acec608c-4bb1-43ad-b598-b33d0ce50938', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:16:32 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-83731e05-782a-4dca-b55a-8d47d7d04d3d tempest-VolumesActionsTest-62398517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d28b560-66a2-4c5b-ace5-49ff1e55833e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:16:32 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-83731e05-782a-4dca-b55a-8d47d7d04d3d tempest-VolumesActionsTest-62398517 None] Volume volume-acec608c-4bb1-43ad-b598-b33d0ce50938 (acec608c-4bb1-43ad-b598-b33d0ce50938): created successfully Apr 29 15:16:32 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-83731e05-782a-4dca-b55a-8d47d7d04d3d tempest-VolumesActionsTest-62398517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d28b560-66a2-4c5b-ace5-49ff1e55833e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:16:32 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-83731e05-782a-4dca-b55a-8d47d7d04d3d tempest-VolumesActionsTest-62398517 None] Flow 'volume_create_manager' (195702f9-0cc5-42f4-83cc-374ab2647f4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:16:32 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-83731e05-782a-4dca-b55a-8d47d7d04d3d tempest-VolumesActionsTest-62398517 None] Created volume successfully. Apr 29 15:16:32 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-0ec3fa13-1d31-4dfe-9f8e-5ccee0289b4c req-a13e2232-a0d6-4e88-9b54-51fa67163f93 tempest-AttachVolumeTestJSON-1394496241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:16:32 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-0ec3fa13-1d31-4dfe-9f8e-5ccee0289b4c req-a13e2232-a0d6-4e88-9b54-51fa67163f93 tempest-AttachVolumeTestJSON-1394496241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:16:32 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c3fbad8-01a9-40b6-a5e4-8a3e97c95a83]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:16:32 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-0ec3fa13-1d31-4dfe-9f8e-5ccee0289b4c req-a13e2232-a0d6-4e88-9b54-51fa67163f93 tempest-AttachVolumeTestJSON-1394496241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-bf511176-359d-4e94-80d1-a4a3dbb97949 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:16:32 devstack sudo[97642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-bf511176-359d-4e94-80d1-a4a3dbb97949 Apr 29 15:16:32 devstack sudo[97642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:16:33 devstack sudo[97642]: pam_unix(sudo:session): session closed for user root Apr 29 15:16:33 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-0ec3fa13-1d31-4dfe-9f8e-5ccee0289b4c req-a13e2232-a0d6-4e88-9b54-51fa67163f93 tempest-AttachVolumeTestJSON-1394496241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-bf511176-359d-4e94-80d1-a4a3dbb97949" returned: 0 in 0.997s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:16:33 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-0ec3fa13-1d31-4dfe-9f8e-5ccee0289b4c req-a13e2232-a0d6-4e88-9b54-51fa67163f93 tempest-AttachVolumeTestJSON-1394496241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.026s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:16:33 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-0ec3fa13-1d31-4dfe-9f8e-5ccee0289b4c req-a13e2232-a0d6-4e88-9b54-51fa67163f93 tempest-AttachVolumeTestJSON-1394496241 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a', 'name': 'volume-bf511176-359d-4e94-80d1-a4a3dbb97949', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '40b1c3ca-0d36-49c0-af24-8491eb819616', 'enforce_multipath': True} {{(pid=84448) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 15:16:33 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-0ec3fa13-1d31-4dfe-9f8e-5ccee0289b4c req-a13e2232-a0d6-4e88-9b54-51fa67163f93 tempest-AttachVolumeTestJSON-1394496241 None] attachment_update completed successfully. Apr 29 15:16:37 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fb4a6ee-e527-4896-8756-114b3deff5d1 tempest-AttachVolumeNegativeTest-1321218953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:16:37 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6fb4a6ee-e527-4896-8756-114b3deff5d1 tempest-AttachVolumeNegativeTest-1321218953 None] Flow 'volume_create_manager' (c363303f-e1a2-40b9-84a3-818e75df4213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:16:37 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6fb4a6ee-e527-4896-8756-114b3deff5d1 tempest-AttachVolumeNegativeTest-1321218953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea7f50b0-6cf5-4dc1-bdc3-23a5c81e9006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:16:37 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6fb4a6ee-e527-4896-8756-114b3deff5d1 tempest-AttachVolumeNegativeTest-1321218953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea7f50b0-6cf5-4dc1-bdc3-23a5c81e9006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:16:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1402050066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bd506d1-26e8-4cfd-9ab8-6c62e7ae2581,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f80705dfae64e8cbfd0e0cbeacc682e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:16:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:16:38Z,use_quota=True,user_id='decaea8fffd2452eb3b2bb1bd5eff95f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:16:37 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6fb4a6ee-e527-4896-8756-114b3deff5d1 tempest-AttachVolumeNegativeTest-1321218953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5caa7bed-be6d-42a8-8398-888e0ba155f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:16:37 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6fb4a6ee-e527-4896-8756-114b3deff5d1 tempest-AttachVolumeNegativeTest-1321218953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5caa7bed-be6d-42a8-8398-888e0ba155f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:16:37 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6fb4a6ee-e527-4896-8756-114b3deff5d1 tempest-AttachVolumeNegativeTest-1321218953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0a3df31-032c-4c97-bb27-e2fef4347279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:16:37 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6fb4a6ee-e527-4896-8756-114b3deff5d1 tempest-AttachVolumeNegativeTest-1321218953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0a3df31-032c-4c97-bb27-e2fef4347279) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bd506d1-26e8-4cfd-9ab8-6c62e7ae2581', 'volume_name': 'volume-8bd506d1-26e8-4cfd-9ab8-6c62e7ae2581', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:16:37 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6fb4a6ee-e527-4896-8756-114b3deff5d1 tempest-AttachVolumeNegativeTest-1321218953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3b67ef8-2bc8-4746-9fcf-ebe9a38921bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:16:37 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6fb4a6ee-e527-4896-8756-114b3deff5d1 tempest-AttachVolumeNegativeTest-1321218953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3b67ef8-2bc8-4746-9fcf-ebe9a38921bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:16:37 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6fb4a6ee-e527-4896-8756-114b3deff5d1 tempest-AttachVolumeNegativeTest-1321218953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97354c3b-7e78-4101-91a9-21e6e155c502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:16:37 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-6fb4a6ee-e527-4896-8756-114b3deff5d1 tempest-AttachVolumeNegativeTest-1321218953 None] Volume 8bd506d1-26e8-4cfd-9ab8-6c62e7ae2581: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bd506d1-26e8-4cfd-9ab8-6c62e7ae2581', 'volume_size': 1} Apr 29 15:16:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-6fb4a6ee-e527-4896-8756-114b3deff5d1 tempest-AttachVolumeNegativeTest-1321218953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:16:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-6fb4a6ee-e527-4896-8756-114b3deff5d1 tempest-AttachVolumeNegativeTest-1321218953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:16:37 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-6fb4a6ee-e527-4896-8756-114b3deff5d1 tempest-AttachVolumeNegativeTest-1321218953 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:16:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1402050066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bd506d1-26e8-4cfd-9ab8-6c62e7ae2581,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f80705dfae64e8cbfd0e0cbeacc682e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:16:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:16:38Z,use_quota=True,user_id='decaea8fffd2452eb3b2bb1bd5eff95f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:16:37 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-6fb4a6ee-e527-4896-8756-114b3deff5d1 tempest-AttachVolumeNegativeTest-1321218953 None] Creating volume 8bd506d1-26e8-4cfd-9ab8-6c62e7ae2581 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:16:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-6fb4a6ee-e527-4896-8756-114b3deff5d1 tempest-AttachVolumeNegativeTest-1321218953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:16:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-6fb4a6ee-e527-4896-8756-114b3deff5d1 tempest-AttachVolumeNegativeTest-1321218953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:16:37 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-6fb4a6ee-e527-4896-8756-114b3deff5d1 tempest-AttachVolumeNegativeTest-1321218953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:16:37 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-6fb4a6ee-e527-4896-8756-114b3deff5d1 tempest-AttachVolumeNegativeTest-1321218953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:16:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-6fb4a6ee-e527-4896-8756-114b3deff5d1 tempest-AttachVolumeNegativeTest-1321218953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:16:37 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-6fb4a6ee-e527-4896-8756-114b3deff5d1 tempest-AttachVolumeNegativeTest-1321218953 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:16:37 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-6fb4a6ee-e527-4896-8756-114b3deff5d1 tempest-AttachVolumeNegativeTest-1321218953 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:16:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6fb4a6ee-e527-4896-8756-114b3deff5d1 tempest-AttachVolumeNegativeTest-1321218953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-8bd506d1-26e8-4cfd-9ab8-6c62e7ae2581 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:16:37 devstack sudo[98072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-8bd506d1-26e8-4cfd-9ab8-6c62e7ae2581 1073741824 Apr 29 15:16:37 devstack sudo[98072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:16:38 devstack sudo[98072]: pam_unix(sudo:session): session closed for user root Apr 29 15:16:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6fb4a6ee-e527-4896-8756-114b3deff5d1 tempest-AttachVolumeNegativeTest-1321218953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-8bd506d1-26e8-4cfd-9ab8-6c62e7ae2581 1073741824" returned: 0 in 1.063s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:16:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6fb4a6ee-e527-4896-8756-114b3deff5d1 tempest-AttachVolumeNegativeTest-1321218953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-8bd506d1-26e8-4cfd-9ab8-6c62e7ae2581 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:16:38 devstack sudo[98102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-8bd506d1-26e8-4cfd-9ab8-6c62e7ae2581 Apr 29 15:16:38 devstack sudo[98102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:16:39 devstack sudo[98102]: pam_unix(sudo:session): session closed for user root Apr 29 15:16:39 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6fb4a6ee-e527-4896-8756-114b3deff5d1 tempest-AttachVolumeNegativeTest-1321218953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-8bd506d1-26e8-4cfd-9ab8-6c62e7ae2581" returned: 0 in 0.709s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:16:39 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-6fb4a6ee-e527-4896-8756-114b3deff5d1 tempest-AttachVolumeNegativeTest-1321218953 None] <== create_volume: return (1822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:16:39 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-6fb4a6ee-e527-4896-8756-114b3deff5d1 tempest-AttachVolumeNegativeTest-1321218953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.825s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:16:39 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6fb4a6ee-e527-4896-8756-114b3deff5d1 tempest-AttachVolumeNegativeTest-1321218953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97354c3b-7e78-4101-91a9-21e6e155c502) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bd506d1-26e8-4cfd-9ab8-6c62e7ae2581', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:16:39 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6fb4a6ee-e527-4896-8756-114b3deff5d1 tempest-AttachVolumeNegativeTest-1321218953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (627c192f-e797-4de4-b094-f5b3c6d80ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:16:39 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-6fb4a6ee-e527-4896-8756-114b3deff5d1 tempest-AttachVolumeNegativeTest-1321218953 None] Volume volume-8bd506d1-26e8-4cfd-9ab8-6c62e7ae2581 (8bd506d1-26e8-4cfd-9ab8-6c62e7ae2581): created successfully Apr 29 15:16:39 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6fb4a6ee-e527-4896-8756-114b3deff5d1 tempest-AttachVolumeNegativeTest-1321218953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (627c192f-e797-4de4-b094-f5b3c6d80ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:16:39 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6fb4a6ee-e527-4896-8756-114b3deff5d1 tempest-AttachVolumeNegativeTest-1321218953 None] Flow 'volume_create_manager' (c363303f-e1a2-40b9-84a3-818e75df4213) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:16:39 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-6fb4a6ee-e527-4896-8756-114b3deff5d1 tempest-AttachVolumeNegativeTest-1321218953 None] Created volume successfully. Apr 29 15:16:43 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-0a1d6f41-779b-4250-89a1-b525015e66d6 req-d54abf8d-f81c-4cab-90d8-757b2c015c50 tempest-AttachVolumeNegativeTest-1321218953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:16:43 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-0a1d6f41-779b-4250-89a1-b525015e66d6 req-d54abf8d-f81c-4cab-90d8-757b2c015c50 tempest-AttachVolumeNegativeTest-1321218953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:16:43 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e613145-4b12-410b-b935-6e8f2f003412]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:16:43 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-0a1d6f41-779b-4250-89a1-b525015e66d6 req-d54abf8d-f81c-4cab-90d8-757b2c015c50 tempest-AttachVolumeNegativeTest-1321218953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-8bd506d1-26e8-4cfd-9ab8-6c62e7ae2581 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:16:43 devstack sudo[98223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-8bd506d1-26e8-4cfd-9ab8-6c62e7ae2581 Apr 29 15:16:43 devstack sudo[98223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:16:44 devstack sudo[98223]: pam_unix(sudo:session): session closed for user root Apr 29 15:16:44 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-0a1d6f41-779b-4250-89a1-b525015e66d6 req-d54abf8d-f81c-4cab-90d8-757b2c015c50 tempest-AttachVolumeNegativeTest-1321218953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-8bd506d1-26e8-4cfd-9ab8-6c62e7ae2581" returned: 0 in 1.210s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:16:44 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-0a1d6f41-779b-4250-89a1-b525015e66d6 req-d54abf8d-f81c-4cab-90d8-757b2c015c50 tempest-AttachVolumeNegativeTest-1321218953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.235s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:16:44 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-0a1d6f41-779b-4250-89a1-b525015e66d6 req-d54abf8d-f81c-4cab-90d8-757b2c015c50 tempest-AttachVolumeNegativeTest-1321218953 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a', 'name': 'volume-8bd506d1-26e8-4cfd-9ab8-6c62e7ae2581', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b4ed74c6-3441-4332-b573-ed78793f44c0', 'enforce_multipath': True} {{(pid=84448) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 15:16:44 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-0a1d6f41-779b-4250-89a1-b525015e66d6 req-d54abf8d-f81c-4cab-90d8-757b2c015c50 tempest-AttachVolumeNegativeTest-1321218953 None] attachment_update completed successfully. Apr 29 15:16:50 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-cd5f5436-ac29-4997-8452-09b88ed0d11a tempest-VolumesActionsTest-62398517 None] Acquiring lock "cinder-acec608c-4bb1-43ad-b598-b33d0ce50938" by "attach_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:16:50 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-cd5f5436-ac29-4997-8452-09b88ed0d11a tempest-VolumesActionsTest-62398517 None] Lock "cinder-acec608c-4bb1-43ad-b598-b33d0ce50938" acquired by "attach_volume" :: waited 0.043s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:16:50 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-cd5f5436-ac29-4997-8452-09b88ed0d11a tempest-VolumesActionsTest-62398517 None] Attaching volume acec608c-4bb1-43ad-b598-b33d0ce50938 to instance 627dea84-4970-484e-be6c-1cfab8a5bc0f at mountpoint /dev/vdb on host None. Apr 29 15:16:50 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-cd5f5436-ac29-4997-8452-09b88ed0d11a tempest-VolumesActionsTest-62398517 None] Attach volume completed successfully. Apr 29 15:16:50 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-cd5f5436-ac29-4997-8452-09b88ed0d11a tempest-VolumesActionsTest-62398517 None] Lock "cinder-acec608c-4bb1-43ad-b598-b33d0ce50938" released by "attach_volume" :: held 0.188s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:16:50 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-92322fb7-4a65-4aad-842d-95eae08f721d tempest-VolumesActionsTest-62398517 None] Acquiring lock "cinder-acec608c-4bb1-43ad-b598-b33d0ce50938-detach_volume" by "detach_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:16:50 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-92322fb7-4a65-4aad-842d-95eae08f721d tempest-VolumesActionsTest-62398517 None] Lock "cinder-acec608c-4bb1-43ad-b598-b33d0ce50938-detach_volume" acquired by "detach_volume" :: waited 0.035s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:16:50 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-92322fb7-4a65-4aad-842d-95eae08f721d tempest-VolumesActionsTest-62398517 None] Detaching volume acec608c-4bb1-43ad-b598-b33d0ce50938 from instance 627dea84-4970-484e-be6c-1cfab8a5bc0f. Apr 29 15:16:50 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-92322fb7-4a65-4aad-842d-95eae08f721d tempest-VolumesActionsTest-62398517 None] Detach volume completed successfully. Apr 29 15:16:50 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-92322fb7-4a65-4aad-842d-95eae08f721d tempest-VolumesActionsTest-62398517 None] Lock "cinder-acec608c-4bb1-43ad-b598-b33d0ce50938-detach_volume" released by "detach_volume" :: held 0.147s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:16:51 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-735b0b8b-733c-4212-83e5-141d230ad9d7 tempest-ServerRescueNegativeTestJSON-1253271205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:16:51 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-735b0b8b-733c-4212-83e5-141d230ad9d7 tempest-ServerRescueNegativeTestJSON-1253271205 None] Flow 'volume_create_manager' (b24173f1-eebf-415f-abd6-c7b72bea0851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:16:51 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-735b0b8b-733c-4212-83e5-141d230ad9d7 tempest-ServerRescueNegativeTestJSON-1253271205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bf94d90-a870-40a2-9276-b48e7edc13df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:16:51 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-735b0b8b-733c-4212-83e5-141d230ad9d7 tempest-ServerRescueNegativeTestJSON-1253271205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bf94d90-a870-40a2-9276-b48e7edc13df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:16:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1137803103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1424d010-9a13-4fa3-ba2c-db4d43abfa10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f349d34e72c04da18a92e0b3e24f5628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:16:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:16:51Z,use_quota=True,user_id='f02358bc56244b6db119be5ca65aa45c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:16:51 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-735b0b8b-733c-4212-83e5-141d230ad9d7 tempest-ServerRescueNegativeTestJSON-1253271205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (662d17cf-f083-497d-bec9-4a949383d914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:16:51 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-735b0b8b-733c-4212-83e5-141d230ad9d7 tempest-ServerRescueNegativeTestJSON-1253271205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (662d17cf-f083-497d-bec9-4a949383d914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:16:51 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-735b0b8b-733c-4212-83e5-141d230ad9d7 tempest-ServerRescueNegativeTestJSON-1253271205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00d79f39-2de9-4c12-86f0-e6ebe75e4c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:16:51 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-735b0b8b-733c-4212-83e5-141d230ad9d7 tempest-ServerRescueNegativeTestJSON-1253271205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00d79f39-2de9-4c12-86f0-e6ebe75e4c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1424d010-9a13-4fa3-ba2c-db4d43abfa10', 'volume_name': 'volume-1424d010-9a13-4fa3-ba2c-db4d43abfa10', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:16:51 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-735b0b8b-733c-4212-83e5-141d230ad9d7 tempest-ServerRescueNegativeTestJSON-1253271205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (449ab740-baab-4991-bbff-fd34fb216999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:16:51 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-735b0b8b-733c-4212-83e5-141d230ad9d7 tempest-ServerRescueNegativeTestJSON-1253271205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (449ab740-baab-4991-bbff-fd34fb216999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:16:51 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-735b0b8b-733c-4212-83e5-141d230ad9d7 tempest-ServerRescueNegativeTestJSON-1253271205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee2cd5f6-214b-4f91-a7cf-cdcb8c85376e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:16:51 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-735b0b8b-733c-4212-83e5-141d230ad9d7 tempest-ServerRescueNegativeTestJSON-1253271205 None] Volume 1424d010-9a13-4fa3-ba2c-db4d43abfa10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1424d010-9a13-4fa3-ba2c-db4d43abfa10', 'volume_size': 1} Apr 29 15:16:51 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-735b0b8b-733c-4212-83e5-141d230ad9d7 tempest-ServerRescueNegativeTestJSON-1253271205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:16:51 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-735b0b8b-733c-4212-83e5-141d230ad9d7 tempest-ServerRescueNegativeTestJSON-1253271205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:16:51 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-735b0b8b-733c-4212-83e5-141d230ad9d7 tempest-ServerRescueNegativeTestJSON-1253271205 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:16:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1137803103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1424d010-9a13-4fa3-ba2c-db4d43abfa10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f349d34e72c04da18a92e0b3e24f5628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:16:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:16:51Z,use_quota=True,user_id='f02358bc56244b6db119be5ca65aa45c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:16:51 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-735b0b8b-733c-4212-83e5-141d230ad9d7 tempest-ServerRescueNegativeTestJSON-1253271205 None] Creating volume 1424d010-9a13-4fa3-ba2c-db4d43abfa10 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:16:51 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-735b0b8b-733c-4212-83e5-141d230ad9d7 tempest-ServerRescueNegativeTestJSON-1253271205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:16:51 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-735b0b8b-733c-4212-83e5-141d230ad9d7 tempest-ServerRescueNegativeTestJSON-1253271205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:16:51 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-735b0b8b-733c-4212-83e5-141d230ad9d7 tempest-ServerRescueNegativeTestJSON-1253271205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:16:51 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-735b0b8b-733c-4212-83e5-141d230ad9d7 tempest-ServerRescueNegativeTestJSON-1253271205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:16:51 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-735b0b8b-733c-4212-83e5-141d230ad9d7 tempest-ServerRescueNegativeTestJSON-1253271205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:16:51 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-735b0b8b-733c-4212-83e5-141d230ad9d7 tempest-ServerRescueNegativeTestJSON-1253271205 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:16:51 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-735b0b8b-733c-4212-83e5-141d230ad9d7 tempest-ServerRescueNegativeTestJSON-1253271205 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:16:51 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-735b0b8b-733c-4212-83e5-141d230ad9d7 tempest-ServerRescueNegativeTestJSON-1253271205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1424d010-9a13-4fa3-ba2c-db4d43abfa10 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:16:51 devstack sudo[98430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1424d010-9a13-4fa3-ba2c-db4d43abfa10 1073741824 Apr 29 15:16:51 devstack sudo[98430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:16:53 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-673b81a1-7780-4275-b91c-4bcdcb70bf58 req-8af9d3a7-0c99-4dc1-9c1d-b93c71ef99fe tempest-AttachVolumeNegativeTest-1321218953 None] Terminate volume connection completed successfully. Apr 29 15:16:53 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-673b81a1-7780-4275-b91c-4bcdcb70bf58 req-8af9d3a7-0c99-4dc1-9c1d-b93c71ef99fe tempest-AttachVolumeNegativeTest-1321218953 None] Deleting attachment b4ed74c6-3441-4332-b573-ed78793f44c0. {{(pid=84448) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 15:16:53 devstack sudo[98430]: pam_unix(sudo:session): session closed for user root Apr 29 15:16:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-735b0b8b-733c-4212-83e5-141d230ad9d7 tempest-ServerRescueNegativeTestJSON-1253271205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1424d010-9a13-4fa3-ba2c-db4d43abfa10 1073741824" returned: 0 in 1.468s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:16:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-735b0b8b-733c-4212-83e5-141d230ad9d7 tempest-ServerRescueNegativeTestJSON-1253271205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1424d010-9a13-4fa3-ba2c-db4d43abfa10 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:16:53 devstack sudo[98499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1424d010-9a13-4fa3-ba2c-db4d43abfa10 Apr 29 15:16:53 devstack sudo[98499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:16:54 devstack sudo[98499]: pam_unix(sudo:session): session closed for user root Apr 29 15:16:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-735b0b8b-733c-4212-83e5-141d230ad9d7 tempest-ServerRescueNegativeTestJSON-1253271205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1424d010-9a13-4fa3-ba2c-db4d43abfa10" returned: 0 in 0.981s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:16:54 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-735b0b8b-733c-4212-83e5-141d230ad9d7 tempest-ServerRescueNegativeTestJSON-1253271205 None] <== create_volume: return (2531ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:16:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-735b0b8b-733c-4212-83e5-141d230ad9d7 tempest-ServerRescueNegativeTestJSON-1253271205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.534s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:16:54 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-735b0b8b-733c-4212-83e5-141d230ad9d7 tempest-ServerRescueNegativeTestJSON-1253271205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee2cd5f6-214b-4f91-a7cf-cdcb8c85376e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1424d010-9a13-4fa3-ba2c-db4d43abfa10', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:16:54 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-735b0b8b-733c-4212-83e5-141d230ad9d7 tempest-ServerRescueNegativeTestJSON-1253271205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53b89fd5-47ae-4a9e-862a-b9145522ff1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:16:54 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-735b0b8b-733c-4212-83e5-141d230ad9d7 tempest-ServerRescueNegativeTestJSON-1253271205 None] Volume volume-1424d010-9a13-4fa3-ba2c-db4d43abfa10 (1424d010-9a13-4fa3-ba2c-db4d43abfa10): created successfully Apr 29 15:16:54 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-735b0b8b-733c-4212-83e5-141d230ad9d7 tempest-ServerRescueNegativeTestJSON-1253271205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53b89fd5-47ae-4a9e-862a-b9145522ff1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:16:54 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-735b0b8b-733c-4212-83e5-141d230ad9d7 tempest-ServerRescueNegativeTestJSON-1253271205 None] Flow 'volume_create_manager' (b24173f1-eebf-415f-abd6-c7b72bea0851) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:16:54 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-735b0b8b-733c-4212-83e5-141d230ad9d7 tempest-ServerRescueNegativeTestJSON-1253271205 None] Created volume successfully. Apr 29 15:17:04 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:SELECT=25,cinder:UPDATE=17,cinder:INSERT=3 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:17:04 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:SELECT=32,cinder:UPDATE=25,cinder:INSERT=4,cinder:DELETE=5 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:17:17 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-affef255-37c6-4228-97d1-1a389b3aadd3 tempest-VolumesActionsTest-62398517 None] Acquiring lock "cinder-acec608c-4bb1-43ad-b598-b33d0ce50938" by "attach_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:17:17 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-affef255-37c6-4228-97d1-1a389b3aadd3 tempest-VolumesActionsTest-62398517 None] Lock "cinder-acec608c-4bb1-43ad-b598-b33d0ce50938" acquired by "attach_volume" :: waited 0.023s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:17:17 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-affef255-37c6-4228-97d1-1a389b3aadd3 tempest-VolumesActionsTest-62398517 None] Attaching volume acec608c-4bb1-43ad-b598-b33d0ce50938 to instance 2ee2054e-fa9d-4e52-96dc-2f3240fbbe99 at mountpoint /dev/vdb on host None. Apr 29 15:17:17 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-affef255-37c6-4228-97d1-1a389b3aadd3 tempest-VolumesActionsTest-62398517 None] Attach volume completed successfully. Apr 29 15:17:17 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-affef255-37c6-4228-97d1-1a389b3aadd3 tempest-VolumesActionsTest-62398517 None] Lock "cinder-acec608c-4bb1-43ad-b598-b33d0ce50938" released by "attach_volume" :: held 0.105s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:17:18 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-73ef49a2-f5f3-455f-b49b-8376070ed761 tempest-VolumesActionsTest-62398517 None] Acquiring lock "cinder-acec608c-4bb1-43ad-b598-b33d0ce50938-detach_volume" by "detach_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:17:18 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-73ef49a2-f5f3-455f-b49b-8376070ed761 tempest-VolumesActionsTest-62398517 None] Lock "cinder-acec608c-4bb1-43ad-b598-b33d0ce50938-detach_volume" acquired by "detach_volume" :: waited 0.028s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:17:18 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-73ef49a2-f5f3-455f-b49b-8376070ed761 tempest-VolumesActionsTest-62398517 None] Detaching volume acec608c-4bb1-43ad-b598-b33d0ce50938 from instance 2ee2054e-fa9d-4e52-96dc-2f3240fbbe99. Apr 29 15:17:18 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-73ef49a2-f5f3-455f-b49b-8376070ed761 tempest-VolumesActionsTest-62398517 None] Detach volume completed successfully. Apr 29 15:17:18 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-73ef49a2-f5f3-455f-b49b-8376070ed761 tempest-VolumesActionsTest-62398517 None] Lock "cinder-acec608c-4bb1-43ad-b598-b33d0ce50938-detach_volume" released by "detach_volume" :: held 0.066s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:17:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-6c3c4c07-b6cf-4e82-b8ee-877ebeb497fe tempest-VolumesActionsTest-62398517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:17:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-6c3c4c07-b6cf-4e82-b8ee-877ebeb497fe tempest-VolumesActionsTest-62398517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:17:29 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee40d430-431b-4ca3-94cb-8252bd2ad5a6]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:17:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6c3c4c07-b6cf-4e82-b8ee-877ebeb497fe tempest-VolumesActionsTest-62398517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-acec608c-4bb1-43ad-b598-b33d0ce50938 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:17:29 devstack sudo[98912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-acec608c-4bb1-43ad-b598-b33d0ce50938 Apr 29 15:17:29 devstack sudo[98912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:17:30 devstack sudo[98912]: pam_unix(sudo:session): session closed for user root Apr 29 15:17:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6c3c4c07-b6cf-4e82-b8ee-877ebeb497fe tempest-VolumesActionsTest-62398517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-acec608c-4bb1-43ad-b598-b33d0ce50938" returned: 0 in 0.779s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:17:30 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b56888-b42f-4296-9197-0b4952df0b60]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:17:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6c3c4c07-b6cf-4e82-b8ee-877ebeb497fe tempest-VolumesActionsTest-62398517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-acec608c-4bb1-43ad-b598-b33d0ce50938 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:17:30 devstack cinder-volume[84448]: DEBUG oslo_service.periodic_task [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84448) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 15:17:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:17:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:17:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:17:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:17:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:17:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:17:30 devstack sudo[98934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-acec608c-4bb1-43ad-b598-b33d0ce50938 Apr 29 15:17:30 devstack sudo[98934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:17:30 devstack sudo[98940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:17:30 devstack sudo[98940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:17:31 devstack sudo[98940]: pam_unix(sudo:session): session closed for user root Apr 29 15:17:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.681s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:17:31 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:17:31 devstack sudo[98934]: pam_unix(sudo:session): session closed for user root Apr 29 15:17:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6c3c4c07-b6cf-4e82-b8ee-877ebeb497fe tempest-VolumesActionsTest-62398517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-acec608c-4bb1-43ad-b598-b33d0ce50938" returned: 0 in 0.923s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:17:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6c3c4c07-b6cf-4e82-b8ee-877ebeb497fe tempest-VolumesActionsTest-62398517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-acec608c-4bb1-43ad-b598-b33d0ce50938 /opt/stack/data/cinder/conversion/acec608c-4bb1-43ad-b598-b33d0ce50938.temp_image.188f4df5-e46b-4f80-91c4-73c3054b0a367fmxnqod.img {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:17:31 devstack sudo[98959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-acec608c-4bb1-43ad-b598-b33d0ce50938 /opt/stack/data/cinder/conversion/acec608c-4bb1-43ad-b598-b33d0ce50938.temp_image.188f4df5-e46b-4f80-91c4-73c3054b0a367fmxnqod.img Apr 29 15:17:31 devstack sudo[98959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:17:32 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:SELECT=6,cinder:UPDATE=4,cinder:INSERT=1 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:17:38 devstack sudo[98959]: pam_unix(sudo:session): session closed for user root Apr 29 15:17:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6c3c4c07-b6cf-4e82-b8ee-877ebeb497fe tempest-VolumesActionsTest-62398517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-acec608c-4bb1-43ad-b598-b33d0ce50938 /opt/stack/data/cinder/conversion/acec608c-4bb1-43ad-b598-b33d0ce50938.temp_image.188f4df5-e46b-4f80-91c4-73c3054b0a367fmxnqod.img" returned: 0 in 6.862s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:17:38 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e1b06ce-38a4-4f8c-b045-b4632d00a0ae]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:17:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6c3c4c07-b6cf-4e82-b8ee-877ebeb497fe tempest-VolumesActionsTest-62398517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-acec608c-4bb1-43ad-b598-b33d0ce50938 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:17:38 devstack sudo[99014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-acec608c-4bb1-43ad-b598-b33d0ce50938 Apr 29 15:17:38 devstack sudo[99014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:17:38 devstack sudo[99014]: pam_unix(sudo:session): session closed for user root Apr 29 15:17:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6c3c4c07-b6cf-4e82-b8ee-877ebeb497fe tempest-VolumesActionsTest-62398517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-acec608c-4bb1-43ad-b598-b33d0ce50938" returned: 0 in 0.871s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:17:38 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [None req-6c3c4c07-b6cf-4e82-b8ee-877ebeb497fe tempest-VolumesActionsTest-62398517 None] Image conversion details: src /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-acec608c-4bb1-43ad-b598-b33d0ce50938, size 1024.00 MB, duration 6.86 sec, destination /opt/stack/data/cinder/conversion/acec608c-4bb1-43ad-b598-b33d0ce50938.temp_image.188f4df5-e46b-4f80-91c4-73c3054b0a367fmxnqod.img {{(pid=84448) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 15:17:38 devstack cinder-volume[84448]: INFO cinder.image.image_utils [None req-6c3c4c07-b6cf-4e82-b8ee-877ebeb497fe tempest-VolumesActionsTest-62398517 None] Converted 1024.00 MB image at 149.20 MB/s Apr 29 15:17:38 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [None req-6c3c4c07-b6cf-4e82-b8ee-877ebeb497fe tempest-VolumesActionsTest-62398517 None] 188f4df5-e46b-4f80-91c4-73c3054b0a36 was raw, no need to convert to raw {{(pid=84448) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Apr 29 15:17:40 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-39be88c2-cca8-421a-b91a-421f071281a0 req-c85514b1-6740-41d5-8508-d2e1869400bd tempest-ServerRescueNegativeTestJSON-1253271205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:17:47 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ed0b57d-4617-432a-8a9f-8327f8c5ca21 tempest-AttachVolumeNegativeTest-1321218953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:17:47 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6ed0b57d-4617-432a-8a9f-8327f8c5ca21 tempest-AttachVolumeNegativeTest-1321218953 None] Flow 'volume_create_manager' (fc254be0-87a2-49f2-9457-ab0c37034a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:17:47 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6ed0b57d-4617-432a-8a9f-8327f8c5ca21 tempest-AttachVolumeNegativeTest-1321218953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34c30421-dccb-4f6b-a422-ff55e54cb1cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:17:47 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6ed0b57d-4617-432a-8a9f-8327f8c5ca21 tempest-AttachVolumeNegativeTest-1321218953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34c30421-dccb-4f6b-a422-ff55e54cb1cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:17:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1050576861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0c35141-27c2-4623-bc6c-6cb9791d3e88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f80705dfae64e8cbfd0e0cbeacc682e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:17:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:17:47Z,use_quota=True,user_id='decaea8fffd2452eb3b2bb1bd5eff95f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:17:47 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6ed0b57d-4617-432a-8a9f-8327f8c5ca21 tempest-AttachVolumeNegativeTest-1321218953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87435d43-933e-4a3c-9473-fb4a90f00c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:17:47 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6ed0b57d-4617-432a-8a9f-8327f8c5ca21 tempest-AttachVolumeNegativeTest-1321218953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87435d43-933e-4a3c-9473-fb4a90f00c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:17:47 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6ed0b57d-4617-432a-8a9f-8327f8c5ca21 tempest-AttachVolumeNegativeTest-1321218953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51a2818b-ff88-4d31-8823-27e7032e73fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:17:47 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6ed0b57d-4617-432a-8a9f-8327f8c5ca21 tempest-AttachVolumeNegativeTest-1321218953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51a2818b-ff88-4d31-8823-27e7032e73fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0c35141-27c2-4623-bc6c-6cb9791d3e88', 'volume_name': 'volume-a0c35141-27c2-4623-bc6c-6cb9791d3e88', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:17:47 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6ed0b57d-4617-432a-8a9f-8327f8c5ca21 tempest-AttachVolumeNegativeTest-1321218953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51d82c5f-91ae-403e-85b4-543b896ab490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:17:47 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6ed0b57d-4617-432a-8a9f-8327f8c5ca21 tempest-AttachVolumeNegativeTest-1321218953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51d82c5f-91ae-403e-85b4-543b896ab490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:17:47 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6ed0b57d-4617-432a-8a9f-8327f8c5ca21 tempest-AttachVolumeNegativeTest-1321218953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23620606-ccd4-4938-8e06-6d57a2012970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:17:47 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-6ed0b57d-4617-432a-8a9f-8327f8c5ca21 tempest-AttachVolumeNegativeTest-1321218953 None] Volume a0c35141-27c2-4623-bc6c-6cb9791d3e88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0c35141-27c2-4623-bc6c-6cb9791d3e88', 'volume_size': 1} Apr 29 15:17:47 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-6ed0b57d-4617-432a-8a9f-8327f8c5ca21 tempest-AttachVolumeNegativeTest-1321218953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:17:57 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:17:57 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:INSERT=1,cinder:SELECT=13,cinder:UPDATE=3 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:17:58 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-6c3c4c07-b6cf-4e82-b8ee-877ebeb497fe tempest-VolumesActionsTest-62398517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 28.651s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:17:58 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6c3c4c07-b6cf-4e82-b8ee-877ebeb497fe tempest-VolumesActionsTest-62398517 None] Uploaded volume to glance image-id: 188f4df5-e46b-4f80-91c4-73c3054b0a36. {{(pid=84448) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 29 15:17:58 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-39be88c2-cca8-421a-b91a-421f071281a0 req-c85514b1-6740-41d5-8508-d2e1869400bd tempest-ServerRescueNegativeTestJSON-1253271205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 17.501s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:17:58 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a3520fe-bbd1-4595-8116-43b81d4f5762]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:17:58 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-39be88c2-cca8-421a-b91a-421f071281a0 req-c85514b1-6740-41d5-8508-d2e1869400bd tempest-ServerRescueNegativeTestJSON-1253271205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1424d010-9a13-4fa3-ba2c-db4d43abfa10 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:17:58 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-6c3c4c07-b6cf-4e82-b8ee-877ebeb497fe tempest-VolumesActionsTest-62398517 None] Copy volume to image completed successfully. Apr 29 15:17:58 devstack sudo[99050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1424d010-9a13-4fa3-ba2c-db4d43abfa10 Apr 29 15:17:58 devstack sudo[99050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:17:58 devstack sudo[99050]: pam_unix(sudo:session): session closed for user root Apr 29 15:17:58 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-39be88c2-cca8-421a-b91a-421f071281a0 req-c85514b1-6740-41d5-8508-d2e1869400bd tempest-ServerRescueNegativeTestJSON-1253271205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1424d010-9a13-4fa3-ba2c-db4d43abfa10" returned: 0 in 0.762s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:17:58 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-39be88c2-cca8-421a-b91a-421f071281a0 req-c85514b1-6740-41d5-8508-d2e1869400bd tempest-ServerRescueNegativeTestJSON-1253271205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.781s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:17:58 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-6ed0b57d-4617-432a-8a9f-8327f8c5ca21 tempest-AttachVolumeNegativeTest-1321218953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.666s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:17:58 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-6ed0b57d-4617-432a-8a9f-8327f8c5ca21 tempest-AttachVolumeNegativeTest-1321218953 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:17:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1050576861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0c35141-27c2-4623-bc6c-6cb9791d3e88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f80705dfae64e8cbfd0e0cbeacc682e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:17:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:17:47Z,use_quota=True,user_id='decaea8fffd2452eb3b2bb1bd5eff95f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:17:58 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-6ed0b57d-4617-432a-8a9f-8327f8c5ca21 tempest-AttachVolumeNegativeTest-1321218953 None] Creating volume a0c35141-27c2-4623-bc6c-6cb9791d3e88 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:17:58 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-6ed0b57d-4617-432a-8a9f-8327f8c5ca21 tempest-AttachVolumeNegativeTest-1321218953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:17:58 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-6ed0b57d-4617-432a-8a9f-8327f8c5ca21 tempest-AttachVolumeNegativeTest-1321218953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:17:58 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-6ed0b57d-4617-432a-8a9f-8327f8c5ca21 tempest-AttachVolumeNegativeTest-1321218953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:17:58 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-6ed0b57d-4617-432a-8a9f-8327f8c5ca21 tempest-AttachVolumeNegativeTest-1321218953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:17:58 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-6ed0b57d-4617-432a-8a9f-8327f8c5ca21 tempest-AttachVolumeNegativeTest-1321218953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:17:58 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-6ed0b57d-4617-432a-8a9f-8327f8c5ca21 tempest-AttachVolumeNegativeTest-1321218953 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:17:58 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-6ed0b57d-4617-432a-8a9f-8327f8c5ca21 tempest-AttachVolumeNegativeTest-1321218953 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:17:58 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6ed0b57d-4617-432a-8a9f-8327f8c5ca21 tempest-AttachVolumeNegativeTest-1321218953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a0c35141-27c2-4623-bc6c-6cb9791d3e88 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:17:58 devstack sudo[99055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a0c35141-27c2-4623-bc6c-6cb9791d3e88 1073741824 Apr 29 15:17:58 devstack sudo[99055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:17:58 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-39be88c2-cca8-421a-b91a-421f071281a0 req-c85514b1-6740-41d5-8508-d2e1869400bd tempest-ServerRescueNegativeTestJSON-1253271205 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a', 'name': 'volume-1424d010-9a13-4fa3-ba2c-db4d43abfa10', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ebabfe63-ddc2-4f24-8eea-83438213f98a', 'enforce_multipath': True} {{(pid=84448) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 15:17:59 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-39be88c2-cca8-421a-b91a-421f071281a0 req-c85514b1-6740-41d5-8508-d2e1869400bd tempest-ServerRescueNegativeTestJSON-1253271205 None] attachment_update completed successfully. Apr 29 15:17:59 devstack sudo[99055]: pam_unix(sudo:session): session closed for user root Apr 29 15:17:59 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6ed0b57d-4617-432a-8a9f-8327f8c5ca21 tempest-AttachVolumeNegativeTest-1321218953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a0c35141-27c2-4623-bc6c-6cb9791d3e88 1073741824" returned: 0 in 0.882s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:17:59 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6ed0b57d-4617-432a-8a9f-8327f8c5ca21 tempest-AttachVolumeNegativeTest-1321218953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a0c35141-27c2-4623-bc6c-6cb9791d3e88 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:17:59 devstack sudo[99128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a0c35141-27c2-4623-bc6c-6cb9791d3e88 Apr 29 15:17:59 devstack sudo[99128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:17:59 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-98ac4d91-25eb-430e-b4b7-903712d21d0c tempest-VolumesActionsTest-62398517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:18:00 devstack sudo[99128]: pam_unix(sudo:session): session closed for user root Apr 29 15:18:00 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6ed0b57d-4617-432a-8a9f-8327f8c5ca21 tempest-AttachVolumeNegativeTest-1321218953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a0c35141-27c2-4623-bc6c-6cb9791d3e88" returned: 0 in 0.617s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:18:00 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-6ed0b57d-4617-432a-8a9f-8327f8c5ca21 tempest-AttachVolumeNegativeTest-1321218953 None] <== create_volume: return (1549ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:18:00 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-6ed0b57d-4617-432a-8a9f-8327f8c5ca21 tempest-AttachVolumeNegativeTest-1321218953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.551s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:18:00 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-98ac4d91-25eb-430e-b4b7-903712d21d0c tempest-VolumesActionsTest-62398517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.475s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:18:00 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6ed0b57d-4617-432a-8a9f-8327f8c5ca21 tempest-AttachVolumeNegativeTest-1321218953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23620606-ccd4-4938-8e06-6d57a2012970) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0c35141-27c2-4623-bc6c-6cb9791d3e88', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:18:00 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6ed0b57d-4617-432a-8a9f-8327f8c5ca21 tempest-AttachVolumeNegativeTest-1321218953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (026e264a-e0b8-430f-b9c9-8dfb25598e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:18:00 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff18282-864c-4875-b859-c92648910791]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:18:00 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-98ac4d91-25eb-430e-b4b7-903712d21d0c tempest-VolumesActionsTest-62398517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-acec608c-4bb1-43ad-b598-b33d0ce50938 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:18:00 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-6ed0b57d-4617-432a-8a9f-8327f8c5ca21 tempest-AttachVolumeNegativeTest-1321218953 None] Volume volume-a0c35141-27c2-4623-bc6c-6cb9791d3e88 (a0c35141-27c2-4623-bc6c-6cb9791d3e88): created successfully Apr 29 15:18:00 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6ed0b57d-4617-432a-8a9f-8327f8c5ca21 tempest-AttachVolumeNegativeTest-1321218953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (026e264a-e0b8-430f-b9c9-8dfb25598e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:18:00 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6ed0b57d-4617-432a-8a9f-8327f8c5ca21 tempest-AttachVolumeNegativeTest-1321218953 None] Flow 'volume_create_manager' (fc254be0-87a2-49f2-9457-ab0c37034a36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:18:00 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-6ed0b57d-4617-432a-8a9f-8327f8c5ca21 tempest-AttachVolumeNegativeTest-1321218953 None] Created volume successfully. Apr 29 15:18:00 devstack sudo[99446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-acec608c-4bb1-43ad-b598-b33d0ce50938 Apr 29 15:18:00 devstack sudo[99446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:18:01 devstack sudo[99446]: pam_unix(sudo:session): session closed for user root Apr 29 15:18:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-98ac4d91-25eb-430e-b4b7-903712d21d0c tempest-VolumesActionsTest-62398517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-acec608c-4bb1-43ad-b598-b33d0ce50938" returned: 0 in 0.751s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:18:01 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ec2f62-0c0e-4318-88fc-b53479ce0f11]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:18:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-98ac4d91-25eb-430e-b4b7-903712d21d0c tempest-VolumesActionsTest-62398517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-acec608c-4bb1-43ad-b598-b33d0ce50938 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:18:01 devstack sudo[99451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-acec608c-4bb1-43ad-b598-b33d0ce50938 Apr 29 15:18:01 devstack sudo[99451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:18:01 devstack sudo[99451]: pam_unix(sudo:session): session closed for user root Apr 29 15:18:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-98ac4d91-25eb-430e-b4b7-903712d21d0c tempest-VolumesActionsTest-62398517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-acec608c-4bb1-43ad-b598-b33d0ce50938" returned: 0 in 0.732s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:18:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-98ac4d91-25eb-430e-b4b7-903712d21d0c tempest-VolumesActionsTest-62398517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-acec608c-4bb1-43ad-b598-b33d0ce50938 /opt/stack/data/cinder/conversion/acec608c-4bb1-43ad-b598-b33d0ce50938.temp_image.1d4b7db0-26eb-4773-863c-3506c4d6a6bftkkpg25b.img {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:18:02 devstack sudo[99456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-acec608c-4bb1-43ad-b598-b33d0ce50938 /opt/stack/data/cinder/conversion/acec608c-4bb1-43ad-b598-b33d0ce50938.temp_image.1d4b7db0-26eb-4773-863c-3506c4d6a6bftkkpg25b.img Apr 29 15:18:02 devstack sudo[99456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:18:04 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-a26cbf06-a2e4-412c-9ff1-bce7d4923731 req-de834e0a-9359-464d-98a2-66848c754f4e tempest-AttachVolumeNegativeTest-1321218953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:18:07 devstack sudo[99456]: pam_unix(sudo:session): session closed for user root Apr 29 15:18:07 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-98ac4d91-25eb-430e-b4b7-903712d21d0c tempest-VolumesActionsTest-62398517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-acec608c-4bb1-43ad-b598-b33d0ce50938 /opt/stack/data/cinder/conversion/acec608c-4bb1-43ad-b598-b33d0ce50938.temp_image.1d4b7db0-26eb-4773-863c-3506c4d6a6bftkkpg25b.img" returned: 0 in 5.461s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:18:07 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a0efc15-0763-4df5-82aa-29de6a670e7e]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:18:07 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-98ac4d91-25eb-430e-b4b7-903712d21d0c tempest-VolumesActionsTest-62398517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-acec608c-4bb1-43ad-b598-b33d0ce50938 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:18:07 devstack sudo[99494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-acec608c-4bb1-43ad-b598-b33d0ce50938 Apr 29 15:18:07 devstack sudo[99494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:18:08 devstack sudo[99494]: pam_unix(sudo:session): session closed for user root Apr 29 15:18:08 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-98ac4d91-25eb-430e-b4b7-903712d21d0c tempest-VolumesActionsTest-62398517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-acec608c-4bb1-43ad-b598-b33d0ce50938" returned: 0 in 0.856s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:18:08 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [None req-98ac4d91-25eb-430e-b4b7-903712d21d0c tempest-VolumesActionsTest-62398517 None] Image conversion details: src /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-acec608c-4bb1-43ad-b598-b33d0ce50938, size 1024.00 MB, duration 5.46 sec, destination /opt/stack/data/cinder/conversion/acec608c-4bb1-43ad-b598-b33d0ce50938.temp_image.1d4b7db0-26eb-4773-863c-3506c4d6a6bftkkpg25b.img {{(pid=84448) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 15:18:08 devstack cinder-volume[84448]: INFO cinder.image.image_utils [None req-98ac4d91-25eb-430e-b4b7-903712d21d0c tempest-VolumesActionsTest-62398517 None] Converted 1024.00 MB image at 187.48 MB/s Apr 29 15:18:08 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [None req-98ac4d91-25eb-430e-b4b7-903712d21d0c tempest-VolumesActionsTest-62398517 None] 1d4b7db0-26eb-4773-863c-3506c4d6a6bf was raw, converting to qcow2 {{(pid=84448) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Apr 29 15:18:08 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[785d1dfb-e452-449c-9430-956989db7406]: (4, 'raw') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:18:08 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-98ac4d91-25eb-430e-b4b7-903712d21d0c tempest-VolumesActionsTest-62398517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/acec608c-4bb1-43ad-b598-b33d0ce50938.temp_image.1d4b7db0-26eb-4773-863c-3506c4d6a6bftkkpg25b.img {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:18:08 devstack sudo[99499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/acec608c-4bb1-43ad-b598-b33d0ce50938.temp_image.1d4b7db0-26eb-4773-863c-3506c4d6a6bftkkpg25b.img Apr 29 15:18:08 devstack sudo[99499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:18:09 devstack sudo[99499]: pam_unix(sudo:session): session closed for user root Apr 29 15:18:09 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-98ac4d91-25eb-430e-b4b7-903712d21d0c tempest-VolumesActionsTest-62398517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/acec608c-4bb1-43ad-b598-b33d0ce50938.temp_image.1d4b7db0-26eb-4773-863c-3506c4d6a6bftkkpg25b.img" returned: 0 in 0.823s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:18:09 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-98ac4d91-25eb-430e-b4b7-903712d21d0c tempest-VolumesActionsTest-62398517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/acec608c-4bb1-43ad-b598-b33d0ce50938.temp_image.1d4b7db0-26eb-4773-863c-3506c4d6a6bftkkpg25b.img {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:18:09 devstack sudo[99533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/acec608c-4bb1-43ad-b598-b33d0ce50938.temp_image.1d4b7db0-26eb-4773-863c-3506c4d6a6bftkkpg25b.img Apr 29 15:18:09 devstack sudo[99533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:18:09 devstack sudo[99533]: pam_unix(sudo:session): session closed for user root Apr 29 15:18:09 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-98ac4d91-25eb-430e-b4b7-903712d21d0c tempest-VolumesActionsTest-62398517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/acec608c-4bb1-43ad-b598-b33d0ce50938.temp_image.1d4b7db0-26eb-4773-863c-3506c4d6a6bftkkpg25b.img" returned: 1 in 0.722s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:18:09 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-98ac4d91-25eb-430e-b4b7-903712d21d0c tempest-VolumesActionsTest-62398517 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/acec608c-4bb1-43ad-b598-b33d0ce50938.temp_image.1d4b7db0-26eb-4773-863c-3506c4d6a6bftkkpg25b.img' failed. Not Retrying. {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 15:18:09 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-98ac4d91-25eb-430e-b4b7-903712d21d0c tempest-VolumesActionsTest-62398517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/acec608c-4bb1-43ad-b598-b33d0ce50938.temp_image.1d4b7db0-26eb-4773-863c-3506c4d6a6bftkkpg25b.img /opt/stack/data/cinder/conversion/vol_upload_i_ba8t84 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:18:09 devstack sudo[99539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/acec608c-4bb1-43ad-b598-b33d0ce50938.temp_image.1d4b7db0-26eb-4773-863c-3506c4d6a6bftkkpg25b.img /opt/stack/data/cinder/conversion/vol_upload_i_ba8t84 Apr 29 15:18:09 devstack sudo[99539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:18:10 devstack sudo[99539]: pam_unix(sudo:session): session closed for user root Apr 29 15:18:10 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-98ac4d91-25eb-430e-b4b7-903712d21d0c tempest-VolumesActionsTest-62398517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/acec608c-4bb1-43ad-b598-b33d0ce50938.temp_image.1d4b7db0-26eb-4773-863c-3506c4d6a6bftkkpg25b.img /opt/stack/data/cinder/conversion/vol_upload_i_ba8t84" returned: 0 in 0.621s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:18:10 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [None req-98ac4d91-25eb-430e-b4b7-903712d21d0c tempest-VolumesActionsTest-62398517 None] Image conversion details: src /opt/stack/data/cinder/conversion/acec608c-4bb1-43ad-b598-b33d0ce50938.temp_image.1d4b7db0-26eb-4773-863c-3506c4d6a6bftkkpg25b.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_i_ba8t84 {{(pid=84448) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 15:18:10 devstack cinder-volume[84448]: INFO cinder.image.image_utils [None req-98ac4d91-25eb-430e-b4b7-903712d21d0c tempest-VolumesActionsTest-62398517 None] Converted 1024.00 MB image at 1024.00 MB/s Apr 29 15:18:10 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae5b1d3a-1d60-4cb9-ad4f-450dc9c08907]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:18:10 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-98ac4d91-25eb-430e-b4b7-903712d21d0c tempest-VolumesActionsTest-62398517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_i_ba8t84 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:18:10 devstack sudo[99550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_i_ba8t84 Apr 29 15:18:10 devstack sudo[99550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:18:11 devstack sudo[99550]: pam_unix(sudo:session): session closed for user root Apr 29 15:18:11 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-98ac4d91-25eb-430e-b4b7-903712d21d0c tempest-VolumesActionsTest-62398517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_i_ba8t84" returned: 0 in 0.681s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:18:12 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-98ac4d91-25eb-430e-b4b7-903712d21d0c tempest-VolumesActionsTest-62398517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.327s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:18:12 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-98ac4d91-25eb-430e-b4b7-903712d21d0c tempest-VolumesActionsTest-62398517 None] Uploaded volume to glance image-id: 1d4b7db0-26eb-4773-863c-3506c4d6a6bf. {{(pid=84448) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 29 15:18:12 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-a26cbf06-a2e4-412c-9ff1-bce7d4923731 req-de834e0a-9359-464d-98a2-66848c754f4e tempest-AttachVolumeNegativeTest-1321218953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 8.138s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:18:12 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[40678697-f18a-477b-9126-10936506de81]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:18:12 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-a26cbf06-a2e4-412c-9ff1-bce7d4923731 req-de834e0a-9359-464d-98a2-66848c754f4e tempest-AttachVolumeNegativeTest-1321218953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a0c35141-27c2-4623-bc6c-6cb9791d3e88 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:18:12 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-98ac4d91-25eb-430e-b4b7-903712d21d0c tempest-VolumesActionsTest-62398517 None] Copy volume to image completed successfully. Apr 29 15:18:12 devstack sudo[99556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a0c35141-27c2-4623-bc6c-6cb9791d3e88 Apr 29 15:18:12 devstack sudo[99556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:18:13 devstack sudo[99556]: pam_unix(sudo:session): session closed for user root Apr 29 15:18:13 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-a26cbf06-a2e4-412c-9ff1-bce7d4923731 req-de834e0a-9359-464d-98a2-66848c754f4e tempest-AttachVolumeNegativeTest-1321218953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a0c35141-27c2-4623-bc6c-6cb9791d3e88" returned: 0 in 0.721s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:18:13 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-a26cbf06-a2e4-412c-9ff1-bce7d4923731 req-de834e0a-9359-464d-98a2-66848c754f4e tempest-AttachVolumeNegativeTest-1321218953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.747s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:18:13 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-a26cbf06-a2e4-412c-9ff1-bce7d4923731 req-de834e0a-9359-464d-98a2-66848c754f4e tempest-AttachVolumeNegativeTest-1321218953 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a', 'name': 'volume-a0c35141-27c2-4623-bc6c-6cb9791d3e88', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '82dc6c0f-ee3d-475d-be1a-6c765919cab4', 'enforce_multipath': True} {{(pid=84448) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 15:18:13 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-a26cbf06-a2e4-412c-9ff1-bce7d4923731 req-de834e0a-9359-464d-98a2-66848c754f4e tempest-AttachVolumeNegativeTest-1321218953 None] attachment_update completed successfully. Apr 29 15:18:14 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-1919e8d0-5b76-41f7-a06f-caa1faababf5 tempest-VolumesActionsTest-62398517 None] Acquiring lock "cinder-acec608c-4bb1-43ad-b598-b33d0ce50938-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:18:14 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-1919e8d0-5b76-41f7-a06f-caa1faababf5 tempest-VolumesActionsTest-62398517 None] Lock "cinder-acec608c-4bb1-43ad-b598-b33d0ce50938-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:18:14 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-1919e8d0-5b76-41f7-a06f-caa1faababf5 tempest-VolumesActionsTest-62398517 None] Acquiring lock "cinder-quobyte-acec608c-4bb1-43ad-b598-b33d0ce50938" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:18:14 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-1919e8d0-5b76-41f7-a06f-caa1faababf5 tempest-VolumesActionsTest-62398517 None] Lock "cinder-quobyte-acec608c-4bb1-43ad-b598-b33d0ce50938" acquired by "delete_volume" :: waited 0.048s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:18:14 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[f313ec97-ca0c-46ac-a911-e33e24cf2374]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:18:14 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1919e8d0-5b76-41f7-a06f-caa1faababf5 tempest-VolumesActionsTest-62398517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-acec608c-4bb1-43ad-b598-b33d0ce50938 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:18:14 devstack sudo[99585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-acec608c-4bb1-43ad-b598-b33d0ce50938 Apr 29 15:18:14 devstack sudo[99585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:18:15 devstack sudo[99585]: pam_unix(sudo:session): session closed for user root Apr 29 15:18:15 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1919e8d0-5b76-41f7-a06f-caa1faababf5 tempest-VolumesActionsTest-62398517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-acec608c-4bb1-43ad-b598-b33d0ce50938" returned: 0 in 0.885s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:18:15 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1919e8d0-5b76-41f7-a06f-caa1faababf5 tempest-VolumesActionsTest-62398517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-acec608c-4bb1-43ad-b598-b33d0ce50938 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:18:15 devstack sudo[99609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-acec608c-4bb1-43ad-b598-b33d0ce50938 Apr 29 15:18:15 devstack sudo[99609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:18:16 devstack sudo[99609]: pam_unix(sudo:session): session closed for user root Apr 29 15:18:16 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1919e8d0-5b76-41f7-a06f-caa1faababf5 tempest-VolumesActionsTest-62398517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-acec608c-4bb1-43ad-b598-b33d0ce50938" returned: 0 in 0.666s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:18:16 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-1919e8d0-5b76-41f7-a06f-caa1faababf5 tempest-VolumesActionsTest-62398517 None] Lock "cinder-quobyte-acec608c-4bb1-43ad-b598-b33d0ce50938" released by "delete_volume" :: held 1.628s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:18:16 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-1919e8d0-5b76-41f7-a06f-caa1faababf5 tempest-VolumesActionsTest-62398517 None] Created reservations ['1bcbcad0-a877-4161-99a6-408179acc715', '5abbdd8d-e5ee-4550-922a-b2cb44b33ed3', '25477fd0-c36b-4449-8e07-35bd28397cd6', '8e5cff63-5733-4aa8-82ed-c5cbd2c36964'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:18:16 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-1919e8d0-5b76-41f7-a06f-caa1faababf5 tempest-VolumesActionsTest-62398517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:18:16 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-1919e8d0-5b76-41f7-a06f-caa1faababf5 tempest-VolumesActionsTest-62398517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:18:16 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-1919e8d0-5b76-41f7-a06f-caa1faababf5 tempest-VolumesActionsTest-62398517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:18:16 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-1919e8d0-5b76-41f7-a06f-caa1faababf5 tempest-VolumesActionsTest-62398517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:18:16 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-1919e8d0-5b76-41f7-a06f-caa1faababf5 tempest-VolumesActionsTest-62398517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:18:16 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1919e8d0-5b76-41f7-a06f-caa1faababf5 tempest-VolumesActionsTest-62398517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:18:16 devstack sudo[99613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:18:16 devstack sudo[99613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:18:16 devstack sudo[99613]: pam_unix(sudo:session): session closed for user root Apr 29 15:18:16 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1919e8d0-5b76-41f7-a06f-caa1faababf5 tempest-VolumesActionsTest-62398517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.681s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:18:16 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-1919e8d0-5b76-41f7-a06f-caa1faababf5 tempest-VolumesActionsTest-62398517 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:18:16 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-1919e8d0-5b76-41f7-a06f-caa1faababf5 tempest-VolumesActionsTest-62398517 None] Deleted volume successfully. Apr 29 15:18:16 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-1919e8d0-5b76-41f7-a06f-caa1faababf5 tempest-VolumesActionsTest-62398517 None] Lock "cinder-acec608c-4bb1-43ad-b598-b33d0ce50938-delete_volume" released by "delete_volume" :: held 2.654s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:18:20 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-d137acaf-2d9c-44b8-b6b0-db6b49ddbc48 req-3ea7c86e-f4c3-4659-899a-782f6e7747ad tempest-AttachVolumeNegativeTest-1321218953 None] Terminate volume connection completed successfully. Apr 29 15:18:20 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-d137acaf-2d9c-44b8-b6b0-db6b49ddbc48 req-3ea7c86e-f4c3-4659-899a-782f6e7747ad tempest-AttachVolumeNegativeTest-1321218953 None] Deleting attachment 82dc6c0f-ee3d-475d-be1a-6c765919cab4. {{(pid=84448) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 15:18:25 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-85a1a8b6-344b-4e67-9f62-4c3a9ffb009b tempest-VolumesGetTest-1959119330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:18:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-85a1a8b6-344b-4e67-9f62-4c3a9ffb009b tempest-VolumesGetTest-1959119330 None] Flow 'volume_create_manager' (bbb6ae1c-27e8-4d77-89ff-acaddb4e8154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:18:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-85a1a8b6-344b-4e67-9f62-4c3a9ffb009b tempest-VolumesGetTest-1959119330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e33e715-1f60-4976-bd0e-30ac7017ad72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:18:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-85a1a8b6-344b-4e67-9f62-4c3a9ffb009b tempest-VolumesGetTest-1959119330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e33e715-1f60-4976-bd0e-30ac7017ad72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:18:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-970200926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd9ec199-4394-47df-9e6c-566dd55f35af,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f869a6d249654e13be76ee6a847e4481',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:18:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:18:25Z,use_quota=True,user_id='fbb2502dd9b544f5b144418f0bfe579a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:18:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-85a1a8b6-344b-4e67-9f62-4c3a9ffb009b tempest-VolumesGetTest-1959119330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (713eda1a-e2db-49aa-a008-c6dd84275af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:18:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-85a1a8b6-344b-4e67-9f62-4c3a9ffb009b tempest-VolumesGetTest-1959119330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (713eda1a-e2db-49aa-a008-c6dd84275af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:18:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-85a1a8b6-344b-4e67-9f62-4c3a9ffb009b tempest-VolumesGetTest-1959119330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0da8f02-52a2-496a-a76b-f540ded6fb7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:18:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-85a1a8b6-344b-4e67-9f62-4c3a9ffb009b tempest-VolumesGetTest-1959119330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0da8f02-52a2-496a-a76b-f540ded6fb7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd9ec199-4394-47df-9e6c-566dd55f35af', 'volume_name': 'volume-bd9ec199-4394-47df-9e6c-566dd55f35af', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:18:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-85a1a8b6-344b-4e67-9f62-4c3a9ffb009b tempest-VolumesGetTest-1959119330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36aceab9-c32f-48a4-ad40-eff45c3dca84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:18:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-85a1a8b6-344b-4e67-9f62-4c3a9ffb009b tempest-VolumesGetTest-1959119330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36aceab9-c32f-48a4-ad40-eff45c3dca84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:18:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-85a1a8b6-344b-4e67-9f62-4c3a9ffb009b tempest-VolumesGetTest-1959119330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87326d4a-79d3-4caa-858f-4fe32bc82c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:18:25 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-85a1a8b6-344b-4e67-9f62-4c3a9ffb009b tempest-VolumesGetTest-1959119330 None] Volume bd9ec199-4394-47df-9e6c-566dd55f35af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd9ec199-4394-47df-9e6c-566dd55f35af', 'volume_size': 1} Apr 29 15:18:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-85a1a8b6-344b-4e67-9f62-4c3a9ffb009b tempest-VolumesGetTest-1959119330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:18:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-85a1a8b6-344b-4e67-9f62-4c3a9ffb009b tempest-VolumesGetTest-1959119330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:18:25 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-85a1a8b6-344b-4e67-9f62-4c3a9ffb009b tempest-VolumesGetTest-1959119330 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:18:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-970200926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd9ec199-4394-47df-9e6c-566dd55f35af,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f869a6d249654e13be76ee6a847e4481',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:18:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:18:25Z,use_quota=True,user_id='fbb2502dd9b544f5b144418f0bfe579a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:18:25 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-85a1a8b6-344b-4e67-9f62-4c3a9ffb009b tempest-VolumesGetTest-1959119330 None] Creating volume bd9ec199-4394-47df-9e6c-566dd55f35af {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:18:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-85a1a8b6-344b-4e67-9f62-4c3a9ffb009b tempest-VolumesGetTest-1959119330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:18:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-85a1a8b6-344b-4e67-9f62-4c3a9ffb009b tempest-VolumesGetTest-1959119330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:18:25 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-85a1a8b6-344b-4e67-9f62-4c3a9ffb009b tempest-VolumesGetTest-1959119330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:18:25 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-85a1a8b6-344b-4e67-9f62-4c3a9ffb009b tempest-VolumesGetTest-1959119330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:18:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-85a1a8b6-344b-4e67-9f62-4c3a9ffb009b tempest-VolumesGetTest-1959119330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:18:25 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-85a1a8b6-344b-4e67-9f62-4c3a9ffb009b tempest-VolumesGetTest-1959119330 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:18:25 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-85a1a8b6-344b-4e67-9f62-4c3a9ffb009b tempest-VolumesGetTest-1959119330 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:18:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-85a1a8b6-344b-4e67-9f62-4c3a9ffb009b tempest-VolumesGetTest-1959119330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-bd9ec199-4394-47df-9e6c-566dd55f35af 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:18:25 devstack sudo[99747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-bd9ec199-4394-47df-9e6c-566dd55f35af 1073741824 Apr 29 15:18:25 devstack sudo[99747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:18:26 devstack sudo[99747]: pam_unix(sudo:session): session closed for user root Apr 29 15:18:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-85a1a8b6-344b-4e67-9f62-4c3a9ffb009b tempest-VolumesGetTest-1959119330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-bd9ec199-4394-47df-9e6c-566dd55f35af 1073741824" returned: 0 in 0.864s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:18:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-85a1a8b6-344b-4e67-9f62-4c3a9ffb009b tempest-VolumesGetTest-1959119330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-bd9ec199-4394-47df-9e6c-566dd55f35af {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:18:26 devstack sudo[99754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-bd9ec199-4394-47df-9e6c-566dd55f35af Apr 29 15:18:26 devstack sudo[99754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:18:26 devstack sudo[99754]: pam_unix(sudo:session): session closed for user root Apr 29 15:18:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-85a1a8b6-344b-4e67-9f62-4c3a9ffb009b tempest-VolumesGetTest-1959119330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-bd9ec199-4394-47df-9e6c-566dd55f35af" returned: 0 in 0.612s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:18:26 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-85a1a8b6-344b-4e67-9f62-4c3a9ffb009b tempest-VolumesGetTest-1959119330 None] <== create_volume: return (1527ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:18:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-85a1a8b6-344b-4e67-9f62-4c3a9ffb009b tempest-VolumesGetTest-1959119330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.529s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:18:26 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-85a1a8b6-344b-4e67-9f62-4c3a9ffb009b tempest-VolumesGetTest-1959119330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87326d4a-79d3-4caa-858f-4fe32bc82c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd9ec199-4394-47df-9e6c-566dd55f35af', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:18:26 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-85a1a8b6-344b-4e67-9f62-4c3a9ffb009b tempest-VolumesGetTest-1959119330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6274e3a6-0663-4ac1-960b-004dbf52b89e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:18:26 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-85a1a8b6-344b-4e67-9f62-4c3a9ffb009b tempest-VolumesGetTest-1959119330 None] Volume volume-bd9ec199-4394-47df-9e6c-566dd55f35af (bd9ec199-4394-47df-9e6c-566dd55f35af): created successfully Apr 29 15:18:26 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-85a1a8b6-344b-4e67-9f62-4c3a9ffb009b tempest-VolumesGetTest-1959119330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6274e3a6-0663-4ac1-960b-004dbf52b89e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:18:26 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-85a1a8b6-344b-4e67-9f62-4c3a9ffb009b tempest-VolumesGetTest-1959119330 None] Flow 'volume_create_manager' (bbb6ae1c-27e8-4d77-89ff-acaddb4e8154) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:18:26 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-85a1a8b6-344b-4e67-9f62-4c3a9ffb009b tempest-VolumesGetTest-1959119330 None] Created volume successfully. Apr 29 15:18:28 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bf25112-df3f-4e10-8d64-9ba8703c325c tempest-VolumesGetTest-1959119330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:18:28 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-2bf25112-df3f-4e10-8d64-9ba8703c325c tempest-VolumesGetTest-1959119330 None] Flow 'volume_create_manager' (6584eb9f-85ee-41c7-879d-eb9883018e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:18:28 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-2bf25112-df3f-4e10-8d64-9ba8703c325c tempest-VolumesGetTest-1959119330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67707da8-ef18-42cc-96f1-9f4380f80a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:18:28 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-2bf25112-df3f-4e10-8d64-9ba8703c325c tempest-VolumesGetTest-1959119330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67707da8-ef18-42cc-96f1-9f4380f80a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:18:28Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1658509749',display_name='tempest-VolumesGetTest-Volume-1458250804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48b9ce5c-1c64-4f26-bc9a-92b4eb7741ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f869a6d249654e13be76ee6a847e4481',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:18:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:18:28Z,use_quota=True,user_id='fbb2502dd9b544f5b144418f0bfe579a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:18:28 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-2bf25112-df3f-4e10-8d64-9ba8703c325c tempest-VolumesGetTest-1959119330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58ceb89c-2fa1-4d7e-bf36-75e8e9730a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:18:28 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-2bf25112-df3f-4e10-8d64-9ba8703c325c tempest-VolumesGetTest-1959119330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58ceb89c-2fa1-4d7e-bf36-75e8e9730a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:18:28 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-2bf25112-df3f-4e10-8d64-9ba8703c325c tempest-VolumesGetTest-1959119330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1fd2529-8ce3-4f39-aeb2-a3ca206c4c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:18:28 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-2bf25112-df3f-4e10-8d64-9ba8703c325c tempest-VolumesGetTest-1959119330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1fd2529-8ce3-4f39-aeb2-a3ca206c4c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48b9ce5c-1c64-4f26-bc9a-92b4eb7741ba', 'volume_name': 'volume-48b9ce5c-1c64-4f26-bc9a-92b4eb7741ba', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:18:28 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-2bf25112-df3f-4e10-8d64-9ba8703c325c tempest-VolumesGetTest-1959119330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83621f13-ae4c-4097-b8d1-c3d09ab44a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:18:28 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-2bf25112-df3f-4e10-8d64-9ba8703c325c tempest-VolumesGetTest-1959119330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83621f13-ae4c-4097-b8d1-c3d09ab44a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:18:28 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-2bf25112-df3f-4e10-8d64-9ba8703c325c tempest-VolumesGetTest-1959119330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59929f66-7faa-4516-9a03-d12b772e9e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:18:28 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-2bf25112-df3f-4e10-8d64-9ba8703c325c tempest-VolumesGetTest-1959119330 None] Volume 48b9ce5c-1c64-4f26-bc9a-92b4eb7741ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48b9ce5c-1c64-4f26-bc9a-92b4eb7741ba', 'volume_size': 1} Apr 29 15:18:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-2bf25112-df3f-4e10-8d64-9ba8703c325c tempest-VolumesGetTest-1959119330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:18:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-2bf25112-df3f-4e10-8d64-9ba8703c325c tempest-VolumesGetTest-1959119330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:18:28 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-2bf25112-df3f-4e10-8d64-9ba8703c325c tempest-VolumesGetTest-1959119330 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:18:28Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1658509749',display_name='tempest-VolumesGetTest-Volume-1458250804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48b9ce5c-1c64-4f26-bc9a-92b4eb7741ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f869a6d249654e13be76ee6a847e4481',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:18:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:18:28Z,use_quota=True,user_id='fbb2502dd9b544f5b144418f0bfe579a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:18:28 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-2bf25112-df3f-4e10-8d64-9ba8703c325c tempest-VolumesGetTest-1959119330 None] Creating volume 48b9ce5c-1c64-4f26-bc9a-92b4eb7741ba {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:18:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-2bf25112-df3f-4e10-8d64-9ba8703c325c tempest-VolumesGetTest-1959119330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:18:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-2bf25112-df3f-4e10-8d64-9ba8703c325c tempest-VolumesGetTest-1959119330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:18:28 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-2bf25112-df3f-4e10-8d64-9ba8703c325c tempest-VolumesGetTest-1959119330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:18:28 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-2bf25112-df3f-4e10-8d64-9ba8703c325c tempest-VolumesGetTest-1959119330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:18:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-2bf25112-df3f-4e10-8d64-9ba8703c325c tempest-VolumesGetTest-1959119330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:18:28 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-2bf25112-df3f-4e10-8d64-9ba8703c325c tempest-VolumesGetTest-1959119330 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:18:28 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-2bf25112-df3f-4e10-8d64-9ba8703c325c tempest-VolumesGetTest-1959119330 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:18:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-2bf25112-df3f-4e10-8d64-9ba8703c325c tempest-VolumesGetTest-1959119330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-48b9ce5c-1c64-4f26-bc9a-92b4eb7741ba 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:18:28 devstack sudo[99793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-48b9ce5c-1c64-4f26-bc9a-92b4eb7741ba 1073741824 Apr 29 15:18:28 devstack sudo[99793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:18:28 devstack sudo[99793]: pam_unix(sudo:session): session closed for user root Apr 29 15:18:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-2bf25112-df3f-4e10-8d64-9ba8703c325c tempest-VolumesGetTest-1959119330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-48b9ce5c-1c64-4f26-bc9a-92b4eb7741ba 1073741824" returned: 0 in 0.832s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:18:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-2bf25112-df3f-4e10-8d64-9ba8703c325c tempest-VolumesGetTest-1959119330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-48b9ce5c-1c64-4f26-bc9a-92b4eb7741ba {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:18:29 devstack sudo[99800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-48b9ce5c-1c64-4f26-bc9a-92b4eb7741ba Apr 29 15:18:29 devstack sudo[99800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:18:29 devstack sudo[99800]: pam_unix(sudo:session): session closed for user root Apr 29 15:18:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-2bf25112-df3f-4e10-8d64-9ba8703c325c tempest-VolumesGetTest-1959119330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-48b9ce5c-1c64-4f26-bc9a-92b4eb7741ba" returned: 0 in 0.615s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:18:29 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-2bf25112-df3f-4e10-8d64-9ba8703c325c tempest-VolumesGetTest-1959119330 None] <== create_volume: return (1487ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:18:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-2bf25112-df3f-4e10-8d64-9ba8703c325c tempest-VolumesGetTest-1959119330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.490s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:18:29 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-2bf25112-df3f-4e10-8d64-9ba8703c325c tempest-VolumesGetTest-1959119330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59929f66-7faa-4516-9a03-d12b772e9e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48b9ce5c-1c64-4f26-bc9a-92b4eb7741ba', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:18:29 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-2bf25112-df3f-4e10-8d64-9ba8703c325c tempest-VolumesGetTest-1959119330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eff1a2c8-b2b2-4a87-81d1-f17f8d348683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:18:29 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-2bf25112-df3f-4e10-8d64-9ba8703c325c tempest-VolumesGetTest-1959119330 None] Volume volume-48b9ce5c-1c64-4f26-bc9a-92b4eb7741ba (48b9ce5c-1c64-4f26-bc9a-92b4eb7741ba): created successfully Apr 29 15:18:29 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-2bf25112-df3f-4e10-8d64-9ba8703c325c tempest-VolumesGetTest-1959119330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eff1a2c8-b2b2-4a87-81d1-f17f8d348683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:18:29 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-2bf25112-df3f-4e10-8d64-9ba8703c325c tempest-VolumesGetTest-1959119330 None] Flow 'volume_create_manager' (6584eb9f-85ee-41c7-879d-eb9883018e7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:18:29 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-2bf25112-df3f-4e10-8d64-9ba8703c325c tempest-VolumesGetTest-1959119330 None] Created volume successfully. Apr 29 15:18:30 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-c09f59af-9581-4919-b7a9-aaac179a0a8d tempest-VolumesGetTest-1959119330 None] Acquiring lock "cinder-48b9ce5c-1c64-4f26-bc9a-92b4eb7741ba-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:18:30 devstack cinder-volume[84448]: DEBUG oslo_service.periodic_task [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84448) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 15:18:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:18:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:18:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:18:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:18:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:18:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:18:30 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-c09f59af-9581-4919-b7a9-aaac179a0a8d tempest-VolumesGetTest-1959119330 None] Lock "cinder-48b9ce5c-1c64-4f26-bc9a-92b4eb7741ba-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:18:30 devstack sudo[99816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:18:30 devstack sudo[99816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:18:30 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-c09f59af-9581-4919-b7a9-aaac179a0a8d tempest-VolumesGetTest-1959119330 None] Acquiring lock "cinder-quobyte-48b9ce5c-1c64-4f26-bc9a-92b4eb7741ba" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:18:30 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-c09f59af-9581-4919-b7a9-aaac179a0a8d tempest-VolumesGetTest-1959119330 None] Lock "cinder-quobyte-48b9ce5c-1c64-4f26-bc9a-92b4eb7741ba" acquired by "delete_volume" :: waited 0.023s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:18:30 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d6103d-027f-469c-a1fe-7357d21c92a0]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:18:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c09f59af-9581-4919-b7a9-aaac179a0a8d tempest-VolumesGetTest-1959119330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-48b9ce5c-1c64-4f26-bc9a-92b4eb7741ba {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:18:30 devstack sudo[99821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-48b9ce5c-1c64-4f26-bc9a-92b4eb7741ba Apr 29 15:18:30 devstack sudo[99821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:18:31 devstack sudo[99816]: pam_unix(sudo:session): session closed for user root Apr 29 15:18:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.826s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:18:31 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:18:31 devstack sudo[99821]: pam_unix(sudo:session): session closed for user root Apr 29 15:18:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c09f59af-9581-4919-b7a9-aaac179a0a8d tempest-VolumesGetTest-1959119330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-48b9ce5c-1c64-4f26-bc9a-92b4eb7741ba" returned: 0 in 0.920s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:18:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c09f59af-9581-4919-b7a9-aaac179a0a8d tempest-VolumesGetTest-1959119330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-48b9ce5c-1c64-4f26-bc9a-92b4eb7741ba {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:18:31 devstack sudo[99844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-48b9ce5c-1c64-4f26-bc9a-92b4eb7741ba Apr 29 15:18:31 devstack sudo[99844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:18:31 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-76c531ca-86c1-4e3b-a465-e47f6b5fdef2 tempest-AttachVolumeNegativeTest-1321218953 None] Acquiring lock "cinder-a0c35141-27c2-4623-bc6c-6cb9791d3e88-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:18:31 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-76c531ca-86c1-4e3b-a465-e47f6b5fdef2 tempest-AttachVolumeNegativeTest-1321218953 None] Lock "cinder-a0c35141-27c2-4623-bc6c-6cb9791d3e88-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:18:31 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-76c531ca-86c1-4e3b-a465-e47f6b5fdef2 tempest-AttachVolumeNegativeTest-1321218953 None] Acquiring lock "cinder-quobyte-a0c35141-27c2-4623-bc6c-6cb9791d3e88" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:18:31 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-76c531ca-86c1-4e3b-a465-e47f6b5fdef2 tempest-AttachVolumeNegativeTest-1321218953 None] Lock "cinder-quobyte-a0c35141-27c2-4623-bc6c-6cb9791d3e88" acquired by "delete_volume" :: waited 0.022s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:18:31 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf0d6762-9ba4-4598-919d-6593137d0a68]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:18:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-76c531ca-86c1-4e3b-a465-e47f6b5fdef2 tempest-AttachVolumeNegativeTest-1321218953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a0c35141-27c2-4623-bc6c-6cb9791d3e88 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:18:31 devstack sudo[99846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a0c35141-27c2-4623-bc6c-6cb9791d3e88 Apr 29 15:18:31 devstack sudo[99846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:18:32 devstack sudo[99844]: pam_unix(sudo:session): session closed for user root Apr 29 15:18:32 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c09f59af-9581-4919-b7a9-aaac179a0a8d tempest-VolumesGetTest-1959119330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-48b9ce5c-1c64-4f26-bc9a-92b4eb7741ba" returned: 0 in 0.677s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:18:32 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-c09f59af-9581-4919-b7a9-aaac179a0a8d tempest-VolumesGetTest-1959119330 None] Lock "cinder-quobyte-48b9ce5c-1c64-4f26-bc9a-92b4eb7741ba" released by "delete_volume" :: held 1.661s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:18:32 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-c09f59af-9581-4919-b7a9-aaac179a0a8d tempest-VolumesGetTest-1959119330 None] Created reservations ['6bfedf77-8379-4e2f-8a86-9c48de65d74b', 'a1103fc5-eb12-4501-9490-1bce8e38f3e2', '08419480-7d04-4d1f-9f38-36bb25263c64', 'b47d30a2-675b-4a50-82ce-33fededb403c'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:18:32 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-c09f59af-9581-4919-b7a9-aaac179a0a8d tempest-VolumesGetTest-1959119330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:18:32 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-c09f59af-9581-4919-b7a9-aaac179a0a8d tempest-VolumesGetTest-1959119330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:18:32 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-c09f59af-9581-4919-b7a9-aaac179a0a8d tempest-VolumesGetTest-1959119330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:18:32 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-c09f59af-9581-4919-b7a9-aaac179a0a8d tempest-VolumesGetTest-1959119330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:18:32 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-c09f59af-9581-4919-b7a9-aaac179a0a8d tempest-VolumesGetTest-1959119330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:18:32 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c09f59af-9581-4919-b7a9-aaac179a0a8d tempest-VolumesGetTest-1959119330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:18:32 devstack sudo[99850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:18:32 devstack sudo[99850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:18:32 devstack sudo[99846]: pam_unix(sudo:session): session closed for user root Apr 29 15:18:32 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-76c531ca-86c1-4e3b-a465-e47f6b5fdef2 tempest-AttachVolumeNegativeTest-1321218953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a0c35141-27c2-4623-bc6c-6cb9791d3e88" returned: 0 in 0.767s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:18:32 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-76c531ca-86c1-4e3b-a465-e47f6b5fdef2 tempest-AttachVolumeNegativeTest-1321218953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a0c35141-27c2-4623-bc6c-6cb9791d3e88 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:18:32 devstack sudo[99855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a0c35141-27c2-4623-bc6c-6cb9791d3e88 Apr 29 15:18:32 devstack sudo[99855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:18:32 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-7f285178-072e-4dcd-9b18-c2ff4ce73180 tempest-VolumesGetTest-1959119330 None] Acquiring lock "cinder-bd9ec199-4394-47df-9e6c-566dd55f35af-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:18:32 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-7f285178-072e-4dcd-9b18-c2ff4ce73180 tempest-VolumesGetTest-1959119330 None] Lock "cinder-bd9ec199-4394-47df-9e6c-566dd55f35af-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:18:32 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-7f285178-072e-4dcd-9b18-c2ff4ce73180 tempest-VolumesGetTest-1959119330 None] Acquiring lock "cinder-quobyte-bd9ec199-4394-47df-9e6c-566dd55f35af" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:18:32 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-7f285178-072e-4dcd-9b18-c2ff4ce73180 tempest-VolumesGetTest-1959119330 None] Lock "cinder-quobyte-bd9ec199-4394-47df-9e6c-566dd55f35af" acquired by "delete_volume" :: waited 0.019s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:18:32 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c810ed-54c6-48d5-8c14-6a21f054fe05]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:18:32 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7f285178-072e-4dcd-9b18-c2ff4ce73180 tempest-VolumesGetTest-1959119330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-bd9ec199-4394-47df-9e6c-566dd55f35af {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:18:32 devstack sudo[99850]: pam_unix(sudo:session): session closed for user root Apr 29 15:18:32 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c09f59af-9581-4919-b7a9-aaac179a0a8d tempest-VolumesGetTest-1959119330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.608s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:18:32 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-c09f59af-9581-4919-b7a9-aaac179a0a8d tempest-VolumesGetTest-1959119330 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:18:32 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-c09f59af-9581-4919-b7a9-aaac179a0a8d tempest-VolumesGetTest-1959119330 None] Deleted volume successfully. Apr 29 15:18:32 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-c09f59af-9581-4919-b7a9-aaac179a0a8d tempest-VolumesGetTest-1959119330 None] Lock "cinder-48b9ce5c-1c64-4f26-bc9a-92b4eb7741ba-delete_volume" released by "delete_volume" :: held 2.495s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:18:32 devstack sudo[99858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-bd9ec199-4394-47df-9e6c-566dd55f35af Apr 29 15:18:32 devstack sudo[99858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:18:33 devstack sudo[99855]: pam_unix(sudo:session): session closed for user root Apr 29 15:18:33 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-76c531ca-86c1-4e3b-a465-e47f6b5fdef2 tempest-AttachVolumeNegativeTest-1321218953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a0c35141-27c2-4623-bc6c-6cb9791d3e88" returned: 0 in 0.634s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:18:33 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-76c531ca-86c1-4e3b-a465-e47f6b5fdef2 tempest-AttachVolumeNegativeTest-1321218953 None] Lock "cinder-quobyte-a0c35141-27c2-4623-bc6c-6cb9791d3e88" released by "delete_volume" :: held 1.460s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:18:33 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-76c531ca-86c1-4e3b-a465-e47f6b5fdef2 tempest-AttachVolumeNegativeTest-1321218953 None] Created reservations ['c0f936f5-8c7b-4c1a-8bcd-e2156de3d2c2', '9c6a3eb3-d4cc-4a21-8ab7-3b99a629acf6', 'a5296d0d-0396-4a4c-80f5-e94af2939d5b', '5acccd51-c266-43a2-80a2-2523b8e4d6a3'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:18:33 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-76c531ca-86c1-4e3b-a465-e47f6b5fdef2 tempest-AttachVolumeNegativeTest-1321218953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:18:33 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-76c531ca-86c1-4e3b-a465-e47f6b5fdef2 tempest-AttachVolumeNegativeTest-1321218953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:18:33 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-76c531ca-86c1-4e3b-a465-e47f6b5fdef2 tempest-AttachVolumeNegativeTest-1321218953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:18:33 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-76c531ca-86c1-4e3b-a465-e47f6b5fdef2 tempest-AttachVolumeNegativeTest-1321218953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:18:33 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-76c531ca-86c1-4e3b-a465-e47f6b5fdef2 tempest-AttachVolumeNegativeTest-1321218953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:18:33 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-76c531ca-86c1-4e3b-a465-e47f6b5fdef2 tempest-AttachVolumeNegativeTest-1321218953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:18:33 devstack sudo[99861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:18:33 devstack sudo[99861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:18:33 devstack sudo[99858]: pam_unix(sudo:session): session closed for user root Apr 29 15:18:33 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7f285178-072e-4dcd-9b18-c2ff4ce73180 tempest-VolumesGetTest-1959119330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-bd9ec199-4394-47df-9e6c-566dd55f35af" returned: 0 in 0.762s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:18:33 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7f285178-072e-4dcd-9b18-c2ff4ce73180 tempest-VolumesGetTest-1959119330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-bd9ec199-4394-47df-9e6c-566dd55f35af {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:18:33 devstack sudo[99866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-bd9ec199-4394-47df-9e6c-566dd55f35af Apr 29 15:18:33 devstack sudo[99866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:18:33 devstack sudo[99861]: pam_unix(sudo:session): session closed for user root Apr 29 15:18:33 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-76c531ca-86c1-4e3b-a465-e47f6b5fdef2 tempest-AttachVolumeNegativeTest-1321218953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.653s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:18:33 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-76c531ca-86c1-4e3b-a465-e47f6b5fdef2 tempest-AttachVolumeNegativeTest-1321218953 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:18:33 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-76c531ca-86c1-4e3b-a465-e47f6b5fdef2 tempest-AttachVolumeNegativeTest-1321218953 None] Deleted volume successfully. Apr 29 15:18:33 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-7ad94b7c-b9c9-43be-8dda-8e4df797feb2 tempest-AttachVolumeNegativeTest-1321218953 None] Acquiring lock "cinder-8bd506d1-26e8-4cfd-9ab8-6c62e7ae2581-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:18:33 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-7ad94b7c-b9c9-43be-8dda-8e4df797feb2 tempest-AttachVolumeNegativeTest-1321218953 None] Lock "cinder-8bd506d1-26e8-4cfd-9ab8-6c62e7ae2581-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:18:33 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-76c531ca-86c1-4e3b-a465-e47f6b5fdef2 tempest-AttachVolumeNegativeTest-1321218953 None] Lock "cinder-a0c35141-27c2-4623-bc6c-6cb9791d3e88-delete_volume" released by "delete_volume" :: held 2.376s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:18:33 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-7ad94b7c-b9c9-43be-8dda-8e4df797feb2 tempest-AttachVolumeNegativeTest-1321218953 None] Acquiring lock "cinder-quobyte-8bd506d1-26e8-4cfd-9ab8-6c62e7ae2581" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:18:33 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-7ad94b7c-b9c9-43be-8dda-8e4df797feb2 tempest-AttachVolumeNegativeTest-1321218953 None] Lock "cinder-quobyte-8bd506d1-26e8-4cfd-9ab8-6c62e7ae2581" acquired by "delete_volume" :: waited 0.018s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:18:34 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[601a6ad3-ba14-4d1f-b2e5-0004f37ee104]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:18:34 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7ad94b7c-b9c9-43be-8dda-8e4df797feb2 tempest-AttachVolumeNegativeTest-1321218953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-8bd506d1-26e8-4cfd-9ab8-6c62e7ae2581 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:18:34 devstack sudo[99869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-8bd506d1-26e8-4cfd-9ab8-6c62e7ae2581 Apr 29 15:18:34 devstack sudo[99869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:18:34 devstack sudo[99866]: pam_unix(sudo:session): session closed for user root Apr 29 15:18:34 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7f285178-072e-4dcd-9b18-c2ff4ce73180 tempest-VolumesGetTest-1959119330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-bd9ec199-4394-47df-9e6c-566dd55f35af" returned: 0 in 0.651s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:18:34 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-7f285178-072e-4dcd-9b18-c2ff4ce73180 tempest-VolumesGetTest-1959119330 None] Lock "cinder-quobyte-bd9ec199-4394-47df-9e6c-566dd55f35af" released by "delete_volume" :: held 1.455s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:18:34 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-7f285178-072e-4dcd-9b18-c2ff4ce73180 tempest-VolumesGetTest-1959119330 None] Created reservations ['2dd3f246-92fa-4267-821d-04e54d37ae06', '7299f8c5-ec06-41b0-9b1e-6d4def8b7676', '13371f61-e437-4273-a45e-819cbaa67aa4', 'cd5bf8df-b4f5-4c1f-a1dc-e522752afbff'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:18:34 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-7f285178-072e-4dcd-9b18-c2ff4ce73180 tempest-VolumesGetTest-1959119330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:18:34 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-7f285178-072e-4dcd-9b18-c2ff4ce73180 tempest-VolumesGetTest-1959119330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:18:34 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-7f285178-072e-4dcd-9b18-c2ff4ce73180 tempest-VolumesGetTest-1959119330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:18:34 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-7f285178-072e-4dcd-9b18-c2ff4ce73180 tempest-VolumesGetTest-1959119330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:18:34 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-7f285178-072e-4dcd-9b18-c2ff4ce73180 tempest-VolumesGetTest-1959119330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:18:34 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7f285178-072e-4dcd-9b18-c2ff4ce73180 tempest-VolumesGetTest-1959119330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:18:34 devstack sudo[99872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:18:34 devstack sudo[99872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:18:34 devstack sudo[99869]: pam_unix(sudo:session): session closed for user root Apr 29 15:18:34 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7ad94b7c-b9c9-43be-8dda-8e4df797feb2 tempest-AttachVolumeNegativeTest-1321218953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-8bd506d1-26e8-4cfd-9ab8-6c62e7ae2581" returned: 0 in 0.743s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:18:34 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7ad94b7c-b9c9-43be-8dda-8e4df797feb2 tempest-AttachVolumeNegativeTest-1321218953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-8bd506d1-26e8-4cfd-9ab8-6c62e7ae2581 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:18:34 devstack sudo[99877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-8bd506d1-26e8-4cfd-9ab8-6c62e7ae2581 Apr 29 15:18:34 devstack sudo[99877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:18:34 devstack sudo[99872]: pam_unix(sudo:session): session closed for user root Apr 29 15:18:34 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7f285178-072e-4dcd-9b18-c2ff4ce73180 tempest-VolumesGetTest-1959119330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.622s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:18:34 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-7f285178-072e-4dcd-9b18-c2ff4ce73180 tempest-VolumesGetTest-1959119330 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:18:34 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-7f285178-072e-4dcd-9b18-c2ff4ce73180 tempest-VolumesGetTest-1959119330 None] Deleted volume successfully. Apr 29 15:18:35 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-7f285178-072e-4dcd-9b18-c2ff4ce73180 tempest-VolumesGetTest-1959119330 None] Lock "cinder-bd9ec199-4394-47df-9e6c-566dd55f35af-delete_volume" released by "delete_volume" :: held 2.311s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:18:35 devstack sudo[99877]: pam_unix(sudo:session): session closed for user root Apr 29 15:18:35 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7ad94b7c-b9c9-43be-8dda-8e4df797feb2 tempest-AttachVolumeNegativeTest-1321218953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-8bd506d1-26e8-4cfd-9ab8-6c62e7ae2581" returned: 0 in 0.606s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:18:35 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd5666c2-125d-4319-a545-8eee581b8d3e tempest-VolumesGetTest-1959119330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:18:35 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-dd5666c2-125d-4319-a545-8eee581b8d3e tempest-VolumesGetTest-1959119330 None] Flow 'volume_create_manager' (8fd72345-45ad-4963-bb74-524af0d018ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:18:35 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-dd5666c2-125d-4319-a545-8eee581b8d3e tempest-VolumesGetTest-1959119330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d07c8366-82c2-4a98-93f2-10c66ecc4a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:18:35 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-7ad94b7c-b9c9-43be-8dda-8e4df797feb2 tempest-AttachVolumeNegativeTest-1321218953 None] Lock "cinder-quobyte-8bd506d1-26e8-4cfd-9ab8-6c62e7ae2581" released by "delete_volume" :: held 1.427s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:18:35 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-dd5666c2-125d-4319-a545-8eee581b8d3e tempest-VolumesGetTest-1959119330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d07c8366-82c2-4a98-93f2-10c66ecc4a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:18:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1040020881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=051744c7-9bb8-4a89-abb8-20c0464e0d10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f869a6d249654e13be76ee6a847e4481',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:18:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:18:35Z,use_quota=True,user_id='fbb2502dd9b544f5b144418f0bfe579a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:18:35 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-dd5666c2-125d-4319-a545-8eee581b8d3e tempest-VolumesGetTest-1959119330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fe20cb4-3dcc-4722-8712-a5eeb61539c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:18:35 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-dd5666c2-125d-4319-a545-8eee581b8d3e tempest-VolumesGetTest-1959119330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fe20cb4-3dcc-4722-8712-a5eeb61539c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:18:35 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-dd5666c2-125d-4319-a545-8eee581b8d3e tempest-VolumesGetTest-1959119330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42760ced-4714-4bba-8bf3-55314dd0a24b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:18:35 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-dd5666c2-125d-4319-a545-8eee581b8d3e tempest-VolumesGetTest-1959119330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42760ced-4714-4bba-8bf3-55314dd0a24b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '051744c7-9bb8-4a89-abb8-20c0464e0d10', 'volume_name': 'volume-051744c7-9bb8-4a89-abb8-20c0464e0d10', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:18:35 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-dd5666c2-125d-4319-a545-8eee581b8d3e tempest-VolumesGetTest-1959119330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6c67662-2382-4d0d-969c-950b1b6f1c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:18:35 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-dd5666c2-125d-4319-a545-8eee581b8d3e tempest-VolumesGetTest-1959119330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6c67662-2382-4d0d-969c-950b1b6f1c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:18:35 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-dd5666c2-125d-4319-a545-8eee581b8d3e tempest-VolumesGetTest-1959119330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b6e7d3b-d450-4059-990c-1ba2a0431291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:18:35 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-dd5666c2-125d-4319-a545-8eee581b8d3e tempest-VolumesGetTest-1959119330 None] Volume 051744c7-9bb8-4a89-abb8-20c0464e0d10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-051744c7-9bb8-4a89-abb8-20c0464e0d10', 'volume_size': 1} Apr 29 15:18:35 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-dd5666c2-125d-4319-a545-8eee581b8d3e tempest-VolumesGetTest-1959119330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:18:35 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-dd5666c2-125d-4319-a545-8eee581b8d3e tempest-VolumesGetTest-1959119330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:18:35 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-dd5666c2-125d-4319-a545-8eee581b8d3e tempest-VolumesGetTest-1959119330 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:18:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1040020881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=051744c7-9bb8-4a89-abb8-20c0464e0d10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f869a6d249654e13be76ee6a847e4481',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:18:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:18:35Z,use_quota=True,user_id='fbb2502dd9b544f5b144418f0bfe579a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:18:35 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-dd5666c2-125d-4319-a545-8eee581b8d3e tempest-VolumesGetTest-1959119330 None] Creating volume 051744c7-9bb8-4a89-abb8-20c0464e0d10 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:18:35 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-dd5666c2-125d-4319-a545-8eee581b8d3e tempest-VolumesGetTest-1959119330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:18:35 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-dd5666c2-125d-4319-a545-8eee581b8d3e tempest-VolumesGetTest-1959119330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:18:35 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-dd5666c2-125d-4319-a545-8eee581b8d3e tempest-VolumesGetTest-1959119330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:18:35 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-dd5666c2-125d-4319-a545-8eee581b8d3e tempest-VolumesGetTest-1959119330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:18:35 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-dd5666c2-125d-4319-a545-8eee581b8d3e tempest-VolumesGetTest-1959119330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:18:35 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-dd5666c2-125d-4319-a545-8eee581b8d3e tempest-VolumesGetTest-1959119330 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:18:35 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-dd5666c2-125d-4319-a545-8eee581b8d3e tempest-VolumesGetTest-1959119330 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:18:35 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-dd5666c2-125d-4319-a545-8eee581b8d3e tempest-VolumesGetTest-1959119330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-051744c7-9bb8-4a89-abb8-20c0464e0d10 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:18:35 devstack sudo[99882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-051744c7-9bb8-4a89-abb8-20c0464e0d10 1073741824 Apr 29 15:18:35 devstack sudo[99882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:18:35 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-7ad94b7c-b9c9-43be-8dda-8e4df797feb2 tempest-AttachVolumeNegativeTest-1321218953 None] Created reservations ['6c54f5af-b836-445f-ad17-cc6708e505d5', '816e4cfc-aa41-4c3b-8072-4eea1eca6721', '25d9bf94-0422-44a5-bd5d-dc5ece5d2b68', '4a993bc1-8a22-4a44-a0e2-b0692b78211d'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:18:35 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-7ad94b7c-b9c9-43be-8dda-8e4df797feb2 tempest-AttachVolumeNegativeTest-1321218953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:18:35 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-7ad94b7c-b9c9-43be-8dda-8e4df797feb2 tempest-AttachVolumeNegativeTest-1321218953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:18:35 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-7ad94b7c-b9c9-43be-8dda-8e4df797feb2 tempest-AttachVolumeNegativeTest-1321218953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:18:35 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-7ad94b7c-b9c9-43be-8dda-8e4df797feb2 tempest-AttachVolumeNegativeTest-1321218953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:18:35 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-7ad94b7c-b9c9-43be-8dda-8e4df797feb2 tempest-AttachVolumeNegativeTest-1321218953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:18:35 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7ad94b7c-b9c9-43be-8dda-8e4df797feb2 tempest-AttachVolumeNegativeTest-1321218953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:18:35 devstack sudo[99884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:18:35 devstack sudo[99884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:18:36 devstack sudo[99884]: pam_unix(sudo:session): session closed for user root Apr 29 15:18:36 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7ad94b7c-b9c9-43be-8dda-8e4df797feb2 tempest-AttachVolumeNegativeTest-1321218953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.648s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:18:36 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-7ad94b7c-b9c9-43be-8dda-8e4df797feb2 tempest-AttachVolumeNegativeTest-1321218953 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:18:36 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-7ad94b7c-b9c9-43be-8dda-8e4df797feb2 tempest-AttachVolumeNegativeTest-1321218953 None] Deleted volume successfully. Apr 29 15:18:36 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-7ad94b7c-b9c9-43be-8dda-8e4df797feb2 tempest-AttachVolumeNegativeTest-1321218953 None] Lock "cinder-8bd506d1-26e8-4cfd-9ab8-6c62e7ae2581-delete_volume" released by "delete_volume" :: held 2.332s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:18:36 devstack sudo[99882]: pam_unix(sudo:session): session closed for user root Apr 29 15:18:36 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-dd5666c2-125d-4319-a545-8eee581b8d3e tempest-VolumesGetTest-1959119330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-051744c7-9bb8-4a89-abb8-20c0464e0d10 1073741824" returned: 0 in 0.865s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:18:36 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-9a11f926-510c-49fd-9323-d5859a166f56 tempest-AttachVolumeNegativeTest-1321218953 None] Acquiring lock "cinder-1ce1ca81-ef62-438c-9740-f002c0a6fda3-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:18:36 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-dd5666c2-125d-4319-a545-8eee581b8d3e tempest-VolumesGetTest-1959119330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-051744c7-9bb8-4a89-abb8-20c0464e0d10 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:18:36 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-9a11f926-510c-49fd-9323-d5859a166f56 tempest-AttachVolumeNegativeTest-1321218953 None] Lock "cinder-1ce1ca81-ef62-438c-9740-f002c0a6fda3-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:18:36 devstack sudo[99890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-051744c7-9bb8-4a89-abb8-20c0464e0d10 Apr 29 15:18:36 devstack sudo[99890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:18:36 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-9a11f926-510c-49fd-9323-d5859a166f56 tempest-AttachVolumeNegativeTest-1321218953 None] Acquiring lock "cinder-quobyte-1ce1ca81-ef62-438c-9740-f002c0a6fda3" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:18:36 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-9a11f926-510c-49fd-9323-d5859a166f56 tempest-AttachVolumeNegativeTest-1321218953 None] Lock "cinder-quobyte-1ce1ca81-ef62-438c-9740-f002c0a6fda3" acquired by "delete_volume" :: waited 0.015s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:18:36 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a3d22bb-1132-47b9-aa17-4532cbcb9007]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:18:36 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-9a11f926-510c-49fd-9323-d5859a166f56 tempest-AttachVolumeNegativeTest-1321218953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1ce1ca81-ef62-438c-9740-f002c0a6fda3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:18:36 devstack sudo[99892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1ce1ca81-ef62-438c-9740-f002c0a6fda3 Apr 29 15:18:36 devstack sudo[99892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:18:36 devstack sudo[99890]: pam_unix(sudo:session): session closed for user root Apr 29 15:18:36 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-dd5666c2-125d-4319-a545-8eee581b8d3e tempest-VolumesGetTest-1959119330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-051744c7-9bb8-4a89-abb8-20c0464e0d10" returned: 0 in 0.624s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:18:37 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-dd5666c2-125d-4319-a545-8eee581b8d3e tempest-VolumesGetTest-1959119330 None] <== create_volume: return (1543ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:18:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-dd5666c2-125d-4319-a545-8eee581b8d3e tempest-VolumesGetTest-1959119330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.546s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:18:37 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-dd5666c2-125d-4319-a545-8eee581b8d3e tempest-VolumesGetTest-1959119330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b6e7d3b-d450-4059-990c-1ba2a0431291) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-051744c7-9bb8-4a89-abb8-20c0464e0d10', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:18:37 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-dd5666c2-125d-4319-a545-8eee581b8d3e tempest-VolumesGetTest-1959119330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96305452-fb99-4334-9e30-af837988aad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:18:37 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-dd5666c2-125d-4319-a545-8eee581b8d3e tempest-VolumesGetTest-1959119330 None] Volume volume-051744c7-9bb8-4a89-abb8-20c0464e0d10 (051744c7-9bb8-4a89-abb8-20c0464e0d10): created successfully Apr 29 15:18:37 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-dd5666c2-125d-4319-a545-8eee581b8d3e tempest-VolumesGetTest-1959119330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96305452-fb99-4334-9e30-af837988aad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:18:37 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-dd5666c2-125d-4319-a545-8eee581b8d3e tempest-VolumesGetTest-1959119330 None] Flow 'volume_create_manager' (8fd72345-45ad-4963-bb74-524af0d018ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:18:37 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-dd5666c2-125d-4319-a545-8eee581b8d3e tempest-VolumesGetTest-1959119330 None] Created volume successfully. Apr 29 15:18:37 devstack sudo[99892]: pam_unix(sudo:session): session closed for user root Apr 29 15:18:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-9a11f926-510c-49fd-9323-d5859a166f56 tempest-AttachVolumeNegativeTest-1321218953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1ce1ca81-ef62-438c-9740-f002c0a6fda3" returned: 0 in 0.756s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:18:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-9a11f926-510c-49fd-9323-d5859a166f56 tempest-AttachVolumeNegativeTest-1321218953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1ce1ca81-ef62-438c-9740-f002c0a6fda3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:18:37 devstack sudo[99898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1ce1ca81-ef62-438c-9740-f002c0a6fda3 Apr 29 15:18:37 devstack sudo[99898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:18:37 devstack sudo[99898]: pam_unix(sudo:session): session closed for user root Apr 29 15:18:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-9a11f926-510c-49fd-9323-d5859a166f56 tempest-AttachVolumeNegativeTest-1321218953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1ce1ca81-ef62-438c-9740-f002c0a6fda3" returned: 0 in 0.603s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:18:37 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-9a11f926-510c-49fd-9323-d5859a166f56 tempest-AttachVolumeNegativeTest-1321218953 None] Lock "cinder-quobyte-1ce1ca81-ef62-438c-9740-f002c0a6fda3" released by "delete_volume" :: held 1.408s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:18:37 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-9a11f926-510c-49fd-9323-d5859a166f56 tempest-AttachVolumeNegativeTest-1321218953 None] Created reservations ['5cec4721-a5cf-4a5d-ae84-ca1b56e08d27', 'f4d0ac64-189b-4fe5-898e-d1685dced558', '7e006263-3d0e-4b22-a84c-27bcc5a379ad', '3f5f8459-51bb-43ef-b828-180aede32b80'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:18:37 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee8c0645-13b9-43f2-9ea5-fa05b066d99d tempest-VolumesGetTest-1959119330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:18:37 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-ee8c0645-13b9-43f2-9ea5-fa05b066d99d tempest-VolumesGetTest-1959119330 None] Flow 'volume_create_manager' (a324e40c-b3f8-444b-b09f-ffe08daf80d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:18:37 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-ee8c0645-13b9-43f2-9ea5-fa05b066d99d tempest-VolumesGetTest-1959119330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (605abdf2-9aee-4fcc-8caa-3cf2a8f8706f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:18:37 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-ee8c0645-13b9-43f2-9ea5-fa05b066d99d tempest-VolumesGetTest-1959119330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (605abdf2-9aee-4fcc-8caa-3cf2a8f8706f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:18:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-50684853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2aa4114-ee33-4b1e-b9eb-68a0da587a72,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f869a6d249654e13be76ee6a847e4481',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:18:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=051744c7-9bb8-4a89-abb8-20c0464e0d10,status='creating',terminated_at=None,updated_at=2026-04-29T13:18:38Z,use_quota=True,user_id='fbb2502dd9b544f5b144418f0bfe579a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:18:37 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-ee8c0645-13b9-43f2-9ea5-fa05b066d99d tempest-VolumesGetTest-1959119330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a59c808c-6682-4972-8daa-3942dd6bb648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:18:37 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-ee8c0645-13b9-43f2-9ea5-fa05b066d99d tempest-VolumesGetTest-1959119330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a59c808c-6682-4972-8daa-3942dd6bb648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:18:37 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-ee8c0645-13b9-43f2-9ea5-fa05b066d99d tempest-VolumesGetTest-1959119330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ab58577-308f-48a0-804d-848120bb2e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:18:38 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-ee8c0645-13b9-43f2-9ea5-fa05b066d99d tempest-VolumesGetTest-1959119330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ab58577-308f-48a0-804d-848120bb2e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'd2aa4114-ee33-4b1e-b9eb-68a0da587a72', 'volume_name': 'volume-d2aa4114-ee33-4b1e-b9eb-68a0da587a72', 'volume_size': 1, 'source_volid': '051744c7-9bb8-4a89-abb8-20c0464e0d10', 'source_volstatus': 'available'}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:18:38 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-ee8c0645-13b9-43f2-9ea5-fa05b066d99d tempest-VolumesGetTest-1959119330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb410360-d672-4360-a6bb-0d1633899680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:18:38 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-ee8c0645-13b9-43f2-9ea5-fa05b066d99d tempest-VolumesGetTest-1959119330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb410360-d672-4360-a6bb-0d1633899680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:18:38 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-ee8c0645-13b9-43f2-9ea5-fa05b066d99d tempest-VolumesGetTest-1959119330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02252020-c2b9-42ab-8ad9-26423c2486aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:18:38 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-ee8c0645-13b9-43f2-9ea5-fa05b066d99d tempest-VolumesGetTest-1959119330 None] Volume d2aa4114-ee33-4b1e-b9eb-68a0da587a72: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-d2aa4114-ee33-4b1e-b9eb-68a0da587a72', 'volume_size': 1, 'source_volid': '051744c7-9bb8-4a89-abb8-20c0464e0d10', 'source_volstatus': 'available'} Apr 29 15:18:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-ee8c0645-13b9-43f2-9ea5-fa05b066d99d tempest-VolumesGetTest-1959119330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:18:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-ee8c0645-13b9-43f2-9ea5-fa05b066d99d tempest-VolumesGetTest-1959119330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:18:38 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-ee8c0645-13b9-43f2-9ea5-fa05b066d99d tempest-VolumesGetTest-1959119330 None] Cloning volume 051744c7-9bb8-4a89-abb8-20c0464e0d10 to volume d2aa4114-ee33-4b1e-b9eb-68a0da587a72 Apr 29 15:18:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-9a11f926-510c-49fd-9323-d5859a166f56 tempest-AttachVolumeNegativeTest-1321218953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:18:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-9a11f926-510c-49fd-9323-d5859a166f56 tempest-AttachVolumeNegativeTest-1321218953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:18:38 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-9a11f926-510c-49fd-9323-d5859a166f56 tempest-AttachVolumeNegativeTest-1321218953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:18:38 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-9a11f926-510c-49fd-9323-d5859a166f56 tempest-AttachVolumeNegativeTest-1321218953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:18:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-9a11f926-510c-49fd-9323-d5859a166f56 tempest-AttachVolumeNegativeTest-1321218953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:18:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-9a11f926-510c-49fd-9323-d5859a166f56 tempest-AttachVolumeNegativeTest-1321218953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:18:38 devstack sudo[99901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:18:38 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-ee8c0645-13b9-43f2-9ea5-fa05b066d99d tempest-VolumesGetTest-1959119330 None] Creating offline snapshot 972570bb-9ba1-4f3f-93c3-d46606b99e4f of volume 051744c7-9bb8-4a89-abb8-20c0464e0d10 {{(pid=84448) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 15:18:38 devstack sudo[99901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:18:38 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c24a4c9-d0bc-4132-9b56-94737e3e1ee8]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:18:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ee8c0645-13b9-43f2-9ea5-fa05b066d99d tempest-VolumesGetTest-1959119330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-051744c7-9bb8-4a89-abb8-20c0464e0d10 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:18:38 devstack sudo[99903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-051744c7-9bb8-4a89-abb8-20c0464e0d10 Apr 29 15:18:38 devstack sudo[99903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:18:38 devstack sudo[99901]: pam_unix(sudo:session): session closed for user root Apr 29 15:18:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-9a11f926-510c-49fd-9323-d5859a166f56 tempest-AttachVolumeNegativeTest-1321218953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.701s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:18:38 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-9a11f926-510c-49fd-9323-d5859a166f56 tempest-AttachVolumeNegativeTest-1321218953 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:18:38 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-9a11f926-510c-49fd-9323-d5859a166f56 tempest-AttachVolumeNegativeTest-1321218953 None] Deleted volume successfully. Apr 29 15:18:38 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-9a11f926-510c-49fd-9323-d5859a166f56 tempest-AttachVolumeNegativeTest-1321218953 None] Lock "cinder-1ce1ca81-ef62-438c-9740-f002c0a6fda3-delete_volume" released by "delete_volume" :: held 2.439s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:18:38 devstack sudo[99903]: pam_unix(sudo:session): session closed for user root Apr 29 15:18:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ee8c0645-13b9-43f2-9ea5-fa05b066d99d tempest-VolumesGetTest-1959119330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-051744c7-9bb8-4a89-abb8-20c0464e0d10" returned: 0 in 0.834s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:18:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ee8c0645-13b9-43f2-9ea5-fa05b066d99d tempest-VolumesGetTest-1959119330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-051744c7-9bb8-4a89-abb8-20c0464e0d10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-051744c7-9bb8-4a89-abb8-20c0464e0d10.972570bb-9ba1-4f3f-93c3-d46606b99e4f 1G {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:18:39 devstack sudo[99909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-051744c7-9bb8-4a89-abb8-20c0464e0d10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-051744c7-9bb8-4a89-abb8-20c0464e0d10.972570bb-9ba1-4f3f-93c3-d46606b99e4f 1G Apr 29 15:18:39 devstack sudo[99909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:18:39 devstack sudo[99909]: pam_unix(sudo:session): session closed for user root Apr 29 15:18:39 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ee8c0645-13b9-43f2-9ea5-fa05b066d99d tempest-VolumesGetTest-1959119330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-051744c7-9bb8-4a89-abb8-20c0464e0d10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-051744c7-9bb8-4a89-abb8-20c0464e0d10.972570bb-9ba1-4f3f-93c3-d46606b99e4f 1G" returned: 0 in 0.860s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:18:39 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ee8c0645-13b9-43f2-9ea5-fa05b066d99d tempest-VolumesGetTest-1959119330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-051744c7-9bb8-4a89-abb8-20c0464e0d10 -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-051744c7-9bb8-4a89-abb8-20c0464e0d10.972570bb-9ba1-4f3f-93c3-d46606b99e4f {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:18:39 devstack sudo[99915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-051744c7-9bb8-4a89-abb8-20c0464e0d10 -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-051744c7-9bb8-4a89-abb8-20c0464e0d10.972570bb-9ba1-4f3f-93c3-d46606b99e4f Apr 29 15:18:39 devstack sudo[99915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:18:40 devstack sudo[99915]: pam_unix(sudo:session): session closed for user root Apr 29 15:18:40 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ee8c0645-13b9-43f2-9ea5-fa05b066d99d tempest-VolumesGetTest-1959119330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-051744c7-9bb8-4a89-abb8-20c0464e0d10 -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-051744c7-9bb8-4a89-abb8-20c0464e0d10.972570bb-9ba1-4f3f-93c3-d46606b99e4f" returned: 0 in 0.698s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:18:40 devstack cinder-volume[84448]: WARNING cinder.volume.drivers.remotefs [None req-ee8c0645-13b9-43f2-9ea5-fa05b066d99d tempest-VolumesGetTest-1959119330 None] /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-051744c7-9bb8-4a89-abb8-20c0464e0d10.972570bb-9ba1-4f3f-93c3-d46606b99e4f is being set with open permissions: ugo+rw Apr 29 15:18:40 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ee8c0645-13b9-43f2-9ea5-fa05b066d99d tempest-VolumesGetTest-1959119330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-051744c7-9bb8-4a89-abb8-20c0464e0d10.972570bb-9ba1-4f3f-93c3-d46606b99e4f {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:18:40 devstack sudo[99921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-051744c7-9bb8-4a89-abb8-20c0464e0d10.972570bb-9ba1-4f3f-93c3-d46606b99e4f Apr 29 15:18:40 devstack sudo[99921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:18:41 devstack sudo[99921]: pam_unix(sudo:session): session closed for user root Apr 29 15:18:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ee8c0645-13b9-43f2-9ea5-fa05b066d99d tempest-VolumesGetTest-1959119330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-051744c7-9bb8-4a89-abb8-20c0464e0d10.972570bb-9ba1-4f3f-93c3-d46606b99e4f" returned: 0 in 0.613s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:18:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ee8c0645-13b9-43f2-9ea5-fa05b066d99d tempest-VolumesGetTest-1959119330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-051744c7-9bb8-4a89-abb8-20c0464e0d10.info {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:18:41 devstack sudo[99924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-051744c7-9bb8-4a89-abb8-20c0464e0d10.info Apr 29 15:18:41 devstack sudo[99924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:18:41 devstack sudo[99924]: pam_unix(sudo:session): session closed for user root Apr 29 15:18:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ee8c0645-13b9-43f2-9ea5-fa05b066d99d tempest-VolumesGetTest-1959119330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-051744c7-9bb8-4a89-abb8-20c0464e0d10.info" returned: 0 in 0.679s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:18:41 devstack cinder-volume[84448]: WARNING cinder.volume.drivers.remotefs [None req-ee8c0645-13b9-43f2-9ea5-fa05b066d99d tempest-VolumesGetTest-1959119330 None] /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-051744c7-9bb8-4a89-abb8-20c0464e0d10.info is being set with open permissions: ugo+rw Apr 29 15:18:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ee8c0645-13b9-43f2-9ea5-fa05b066d99d tempest-VolumesGetTest-1959119330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-051744c7-9bb8-4a89-abb8-20c0464e0d10.info {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:18:41 devstack sudo[99927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-051744c7-9bb8-4a89-abb8-20c0464e0d10.info Apr 29 15:18:41 devstack sudo[99927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:18:42 devstack sudo[99927]: pam_unix(sudo:session): session closed for user root Apr 29 15:18:42 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ee8c0645-13b9-43f2-9ea5-fa05b066d99d tempest-VolumesGetTest-1959119330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-051744c7-9bb8-4a89-abb8-20c0464e0d10.info" returned: 0 in 0.677s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:18:42 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-ee8c0645-13b9-43f2-9ea5-fa05b066d99d tempest-VolumesGetTest-1959119330 None] Acquiring lock "cinder-quobyte-d2aa4114-ee33-4b1e-b9eb-68a0da587a72" by "_copy_volume_from_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:18:42 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-ee8c0645-13b9-43f2-9ea5-fa05b066d99d tempest-VolumesGetTest-1959119330 None] Lock "cinder-quobyte-d2aa4114-ee33-4b1e-b9eb-68a0da587a72" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:18:42 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-ee8c0645-13b9-43f2-9ea5-fa05b066d99d tempest-VolumesGetTest-1959119330 None] snapshot: 972570bb-9ba1-4f3f-93c3-d46606b99e4f, volume: d2aa4114-ee33-4b1e-b9eb-68a0da587a72, {{(pid=84448) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 15:18:42 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-ee8c0645-13b9-43f2-9ea5-fa05b066d99d tempest-VolumesGetTest-1959119330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:18:42 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-ee8c0645-13b9-43f2-9ea5-fa05b066d99d tempest-VolumesGetTest-1959119330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:18:42 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-ee8c0645-13b9-43f2-9ea5-fa05b066d99d tempest-VolumesGetTest-1959119330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:18:42 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-ee8c0645-13b9-43f2-9ea5-fa05b066d99d tempest-VolumesGetTest-1959119330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:18:42 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-ee8c0645-13b9-43f2-9ea5-fa05b066d99d tempest-VolumesGetTest-1959119330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:18:42 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c5a1428-ffa2-4145-a85b-bbb3f39f782b]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:18:42 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ee8c0645-13b9-43f2-9ea5-fa05b066d99d tempest-VolumesGetTest-1959119330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-051744c7-9bb8-4a89-abb8-20c0464e0d10.972570bb-9ba1-4f3f-93c3-d46606b99e4f {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:18:42 devstack sudo[99933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-051744c7-9bb8-4a89-abb8-20c0464e0d10.972570bb-9ba1-4f3f-93c3-d46606b99e4f Apr 29 15:18:42 devstack sudo[99933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:18:43 devstack sudo[99933]: pam_unix(sudo:session): session closed for user root Apr 29 15:18:43 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ee8c0645-13b9-43f2-9ea5-fa05b066d99d tempest-VolumesGetTest-1959119330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-051744c7-9bb8-4a89-abb8-20c0464e0d10.972570bb-9ba1-4f3f-93c3-d46606b99e4f" returned: 0 in 0.843s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:18:43 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-ee8c0645-13b9-43f2-9ea5-fa05b066d99d tempest-VolumesGetTest-1959119330 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-051744c7-9bb8-4a89-abb8-20c0464e0d10(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84448) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 15:18:43 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-ee8c0645-13b9-43f2-9ea5-fa05b066d99d tempest-VolumesGetTest-1959119330 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-051744c7-9bb8-4a89-abb8-20c0464e0d10 {{(pid=84448) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 15:18:43 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-ee8c0645-13b9-43f2-9ea5-fa05b066d99d tempest-VolumesGetTest-1959119330 None] Creating direct copy from snapshot {{(pid=84448) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 15:18:43 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ca81f5-5d53-4d5e-b4a9-91eb9626eb15]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:18:43 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ee8c0645-13b9-43f2-9ea5-fa05b066d99d tempest-VolumesGetTest-1959119330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-051744c7-9bb8-4a89-abb8-20c0464e0d10 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:18:43 devstack sudo[99939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-051744c7-9bb8-4a89-abb8-20c0464e0d10 Apr 29 15:18:43 devstack sudo[99939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:18:44 devstack sudo[99939]: pam_unix(sudo:session): session closed for user root Apr 29 15:18:44 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ee8c0645-13b9-43f2-9ea5-fa05b066d99d tempest-VolumesGetTest-1959119330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-051744c7-9bb8-4a89-abb8-20c0464e0d10" returned: 0 in 0.736s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:18:44 devstack cinder-volume[84448]: DEBUG cinder.utils [None req-ee8c0645-13b9-43f2-9ea5-fa05b066d99d tempest-VolumesGetTest-1959119330 None] Path /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d2aa4114-ee33-4b1e-b9eb-68a0da587a72 not found in is_blk_device check {{(pid=84448) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 15:18:44 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ee8c0645-13b9-43f2-9ea5-fa05b066d99d tempest-VolumesGetTest-1959119330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-051744c7-9bb8-4a89-abb8-20c0464e0d10 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d2aa4114-ee33-4b1e-b9eb-68a0da587a72 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:18:44 devstack sudo[99944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-051744c7-9bb8-4a89-abb8-20c0464e0d10 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d2aa4114-ee33-4b1e-b9eb-68a0da587a72 Apr 29 15:18:44 devstack sudo[99944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:18:46 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-d178da4a-03a0-4097-bdb8-2cd812c65796 tempest-GroupSnapshotsTest-1515970109 None] Group tempest-GroupSnapshotsTest-Group-370415686: creating Apr 29 15:18:46 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-d178da4a-03a0-4097-bdb8-2cd812c65796 tempest-GroupSnapshotsTest-1515970109 None] Group tempest-GroupSnapshotsTest-Group-370415686: created successfully Apr 29 15:18:46 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-d178da4a-03a0-4097-bdb8-2cd812c65796 tempest-GroupSnapshotsTest-1515970109 None] Create group completed successfully. Apr 29 15:18:49 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-9747f9f3-74b5-4fcb-b23a-93252f648216 tempest-GroupSnapshotsTest-1515970109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:18:49 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-9747f9f3-74b5-4fcb-b23a-93252f648216 tempest-GroupSnapshotsTest-1515970109 None] Flow 'volume_create_manager' (7ea8b538-d52f-400b-83b3-1ad5c16995aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:18:49 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-9747f9f3-74b5-4fcb-b23a-93252f648216 tempest-GroupSnapshotsTest-1515970109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88f39623-ac93-4fa4-840b-e3a5a67bf04a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:18:49 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-9747f9f3-74b5-4fcb-b23a-93252f648216 tempest-GroupSnapshotsTest-1515970109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88f39623-ac93-4fa4-840b-e3a5a67bf04a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:18:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-734132550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=faac508b-de78-4a66-94c6-58479e70da35,host='devstack@QuobyteHD#QuobyteHD',id=cb328395-ebed-4da9-9b09-6e2979a309b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='148ea8123ca04d2bb37f71e331e6b6cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:18:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:18:49Z,use_quota=True,user_id='4f519a26b0c0480ebe4f6ff33fc56fd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a5488e-33d4-42c5-9b20-ff74bdaaee02),volume_type_id=79a5488e-33d4-42c5-9b20-ff74bdaaee02)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:18:49 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-9747f9f3-74b5-4fcb-b23a-93252f648216 tempest-GroupSnapshotsTest-1515970109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e8d4d38-1047-4be7-851d-173ce544f4ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:18:49 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-9747f9f3-74b5-4fcb-b23a-93252f648216 tempest-GroupSnapshotsTest-1515970109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e8d4d38-1047-4be7-851d-173ce544f4ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:18:49 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-9747f9f3-74b5-4fcb-b23a-93252f648216 tempest-GroupSnapshotsTest-1515970109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4a455fe-d9b4-4ed7-9e98-cffbee8ffec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:18:49 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-9747f9f3-74b5-4fcb-b23a-93252f648216 tempest-GroupSnapshotsTest-1515970109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4a455fe-d9b4-4ed7-9e98-cffbee8ffec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb328395-ebed-4da9-9b09-6e2979a309b4', 'volume_name': 'volume-cb328395-ebed-4da9-9b09-6e2979a309b4', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:18:49 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-9747f9f3-74b5-4fcb-b23a-93252f648216 tempest-GroupSnapshotsTest-1515970109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11cedda0-b8db-4f9a-aac2-51eb69cb11a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:18:49 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-9747f9f3-74b5-4fcb-b23a-93252f648216 tempest-GroupSnapshotsTest-1515970109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11cedda0-b8db-4f9a-aac2-51eb69cb11a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:18:49 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-9747f9f3-74b5-4fcb-b23a-93252f648216 tempest-GroupSnapshotsTest-1515970109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e788e48-8079-4f52-a23d-59e2ab326779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:18:49 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-9747f9f3-74b5-4fcb-b23a-93252f648216 tempest-GroupSnapshotsTest-1515970109 None] Volume cb328395-ebed-4da9-9b09-6e2979a309b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb328395-ebed-4da9-9b09-6e2979a309b4', 'volume_size': 1} Apr 29 15:18:49 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-9747f9f3-74b5-4fcb-b23a-93252f648216 tempest-GroupSnapshotsTest-1515970109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:18:49 devstack sudo[99944]: pam_unix(sudo:session): session closed for user root Apr 29 15:18:49 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ee8c0645-13b9-43f2-9ea5-fa05b066d99d tempest-VolumesGetTest-1959119330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-051744c7-9bb8-4a89-abb8-20c0464e0d10 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d2aa4114-ee33-4b1e-b9eb-68a0da587a72" returned: 0 in 5.469s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:18:49 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f017ee-b96f-4ac2-9b1a-be22a917afef]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:18:49 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ee8c0645-13b9-43f2-9ea5-fa05b066d99d tempest-VolumesGetTest-1959119330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-051744c7-9bb8-4a89-abb8-20c0464e0d10 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:18:49 devstack sudo[99958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-051744c7-9bb8-4a89-abb8-20c0464e0d10 Apr 29 15:18:49 devstack sudo[99958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:18:50 devstack sudo[99958]: pam_unix(sudo:session): session closed for user root Apr 29 15:18:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ee8c0645-13b9-43f2-9ea5-fa05b066d99d tempest-VolumesGetTest-1959119330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-051744c7-9bb8-4a89-abb8-20c0464e0d10" returned: 0 in 0.872s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:18:50 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [None req-ee8c0645-13b9-43f2-9ea5-fa05b066d99d tempest-VolumesGetTest-1959119330 None] Image conversion details: src /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-051744c7-9bb8-4a89-abb8-20c0464e0d10, size 1024.00 MB, duration 5.47 sec, destination /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d2aa4114-ee33-4b1e-b9eb-68a0da587a72 {{(pid=84448) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 15:18:50 devstack cinder-volume[84448]: INFO cinder.image.image_utils [None req-ee8c0645-13b9-43f2-9ea5-fa05b066d99d tempest-VolumesGetTest-1959119330 None] Converted 1024.00 MB image at 187.20 MB/s Apr 29 15:18:50 devstack cinder-volume[84448]: WARNING cinder.volume.drivers.remotefs [None req-ee8c0645-13b9-43f2-9ea5-fa05b066d99d tempest-VolumesGetTest-1959119330 None] /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d2aa4114-ee33-4b1e-b9eb-68a0da587a72 is being set with open permissions: ugo+rw Apr 29 15:18:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ee8c0645-13b9-43f2-9ea5-fa05b066d99d tempest-VolumesGetTest-1959119330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d2aa4114-ee33-4b1e-b9eb-68a0da587a72 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:18:50 devstack sudo[99963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d2aa4114-ee33-4b1e-b9eb-68a0da587a72 Apr 29 15:18:50 devstack sudo[99963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:18:51 devstack sudo[99963]: pam_unix(sudo:session): session closed for user root Apr 29 15:18:51 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ee8c0645-13b9-43f2-9ea5-fa05b066d99d tempest-VolumesGetTest-1959119330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d2aa4114-ee33-4b1e-b9eb-68a0da587a72" returned: 0 in 0.598s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:18:51 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-ee8c0645-13b9-43f2-9ea5-fa05b066d99d tempest-VolumesGetTest-1959119330 None] Lock "cinder-quobyte-d2aa4114-ee33-4b1e-b9eb-68a0da587a72" released by "_copy_volume_from_snapshot" :: held 8.607s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:18:51 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-ee8c0645-13b9-43f2-9ea5-fa05b066d99d tempest-VolumesGetTest-1959119330 None] Acquiring lock "cinder-quobyte-972570bb-9ba1-4f3f-93c3-d46606b99e4f" by "_delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:18:51 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-ee8c0645-13b9-43f2-9ea5-fa05b066d99d tempest-VolumesGetTest-1959119330 None] Lock "cinder-quobyte-972570bb-9ba1-4f3f-93c3-d46606b99e4f" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:18:51 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-ee8c0645-13b9-43f2-9ea5-fa05b066d99d tempest-VolumesGetTest-1959119330 None] Deleting offline snapshot 972570bb-9ba1-4f3f-93c3-d46606b99e4f of volume 051744c7-9bb8-4a89-abb8-20c0464e0d10 {{(pid=84448) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 15:18:51 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-ee8c0645-13b9-43f2-9ea5-fa05b066d99d tempest-VolumesGetTest-1959119330 None] snapshot_file for this snap is: volume-051744c7-9bb8-4a89-abb8-20c0464e0d10.972570bb-9ba1-4f3f-93c3-d46606b99e4f {{(pid=84448) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 15:18:51 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b9bcc4f-72fc-47e9-a7ef-edcc4601d8e8]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:18:51 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ee8c0645-13b9-43f2-9ea5-fa05b066d99d tempest-VolumesGetTest-1959119330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-051744c7-9bb8-4a89-abb8-20c0464e0d10.972570bb-9ba1-4f3f-93c3-d46606b99e4f {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:18:51 devstack sudo[99966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-051744c7-9bb8-4a89-abb8-20c0464e0d10.972570bb-9ba1-4f3f-93c3-d46606b99e4f Apr 29 15:18:51 devstack sudo[99966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:18:51 devstack sudo[99966]: pam_unix(sudo:session): session closed for user root Apr 29 15:18:51 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ee8c0645-13b9-43f2-9ea5-fa05b066d99d tempest-VolumesGetTest-1959119330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-051744c7-9bb8-4a89-abb8-20c0464e0d10.972570bb-9ba1-4f3f-93c3-d46606b99e4f" returned: 0 in 0.701s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:18:51 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-ee8c0645-13b9-43f2-9ea5-fa05b066d99d tempest-VolumesGetTest-1959119330 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-051744c7-9bb8-4a89-abb8-20c0464e0d10(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84448) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 15:18:51 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b92002-6b8f-47d3-9973-7af15b70d8f5]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:18:51 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ee8c0645-13b9-43f2-9ea5-fa05b066d99d tempest-VolumesGetTest-1959119330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-051744c7-9bb8-4a89-abb8-20c0464e0d10 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:18:52 devstack sudo[99971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-051744c7-9bb8-4a89-abb8-20c0464e0d10 Apr 29 15:18:52 devstack sudo[99971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:18:52 devstack sudo[99971]: pam_unix(sudo:session): session closed for user root Apr 29 15:18:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ee8c0645-13b9-43f2-9ea5-fa05b066d99d tempest-VolumesGetTest-1959119330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-051744c7-9bb8-4a89-abb8-20c0464e0d10" returned: 0 in 0.676s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:18:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ee8c0645-13b9-43f2-9ea5-fa05b066d99d tempest-VolumesGetTest-1959119330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-051744c7-9bb8-4a89-abb8-20c0464e0d10.972570bb-9ba1-4f3f-93c3-d46606b99e4f {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:18:52 devstack sudo[99976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-051744c7-9bb8-4a89-abb8-20c0464e0d10.972570bb-9ba1-4f3f-93c3-d46606b99e4f Apr 29 15:18:52 devstack sudo[99976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:18:53 devstack sudo[99976]: pam_unix(sudo:session): session closed for user root Apr 29 15:18:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ee8c0645-13b9-43f2-9ea5-fa05b066d99d tempest-VolumesGetTest-1959119330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-051744c7-9bb8-4a89-abb8-20c0464e0d10.972570bb-9ba1-4f3f-93c3-d46606b99e4f" returned: 0 in 0.656s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:18:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ee8c0645-13b9-43f2-9ea5-fa05b066d99d tempest-VolumesGetTest-1959119330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-051744c7-9bb8-4a89-abb8-20c0464e0d10.972570bb-9ba1-4f3f-93c3-d46606b99e4f {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:18:53 devstack sudo[99981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-051744c7-9bb8-4a89-abb8-20c0464e0d10.972570bb-9ba1-4f3f-93c3-d46606b99e4f Apr 29 15:18:53 devstack sudo[99981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:18:53 devstack sudo[99981]: pam_unix(sudo:session): session closed for user root Apr 29 15:18:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ee8c0645-13b9-43f2-9ea5-fa05b066d99d tempest-VolumesGetTest-1959119330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-051744c7-9bb8-4a89-abb8-20c0464e0d10.972570bb-9ba1-4f3f-93c3-d46606b99e4f" returned: 0 in 0.576s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:18:53 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-ee8c0645-13b9-43f2-9ea5-fa05b066d99d tempest-VolumesGetTest-1959119330 None] Lock "cinder-quobyte-972570bb-9ba1-4f3f-93c3-d46606b99e4f" released by "_delete_snapshot" :: held 2.697s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:18:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-ee8c0645-13b9-43f2-9ea5-fa05b066d99d tempest-VolumesGetTest-1959119330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.903s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:18:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-9747f9f3-74b5-4fcb-b23a-93252f648216 tempest-GroupSnapshotsTest-1515970109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.761s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:18:53 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-9747f9f3-74b5-4fcb-b23a-93252f648216 tempest-GroupSnapshotsTest-1515970109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=faac508b-de78-4a66-94c6-58479e70da35,created_at=2026-04-29T13:18:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-734132550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=faac508b-de78-4a66-94c6-58479e70da35,host='devstack@QuobyteHD#QuobyteHD',id=cb328395-ebed-4da9-9b09-6e2979a309b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='148ea8123ca04d2bb37f71e331e6b6cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:18:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:18:49Z,use_quota=True,user_id='4f519a26b0c0480ebe4f6ff33fc56fd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a5488e-33d4-42c5-9b20-ff74bdaaee02),volume_type_id=79a5488e-33d4-42c5-9b20-ff74bdaaee02)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:18:53 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-9747f9f3-74b5-4fcb-b23a-93252f648216 tempest-GroupSnapshotsTest-1515970109 None] Creating volume cb328395-ebed-4da9-9b09-6e2979a309b4 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:18:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-9747f9f3-74b5-4fcb-b23a-93252f648216 tempest-GroupSnapshotsTest-1515970109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:18:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-9747f9f3-74b5-4fcb-b23a-93252f648216 tempest-GroupSnapshotsTest-1515970109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:18:53 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-9747f9f3-74b5-4fcb-b23a-93252f648216 tempest-GroupSnapshotsTest-1515970109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:18:53 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-9747f9f3-74b5-4fcb-b23a-93252f648216 tempest-GroupSnapshotsTest-1515970109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:18:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-9747f9f3-74b5-4fcb-b23a-93252f648216 tempest-GroupSnapshotsTest-1515970109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:18:53 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-9747f9f3-74b5-4fcb-b23a-93252f648216 tempest-GroupSnapshotsTest-1515970109 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:18:53 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-9747f9f3-74b5-4fcb-b23a-93252f648216 tempest-GroupSnapshotsTest-1515970109 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:18:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-9747f9f3-74b5-4fcb-b23a-93252f648216 tempest-GroupSnapshotsTest-1515970109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cb328395-ebed-4da9-9b09-6e2979a309b4 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:18:53 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-ee8c0645-13b9-43f2-9ea5-fa05b066d99d tempest-VolumesGetTest-1959119330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02252020-c2b9-42ab-8ad9-26423c2486aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2aa4114-ee33-4b1e-b9eb-68a0da587a72', 'volume_size': 1, 'source_volid': '051744c7-9bb8-4a89-abb8-20c0464e0d10', 'source_volstatus': 'available'}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:18:53 devstack sudo[99984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cb328395-ebed-4da9-9b09-6e2979a309b4 1073741824 Apr 29 15:18:53 devstack sudo[99984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:18:53 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-ee8c0645-13b9-43f2-9ea5-fa05b066d99d tempest-VolumesGetTest-1959119330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0205dcb2-4a61-4aa9-a9e4-4cde70dde7f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:18:54 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-ee8c0645-13b9-43f2-9ea5-fa05b066d99d tempest-VolumesGetTest-1959119330 None] Volume volume-d2aa4114-ee33-4b1e-b9eb-68a0da587a72 (d2aa4114-ee33-4b1e-b9eb-68a0da587a72): created successfully Apr 29 15:18:54 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-ee8c0645-13b9-43f2-9ea5-fa05b066d99d tempest-VolumesGetTest-1959119330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0205dcb2-4a61-4aa9-a9e4-4cde70dde7f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:18:54 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-ee8c0645-13b9-43f2-9ea5-fa05b066d99d tempest-VolumesGetTest-1959119330 None] Flow 'volume_create_manager' (a324e40c-b3f8-444b-b09f-ffe08daf80d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:18:54 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-ee8c0645-13b9-43f2-9ea5-fa05b066d99d tempest-VolumesGetTest-1959119330 None] Created volume successfully. Apr 29 15:18:54 devstack sudo[99984]: pam_unix(sudo:session): session closed for user root Apr 29 15:18:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-9747f9f3-74b5-4fcb-b23a-93252f648216 tempest-GroupSnapshotsTest-1515970109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cb328395-ebed-4da9-9b09-6e2979a309b4 1073741824" returned: 0 in 0.839s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:18:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-9747f9f3-74b5-4fcb-b23a-93252f648216 tempest-GroupSnapshotsTest-1515970109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cb328395-ebed-4da9-9b09-6e2979a309b4 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:18:54 devstack sudo[99990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cb328395-ebed-4da9-9b09-6e2979a309b4 Apr 29 15:18:54 devstack sudo[99990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:18:54 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-484c1695-bd73-413f-b73d-82642d6a891c tempest-VolumesGetTest-1959119330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:18:54 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-484c1695-bd73-413f-b73d-82642d6a891c tempest-VolumesGetTest-1959119330 None] Flow 'volume_create_manager' (b62c2421-7164-4d39-a11f-5bd38b413b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:18:54 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-484c1695-bd73-413f-b73d-82642d6a891c tempest-VolumesGetTest-1959119330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a7b43ae-38f2-400e-a79e-9bc8346e87d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:18:54 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-484c1695-bd73-413f-b73d-82642d6a891c tempest-VolumesGetTest-1959119330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a7b43ae-38f2-400e-a79e-9bc8346e87d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:18:55Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-820901772',display_name='tempest-VolumesGetTest-Volume-1178999076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c8e9582-8bde-4810-93a1-c95f303e8dbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f869a6d249654e13be76ee6a847e4481',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:18:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:18:55Z,use_quota=True,user_id='fbb2502dd9b544f5b144418f0bfe579a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:18:54 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-484c1695-bd73-413f-b73d-82642d6a891c tempest-VolumesGetTest-1959119330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (952fa2f7-815c-4e10-81dd-7951f6e8a04b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:18:54 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-484c1695-bd73-413f-b73d-82642d6a891c tempest-VolumesGetTest-1959119330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (952fa2f7-815c-4e10-81dd-7951f6e8a04b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:18:54 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-484c1695-bd73-413f-b73d-82642d6a891c tempest-VolumesGetTest-1959119330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73f81db9-e515-43a4-b7b5-c8ed087263e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:18:54 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-484c1695-bd73-413f-b73d-82642d6a891c tempest-VolumesGetTest-1959119330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73f81db9-e515-43a4-b7b5-c8ed087263e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c8e9582-8bde-4810-93a1-c95f303e8dbc', 'volume_name': 'volume-1c8e9582-8bde-4810-93a1-c95f303e8dbc', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:18:54 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-484c1695-bd73-413f-b73d-82642d6a891c tempest-VolumesGetTest-1959119330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (916e02a0-5deb-43f1-9d90-3b1a77d203ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:18:54 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-484c1695-bd73-413f-b73d-82642d6a891c tempest-VolumesGetTest-1959119330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (916e02a0-5deb-43f1-9d90-3b1a77d203ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:18:54 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-484c1695-bd73-413f-b73d-82642d6a891c tempest-VolumesGetTest-1959119330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5ac6e29-50b0-461e-86bb-5ad959543ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:18:54 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-484c1695-bd73-413f-b73d-82642d6a891c tempest-VolumesGetTest-1959119330 None] Volume 1c8e9582-8bde-4810-93a1-c95f303e8dbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c8e9582-8bde-4810-93a1-c95f303e8dbc', 'volume_size': 1} Apr 29 15:18:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-484c1695-bd73-413f-b73d-82642d6a891c tempest-VolumesGetTest-1959119330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:18:55 devstack sudo[99990]: pam_unix(sudo:session): session closed for user root Apr 29 15:18:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-9747f9f3-74b5-4fcb-b23a-93252f648216 tempest-GroupSnapshotsTest-1515970109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cb328395-ebed-4da9-9b09-6e2979a309b4" returned: 0 in 0.607s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:18:55 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-9747f9f3-74b5-4fcb-b23a-93252f648216 tempest-GroupSnapshotsTest-1515970109 None] <== create_volume: return (1485ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:18:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-9747f9f3-74b5-4fcb-b23a-93252f648216 tempest-GroupSnapshotsTest-1515970109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.489s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:18:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-484c1695-bd73-413f-b73d-82642d6a891c tempest-VolumesGetTest-1959119330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.475s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:18:55 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-484c1695-bd73-413f-b73d-82642d6a891c tempest-VolumesGetTest-1959119330 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:18:55Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-820901772',display_name='tempest-VolumesGetTest-Volume-1178999076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c8e9582-8bde-4810-93a1-c95f303e8dbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f869a6d249654e13be76ee6a847e4481',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:18:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:18:55Z,use_quota=True,user_id='fbb2502dd9b544f5b144418f0bfe579a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:18:55 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-484c1695-bd73-413f-b73d-82642d6a891c tempest-VolumesGetTest-1959119330 None] Creating volume 1c8e9582-8bde-4810-93a1-c95f303e8dbc {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:18:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-484c1695-bd73-413f-b73d-82642d6a891c tempest-VolumesGetTest-1959119330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:18:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-484c1695-bd73-413f-b73d-82642d6a891c tempest-VolumesGetTest-1959119330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:18:55 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-484c1695-bd73-413f-b73d-82642d6a891c tempest-VolumesGetTest-1959119330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:18:55 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-484c1695-bd73-413f-b73d-82642d6a891c tempest-VolumesGetTest-1959119330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:18:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-484c1695-bd73-413f-b73d-82642d6a891c tempest-VolumesGetTest-1959119330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:18:55 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-484c1695-bd73-413f-b73d-82642d6a891c tempest-VolumesGetTest-1959119330 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:18:55 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-484c1695-bd73-413f-b73d-82642d6a891c tempest-VolumesGetTest-1959119330 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:18:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-484c1695-bd73-413f-b73d-82642d6a891c tempest-VolumesGetTest-1959119330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1c8e9582-8bde-4810-93a1-c95f303e8dbc 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:18:55 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-9747f9f3-74b5-4fcb-b23a-93252f648216 tempest-GroupSnapshotsTest-1515970109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e788e48-8079-4f52-a23d-59e2ab326779) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb328395-ebed-4da9-9b09-6e2979a309b4', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:18:55 devstack sudo[99994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1c8e9582-8bde-4810-93a1-c95f303e8dbc 1073741824 Apr 29 15:18:55 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-9747f9f3-74b5-4fcb-b23a-93252f648216 tempest-GroupSnapshotsTest-1515970109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a45b83f-a505-4372-909d-343501c3b907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:18:55 devstack sudo[99994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:18:55 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-9747f9f3-74b5-4fcb-b23a-93252f648216 tempest-GroupSnapshotsTest-1515970109 None] Volume volume-cb328395-ebed-4da9-9b09-6e2979a309b4 (cb328395-ebed-4da9-9b09-6e2979a309b4): created successfully Apr 29 15:18:55 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-9747f9f3-74b5-4fcb-b23a-93252f648216 tempest-GroupSnapshotsTest-1515970109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a45b83f-a505-4372-909d-343501c3b907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:18:55 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-9747f9f3-74b5-4fcb-b23a-93252f648216 tempest-GroupSnapshotsTest-1515970109 None] Flow 'volume_create_manager' (7ea8b538-d52f-400b-83b3-1ad5c16995aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:18:55 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-9747f9f3-74b5-4fcb-b23a-93252f648216 tempest-GroupSnapshotsTest-1515970109 None] Created volume successfully. Apr 29 15:18:56 devstack sudo[99994]: pam_unix(sudo:session): session closed for user root Apr 29 15:18:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-484c1695-bd73-413f-b73d-82642d6a891c tempest-VolumesGetTest-1959119330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1c8e9582-8bde-4810-93a1-c95f303e8dbc 1073741824" returned: 0 in 0.808s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:18:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-484c1695-bd73-413f-b73d-82642d6a891c tempest-VolumesGetTest-1959119330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1c8e9582-8bde-4810-93a1-c95f303e8dbc {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:18:56 devstack sudo[100000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1c8e9582-8bde-4810-93a1-c95f303e8dbc Apr 29 15:18:56 devstack sudo[100000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:18:56 devstack sudo[100000]: pam_unix(sudo:session): session closed for user root Apr 29 15:18:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-484c1695-bd73-413f-b73d-82642d6a891c tempest-VolumesGetTest-1959119330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1c8e9582-8bde-4810-93a1-c95f303e8dbc" returned: 0 in 0.639s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:18:56 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-484c1695-bd73-413f-b73d-82642d6a891c tempest-VolumesGetTest-1959119330 None] <== create_volume: return (1485ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:18:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-484c1695-bd73-413f-b73d-82642d6a891c tempest-VolumesGetTest-1959119330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.490s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:18:56 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-484c1695-bd73-413f-b73d-82642d6a891c tempest-VolumesGetTest-1959119330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5ac6e29-50b0-461e-86bb-5ad959543ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c8e9582-8bde-4810-93a1-c95f303e8dbc', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:18:56 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-484c1695-bd73-413f-b73d-82642d6a891c tempest-VolumesGetTest-1959119330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd517492-7014-483e-81fc-de16a4600efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:18:56 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-484c1695-bd73-413f-b73d-82642d6a891c tempest-VolumesGetTest-1959119330 None] Volume volume-1c8e9582-8bde-4810-93a1-c95f303e8dbc (1c8e9582-8bde-4810-93a1-c95f303e8dbc): created successfully Apr 29 15:18:56 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-484c1695-bd73-413f-b73d-82642d6a891c tempest-VolumesGetTest-1959119330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd517492-7014-483e-81fc-de16a4600efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:18:56 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-484c1695-bd73-413f-b73d-82642d6a891c tempest-VolumesGetTest-1959119330 None] Flow 'volume_create_manager' (b62c2421-7164-4d39-a11f-5bd38b413b19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:18:57 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-484c1695-bd73-413f-b73d-82642d6a891c tempest-VolumesGetTest-1959119330 None] Created volume successfully. Apr 29 15:18:57 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-74b15155-d1b3-4742-bc99-1b12c6c08897 tempest-GroupSnapshotsTest-1515970109 None] GroupSnapshot 49aacd2b-6e0b-4f6b-929e-22c271bfe2c3: creating. Apr 29 15:18:57 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-74b15155-d1b3-4742-bc99-1b12c6c08897 tempest-GroupSnapshotsTest-1515970109 None] Group snapshot 49aacd2b-6e0b-4f6b-929e-22c271bfe2c3: creating. {{(pid=84448) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 29 15:18:57 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-74b15155-d1b3-4742-bc99-1b12c6c08897 tempest-GroupSnapshotsTest-1515970109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:18:57 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-74b15155-d1b3-4742-bc99-1b12c6c08897 tempest-GroupSnapshotsTest-1515970109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:18:57 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-74b15155-d1b3-4742-bc99-1b12c6c08897 tempest-GroupSnapshotsTest-1515970109 None] Creating offline snapshot 9311cdb0-7c9f-4ca1-91ec-a07257100bbf of volume cb328395-ebed-4da9-9b09-6e2979a309b4 {{(pid=84448) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 15:18:57 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[08516ea8-ec97-4bc5-a743-42449a0b597f]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:18:57 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-74b15155-d1b3-4742-bc99-1b12c6c08897 tempest-GroupSnapshotsTest-1515970109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cb328395-ebed-4da9-9b09-6e2979a309b4 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:18:57 devstack sudo[100003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cb328395-ebed-4da9-9b09-6e2979a309b4 Apr 29 15:18:57 devstack sudo[100003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:18:57 devstack sudo[100003]: pam_unix(sudo:session): session closed for user root Apr 29 15:18:57 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-74b15155-d1b3-4742-bc99-1b12c6c08897 tempest-GroupSnapshotsTest-1515970109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cb328395-ebed-4da9-9b09-6e2979a309b4" returned: 0 in 0.683s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:18:57 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-74b15155-d1b3-4742-bc99-1b12c6c08897 tempest-GroupSnapshotsTest-1515970109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cb328395-ebed-4da9-9b09-6e2979a309b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cb328395-ebed-4da9-9b09-6e2979a309b4.9311cdb0-7c9f-4ca1-91ec-a07257100bbf 1G {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:18:57 devstack sudo[100008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cb328395-ebed-4da9-9b09-6e2979a309b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cb328395-ebed-4da9-9b09-6e2979a309b4.9311cdb0-7c9f-4ca1-91ec-a07257100bbf 1G Apr 29 15:18:57 devstack sudo[100008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:18:58 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-64bad3c1-f9b1-486e-b6a1-9dd4283ffbb8 tempest-VolumesGetTest-1959119330 None] Acquiring lock "cinder-1c8e9582-8bde-4810-93a1-c95f303e8dbc-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:18:58 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-64bad3c1-f9b1-486e-b6a1-9dd4283ffbb8 tempest-VolumesGetTest-1959119330 None] Lock "cinder-1c8e9582-8bde-4810-93a1-c95f303e8dbc-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:18:58 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:SELECT=64,cinder:UPDATE=74,cinder:INSERT=15,cinder:DELETE=6 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:18:58 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:SELECT=63,cinder:UPDATE=77,cinder:INSERT=18,cinder:DELETE=7 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:18:58 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-64bad3c1-f9b1-486e-b6a1-9dd4283ffbb8 tempest-VolumesGetTest-1959119330 None] Acquiring lock "cinder-quobyte-1c8e9582-8bde-4810-93a1-c95f303e8dbc" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:18:58 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-64bad3c1-f9b1-486e-b6a1-9dd4283ffbb8 tempest-VolumesGetTest-1959119330 None] Lock "cinder-quobyte-1c8e9582-8bde-4810-93a1-c95f303e8dbc" acquired by "delete_volume" :: waited 0.022s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:18:58 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[7767af8b-5f55-43e4-8248-675f1e10ff21]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:18:58 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-64bad3c1-f9b1-486e-b6a1-9dd4283ffbb8 tempest-VolumesGetTest-1959119330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1c8e9582-8bde-4810-93a1-c95f303e8dbc {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:18:58 devstack sudo[100012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1c8e9582-8bde-4810-93a1-c95f303e8dbc Apr 29 15:18:58 devstack sudo[100012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:18:58 devstack sudo[100008]: pam_unix(sudo:session): session closed for user root Apr 29 15:18:58 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-74b15155-d1b3-4742-bc99-1b12c6c08897 tempest-GroupSnapshotsTest-1515970109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cb328395-ebed-4da9-9b09-6e2979a309b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cb328395-ebed-4da9-9b09-6e2979a309b4.9311cdb0-7c9f-4ca1-91ec-a07257100bbf 1G" returned: 0 in 0.785s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:18:58 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-74b15155-d1b3-4742-bc99-1b12c6c08897 tempest-GroupSnapshotsTest-1515970109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb328395-ebed-4da9-9b09-6e2979a309b4 -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cb328395-ebed-4da9-9b09-6e2979a309b4.9311cdb0-7c9f-4ca1-91ec-a07257100bbf {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:18:58 devstack sudo[100015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb328395-ebed-4da9-9b09-6e2979a309b4 -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cb328395-ebed-4da9-9b09-6e2979a309b4.9311cdb0-7c9f-4ca1-91ec-a07257100bbf Apr 29 15:18:58 devstack sudo[100015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:18:59 devstack sudo[100012]: pam_unix(sudo:session): session closed for user root Apr 29 15:18:59 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-64bad3c1-f9b1-486e-b6a1-9dd4283ffbb8 tempest-VolumesGetTest-1959119330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1c8e9582-8bde-4810-93a1-c95f303e8dbc" returned: 0 in 0.734s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:18:59 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-64bad3c1-f9b1-486e-b6a1-9dd4283ffbb8 tempest-VolumesGetTest-1959119330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1c8e9582-8bde-4810-93a1-c95f303e8dbc {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:18:59 devstack sudo[100021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1c8e9582-8bde-4810-93a1-c95f303e8dbc Apr 29 15:18:59 devstack sudo[100021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:18:59 devstack sudo[100015]: pam_unix(sudo:session): session closed for user root Apr 29 15:18:59 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-74b15155-d1b3-4742-bc99-1b12c6c08897 tempest-GroupSnapshotsTest-1515970109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb328395-ebed-4da9-9b09-6e2979a309b4 -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cb328395-ebed-4da9-9b09-6e2979a309b4.9311cdb0-7c9f-4ca1-91ec-a07257100bbf" returned: 0 in 0.703s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:18:59 devstack cinder-volume[84448]: WARNING cinder.volume.drivers.remotefs [None req-74b15155-d1b3-4742-bc99-1b12c6c08897 tempest-GroupSnapshotsTest-1515970109 None] /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cb328395-ebed-4da9-9b09-6e2979a309b4.9311cdb0-7c9f-4ca1-91ec-a07257100bbf is being set with open permissions: ugo+rw: NotImplementedError Apr 29 15:18:59 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-74b15155-d1b3-4742-bc99-1b12c6c08897 tempest-GroupSnapshotsTest-1515970109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cb328395-ebed-4da9-9b09-6e2979a309b4.9311cdb0-7c9f-4ca1-91ec-a07257100bbf {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:18:59 devstack sudo[100025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cb328395-ebed-4da9-9b09-6e2979a309b4.9311cdb0-7c9f-4ca1-91ec-a07257100bbf Apr 29 15:18:59 devstack sudo[100025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:18:59 devstack sudo[100021]: pam_unix(sudo:session): session closed for user root Apr 29 15:18:59 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-64bad3c1-f9b1-486e-b6a1-9dd4283ffbb8 tempest-VolumesGetTest-1959119330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1c8e9582-8bde-4810-93a1-c95f303e8dbc" returned: 0 in 0.627s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:18:59 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-64bad3c1-f9b1-486e-b6a1-9dd4283ffbb8 tempest-VolumesGetTest-1959119330 None] Lock "cinder-quobyte-1c8e9582-8bde-4810-93a1-c95f303e8dbc" released by "delete_volume" :: held 1.408s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:18:59 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-64bad3c1-f9b1-486e-b6a1-9dd4283ffbb8 tempest-VolumesGetTest-1959119330 None] Created reservations ['261872f3-a54d-4583-93cb-ffd1a43b2ba9', 'abacc44c-ef9e-47b0-9603-196963f7663b', 'c41353dc-79f7-48da-b4b5-7e58d1c14adc', '5831d409-e94d-43ed-be5e-cdcaa38c7715'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:18:59 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-64bad3c1-f9b1-486e-b6a1-9dd4283ffbb8 tempest-VolumesGetTest-1959119330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:18:59 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-64bad3c1-f9b1-486e-b6a1-9dd4283ffbb8 tempest-VolumesGetTest-1959119330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:18:59 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-64bad3c1-f9b1-486e-b6a1-9dd4283ffbb8 tempest-VolumesGetTest-1959119330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:18:59 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-64bad3c1-f9b1-486e-b6a1-9dd4283ffbb8 tempest-VolumesGetTest-1959119330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:18:59 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-64bad3c1-f9b1-486e-b6a1-9dd4283ffbb8 tempest-VolumesGetTest-1959119330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:18:59 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-64bad3c1-f9b1-486e-b6a1-9dd4283ffbb8 tempest-VolumesGetTest-1959119330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:18:59 devstack sudo[100029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:18:59 devstack sudo[100029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:18:59 devstack sudo[100025]: pam_unix(sudo:session): session closed for user root Apr 29 15:18:59 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-74b15155-d1b3-4742-bc99-1b12c6c08897 tempest-GroupSnapshotsTest-1515970109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cb328395-ebed-4da9-9b09-6e2979a309b4.9311cdb0-7c9f-4ca1-91ec-a07257100bbf" returned: 0 in 0.627s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:18:59 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-74b15155-d1b3-4742-bc99-1b12c6c08897 tempest-GroupSnapshotsTest-1515970109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cb328395-ebed-4da9-9b09-6e2979a309b4.info {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:18:59 devstack sudo[100031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cb328395-ebed-4da9-9b09-6e2979a309b4.info Apr 29 15:18:59 devstack sudo[100031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:00 devstack sudo[100029]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:00 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-64bad3c1-f9b1-486e-b6a1-9dd4283ffbb8 tempest-VolumesGetTest-1959119330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.639s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:00 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-64bad3c1-f9b1-486e-b6a1-9dd4283ffbb8 tempest-VolumesGetTest-1959119330 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:19:00 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-64bad3c1-f9b1-486e-b6a1-9dd4283ffbb8 tempest-VolumesGetTest-1959119330 None] Deleted volume successfully. Apr 29 15:19:00 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-64bad3c1-f9b1-486e-b6a1-9dd4283ffbb8 tempest-VolumesGetTest-1959119330 None] Lock "cinder-1c8e9582-8bde-4810-93a1-c95f303e8dbc-delete_volume" released by "delete_volume" :: held 2.271s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:19:00 devstack sudo[100031]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:00 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-79f3c44b-4a07-409e-90bb-3f21896af5ed tempest-VolumesGetTest-1959119330 None] Acquiring lock "cinder-d2aa4114-ee33-4b1e-b9eb-68a0da587a72-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:19:00 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-74b15155-d1b3-4742-bc99-1b12c6c08897 tempest-GroupSnapshotsTest-1515970109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cb328395-ebed-4da9-9b09-6e2979a309b4.info" returned: 0 in 0.639s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:00 devstack cinder-volume[84448]: WARNING cinder.volume.drivers.remotefs [None req-74b15155-d1b3-4742-bc99-1b12c6c08897 tempest-GroupSnapshotsTest-1515970109 None] /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cb328395-ebed-4da9-9b09-6e2979a309b4.info is being set with open permissions: ugo+rw: NotImplementedError Apr 29 15:19:00 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-74b15155-d1b3-4742-bc99-1b12c6c08897 tempest-GroupSnapshotsTest-1515970109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cb328395-ebed-4da9-9b09-6e2979a309b4.info {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:00 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-79f3c44b-4a07-409e-90bb-3f21896af5ed tempest-VolumesGetTest-1959119330 None] Lock "cinder-d2aa4114-ee33-4b1e-b9eb-68a0da587a72-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:19:00 devstack sudo[100035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cb328395-ebed-4da9-9b09-6e2979a309b4.info Apr 29 15:19:00 devstack sudo[100035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:00 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-79f3c44b-4a07-409e-90bb-3f21896af5ed tempest-VolumesGetTest-1959119330 None] Acquiring lock "cinder-quobyte-d2aa4114-ee33-4b1e-b9eb-68a0da587a72" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:19:00 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-79f3c44b-4a07-409e-90bb-3f21896af5ed tempest-VolumesGetTest-1959119330 None] Lock "cinder-quobyte-d2aa4114-ee33-4b1e-b9eb-68a0da587a72" acquired by "delete_volume" :: waited 0.014s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:19:00 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a69baf-38e6-42c9-a54b-2ea26a613e02]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:19:00 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-79f3c44b-4a07-409e-90bb-3f21896af5ed tempest-VolumesGetTest-1959119330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d2aa4114-ee33-4b1e-b9eb-68a0da587a72 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:00 devstack sudo[100037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d2aa4114-ee33-4b1e-b9eb-68a0da587a72 Apr 29 15:19:00 devstack sudo[100037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:01 devstack sudo[100035]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-74b15155-d1b3-4742-bc99-1b12c6c08897 tempest-GroupSnapshotsTest-1515970109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cb328395-ebed-4da9-9b09-6e2979a309b4.info" returned: 0 in 0.625s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-74b15155-d1b3-4742-bc99-1b12c6c08897 tempest-GroupSnapshotsTest-1515970109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.151s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:19:01 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-74b15155-d1b3-4742-bc99-1b12c6c08897 tempest-GroupSnapshotsTest-1515970109 None] group_snapshot 49aacd2b-6e0b-4f6b-929e-22c271bfe2c3: created successfully Apr 29 15:19:01 devstack sudo[100037]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-79f3c44b-4a07-409e-90bb-3f21896af5ed tempest-VolumesGetTest-1959119330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d2aa4114-ee33-4b1e-b9eb-68a0da587a72" returned: 0 in 0.697s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-79f3c44b-4a07-409e-90bb-3f21896af5ed tempest-VolumesGetTest-1959119330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d2aa4114-ee33-4b1e-b9eb-68a0da587a72 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:01 devstack sudo[100044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d2aa4114-ee33-4b1e-b9eb-68a0da587a72 Apr 29 15:19:01 devstack sudo[100044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:01 devstack sudo[100044]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-79f3c44b-4a07-409e-90bb-3f21896af5ed tempest-VolumesGetTest-1959119330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d2aa4114-ee33-4b1e-b9eb-68a0da587a72" returned: 0 in 0.589s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:01 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-79f3c44b-4a07-409e-90bb-3f21896af5ed tempest-VolumesGetTest-1959119330 None] Lock "cinder-quobyte-d2aa4114-ee33-4b1e-b9eb-68a0da587a72" released by "delete_volume" :: held 1.327s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:19:02 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-79f3c44b-4a07-409e-90bb-3f21896af5ed tempest-VolumesGetTest-1959119330 None] Created reservations ['ddca2dd3-a37f-45b3-8475-ac20c88601d5', 'cd5af527-0b5b-48cf-8b44-d4b87c1f5da5', '3fe6756b-bc26-46e4-8ad1-2e3a132ef6e4', 'ca1363c6-2451-417c-a4d3-40b9cb2204dc'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:19:02 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-79f3c44b-4a07-409e-90bb-3f21896af5ed tempest-VolumesGetTest-1959119330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:19:02 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-79f3c44b-4a07-409e-90bb-3f21896af5ed tempest-VolumesGetTest-1959119330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:19:02 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-79f3c44b-4a07-409e-90bb-3f21896af5ed tempest-VolumesGetTest-1959119330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:19:02 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-79f3c44b-4a07-409e-90bb-3f21896af5ed tempest-VolumesGetTest-1959119330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:19:02 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-79f3c44b-4a07-409e-90bb-3f21896af5ed tempest-VolumesGetTest-1959119330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:19:02 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-79f3c44b-4a07-409e-90bb-3f21896af5ed tempest-VolumesGetTest-1959119330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:02 devstack sudo[100047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:19:02 devstack sudo[100047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:02 devstack sudo[100047]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:02 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-79f3c44b-4a07-409e-90bb-3f21896af5ed tempest-VolumesGetTest-1959119330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.602s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:02 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-79f3c44b-4a07-409e-90bb-3f21896af5ed tempest-VolumesGetTest-1959119330 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:19:02 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-79f3c44b-4a07-409e-90bb-3f21896af5ed tempest-VolumesGetTest-1959119330 None] Deleted volume successfully. Apr 29 15:19:02 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-79f3c44b-4a07-409e-90bb-3f21896af5ed tempest-VolumesGetTest-1959119330 None] Lock "cinder-d2aa4114-ee33-4b1e-b9eb-68a0da587a72-delete_volume" released by "delete_volume" :: held 2.125s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:19:02 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-d3373576-d4e1-4e4e-8baa-d14e37aac7e8 tempest-VolumesGetTest-1959119330 None] Acquiring lock "cinder-051744c7-9bb8-4a89-abb8-20c0464e0d10-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:19:02 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-d3373576-d4e1-4e4e-8baa-d14e37aac7e8 tempest-VolumesGetTest-1959119330 None] Lock "cinder-051744c7-9bb8-4a89-abb8-20c0464e0d10-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:19:02 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-d3373576-d4e1-4e4e-8baa-d14e37aac7e8 tempest-VolumesGetTest-1959119330 None] Acquiring lock "cinder-quobyte-051744c7-9bb8-4a89-abb8-20c0464e0d10" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:19:02 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-d3373576-d4e1-4e4e-8baa-d14e37aac7e8 tempest-VolumesGetTest-1959119330 None] Lock "cinder-quobyte-051744c7-9bb8-4a89-abb8-20c0464e0d10" acquired by "delete_volume" :: waited 0.015s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:19:02 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e20872-7ef0-4941-90b3-f2d8b15bafe5]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:19:02 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-d3373576-d4e1-4e4e-8baa-d14e37aac7e8 tempest-VolumesGetTest-1959119330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-051744c7-9bb8-4a89-abb8-20c0464e0d10 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:03 devstack sudo[100050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-051744c7-9bb8-4a89-abb8-20c0464e0d10 Apr 29 15:19:03 devstack sudo[100050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:03 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-d01dd773-3aa5-49d9-8d37-e857fc349213 tempest-GroupSnapshotsTest-1515970109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:19:03 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-d01dd773-3aa5-49d9-8d37-e857fc349213 tempest-GroupSnapshotsTest-1515970109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:19:03 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-d01dd773-3aa5-49d9-8d37-e857fc349213 tempest-GroupSnapshotsTest-1515970109 None] Acquiring lock "cinder-quobyte-9311cdb0-7c9f-4ca1-91ec-a07257100bbf-36b84d1c-8875-4981-bafd-bb9631e08794" by "_create_volume_from_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:19:03 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-d01dd773-3aa5-49d9-8d37-e857fc349213 tempest-GroupSnapshotsTest-1515970109 None] Lock "cinder-quobyte-9311cdb0-7c9f-4ca1-91ec-a07257100bbf-36b84d1c-8875-4981-bafd-bb9631e08794" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:19:03 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-d01dd773-3aa5-49d9-8d37-e857fc349213 tempest-GroupSnapshotsTest-1515970109 None] Creating volume 36b84d1c-8875-4981-bafd-bb9631e08794 from snapshot 9311cdb0-7c9f-4ca1-91ec-a07257100bbf {{(pid=84448) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 15:19:03 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-d01dd773-3aa5-49d9-8d37-e857fc349213 tempest-GroupSnapshotsTest-1515970109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:19:03 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-d01dd773-3aa5-49d9-8d37-e857fc349213 tempest-GroupSnapshotsTest-1515970109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:19:03 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-d01dd773-3aa5-49d9-8d37-e857fc349213 tempest-GroupSnapshotsTest-1515970109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:19:03 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-d01dd773-3aa5-49d9-8d37-e857fc349213 tempest-GroupSnapshotsTest-1515970109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:19:03 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-d01dd773-3aa5-49d9-8d37-e857fc349213 tempest-GroupSnapshotsTest-1515970109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:19:03 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-d01dd773-3aa5-49d9-8d37-e857fc349213 tempest-GroupSnapshotsTest-1515970109 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:19:03 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-d01dd773-3aa5-49d9-8d37-e857fc349213 tempest-GroupSnapshotsTest-1515970109 None] Acquiring lock "cinder-quobyte-36b84d1c-8875-4981-bafd-bb9631e08794" by "_copy_volume_from_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:19:03 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-d01dd773-3aa5-49d9-8d37-e857fc349213 tempest-GroupSnapshotsTest-1515970109 None] Lock "cinder-quobyte-36b84d1c-8875-4981-bafd-bb9631e08794" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:19:03 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-d01dd773-3aa5-49d9-8d37-e857fc349213 tempest-GroupSnapshotsTest-1515970109 None] snapshot: 9311cdb0-7c9f-4ca1-91ec-a07257100bbf, volume: 36b84d1c-8875-4981-bafd-bb9631e08794, {{(pid=84448) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 15:19:03 devstack sudo[100050]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:03 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-d01dd773-3aa5-49d9-8d37-e857fc349213 tempest-GroupSnapshotsTest-1515970109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:19:03 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-d01dd773-3aa5-49d9-8d37-e857fc349213 tempest-GroupSnapshotsTest-1515970109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:19:03 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-d01dd773-3aa5-49d9-8d37-e857fc349213 tempest-GroupSnapshotsTest-1515970109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:19:03 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-d01dd773-3aa5-49d9-8d37-e857fc349213 tempest-GroupSnapshotsTest-1515970109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:19:03 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-d01dd773-3aa5-49d9-8d37-e857fc349213 tempest-GroupSnapshotsTest-1515970109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:19:03 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-d3373576-d4e1-4e4e-8baa-d14e37aac7e8 tempest-VolumesGetTest-1959119330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-051744c7-9bb8-4a89-abb8-20c0464e0d10" returned: 0 in 0.759s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:03 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-d3373576-d4e1-4e4e-8baa-d14e37aac7e8 tempest-VolumesGetTest-1959119330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-051744c7-9bb8-4a89-abb8-20c0464e0d10 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:03 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[0580634b-8ca0-459f-962a-c99163ffc56a]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:19:03 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-d01dd773-3aa5-49d9-8d37-e857fc349213 tempest-GroupSnapshotsTest-1515970109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cb328395-ebed-4da9-9b09-6e2979a309b4.9311cdb0-7c9f-4ca1-91ec-a07257100bbf {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:03 devstack sudo[100055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-051744c7-9bb8-4a89-abb8-20c0464e0d10 Apr 29 15:19:03 devstack sudo[100055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:03 devstack sudo[100056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cb328395-ebed-4da9-9b09-6e2979a309b4.9311cdb0-7c9f-4ca1-91ec-a07257100bbf Apr 29 15:19:03 devstack sudo[100056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:04 devstack sudo[100055]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:04 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-d3373576-d4e1-4e4e-8baa-d14e37aac7e8 tempest-VolumesGetTest-1959119330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-051744c7-9bb8-4a89-abb8-20c0464e0d10" returned: 0 in 0.659s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:04 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-d3373576-d4e1-4e4e-8baa-d14e37aac7e8 tempest-VolumesGetTest-1959119330 None] Lock "cinder-quobyte-051744c7-9bb8-4a89-abb8-20c0464e0d10" released by "delete_volume" :: held 1.487s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:19:04 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-d3373576-d4e1-4e4e-8baa-d14e37aac7e8 tempest-VolumesGetTest-1959119330 None] Created reservations ['d760c845-7f31-4871-bea8-8ed0ca731482', 'bb4ab3f6-474e-4e42-8b49-6251378437a0', '4473b6ba-9bd0-479b-985c-4f682b79604a', '4677ebdd-525f-4c89-a011-632e9265a275'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:19:04 devstack sudo[100056]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:04 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-d01dd773-3aa5-49d9-8d37-e857fc349213 tempest-GroupSnapshotsTest-1515970109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cb328395-ebed-4da9-9b09-6e2979a309b4.9311cdb0-7c9f-4ca1-91ec-a07257100bbf" returned: 0 in 0.759s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:04 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-d01dd773-3aa5-49d9-8d37-e857fc349213 tempest-GroupSnapshotsTest-1515970109 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb328395-ebed-4da9-9b09-6e2979a309b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84448) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 15:19:04 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-d01dd773-3aa5-49d9-8d37-e857fc349213 tempest-GroupSnapshotsTest-1515970109 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cb328395-ebed-4da9-9b09-6e2979a309b4 {{(pid=84448) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 15:19:04 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-d01dd773-3aa5-49d9-8d37-e857fc349213 tempest-GroupSnapshotsTest-1515970109 None] Creating direct copy from snapshot {{(pid=84448) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 15:19:04 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac40c83-4d88-4a49-96b4-3729428a8127]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:19:04 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-d01dd773-3aa5-49d9-8d37-e857fc349213 tempest-GroupSnapshotsTest-1515970109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cb328395-ebed-4da9-9b09-6e2979a309b4 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:04 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-d3373576-d4e1-4e4e-8baa-d14e37aac7e8 tempest-VolumesGetTest-1959119330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:19:04 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-d3373576-d4e1-4e4e-8baa-d14e37aac7e8 tempest-VolumesGetTest-1959119330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:19:04 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-d3373576-d4e1-4e4e-8baa-d14e37aac7e8 tempest-VolumesGetTest-1959119330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:19:04 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-d3373576-d4e1-4e4e-8baa-d14e37aac7e8 tempest-VolumesGetTest-1959119330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:19:04 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-d3373576-d4e1-4e4e-8baa-d14e37aac7e8 tempest-VolumesGetTest-1959119330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:19:04 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-d3373576-d4e1-4e4e-8baa-d14e37aac7e8 tempest-VolumesGetTest-1959119330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:04 devstack sudo[100064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:19:04 devstack sudo[100064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:04 devstack sudo[100063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cb328395-ebed-4da9-9b09-6e2979a309b4 Apr 29 15:19:04 devstack sudo[100063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:05 devstack sudo[100064]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:05 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-d3373576-d4e1-4e4e-8baa-d14e37aac7e8 tempest-VolumesGetTest-1959119330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.635s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:05 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-d3373576-d4e1-4e4e-8baa-d14e37aac7e8 tempest-VolumesGetTest-1959119330 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:19:05 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-d3373576-d4e1-4e4e-8baa-d14e37aac7e8 tempest-VolumesGetTest-1959119330 None] Deleted volume successfully. Apr 29 15:19:05 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-d3373576-d4e1-4e4e-8baa-d14e37aac7e8 tempest-VolumesGetTest-1959119330 None] Lock "cinder-051744c7-9bb8-4a89-abb8-20c0464e0d10-delete_volume" released by "delete_volume" :: held 2.355s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:19:05 devstack sudo[100063]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:05 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-d01dd773-3aa5-49d9-8d37-e857fc349213 tempest-GroupSnapshotsTest-1515970109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cb328395-ebed-4da9-9b09-6e2979a309b4" returned: 0 in 0.734s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:05 devstack cinder-volume[84448]: DEBUG cinder.utils [None req-d01dd773-3aa5-49d9-8d37-e857fc349213 tempest-GroupSnapshotsTest-1515970109 None] Path /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-36b84d1c-8875-4981-bafd-bb9631e08794 not found in is_blk_device check {{(pid=84448) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 15:19:05 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-d01dd773-3aa5-49d9-8d37-e857fc349213 tempest-GroupSnapshotsTest-1515970109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cb328395-ebed-4da9-9b09-6e2979a309b4 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-36b84d1c-8875-4981-bafd-bb9631e08794 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:05 devstack sudo[100071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cb328395-ebed-4da9-9b09-6e2979a309b4 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-36b84d1c-8875-4981-bafd-bb9631e08794 Apr 29 15:19:05 devstack sudo[100071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:05 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-f45db8a4-0f76-43e3-88ef-285f11f7e0a3 tempest-VolumesGetTest-1959119330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:19:05 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-f45db8a4-0f76-43e3-88ef-285f11f7e0a3 tempest-VolumesGetTest-1959119330 None] Flow 'volume_create_manager' (bedd2c92-5bcb-4dc4-86eb-b6aa5a2b2791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:19:05 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-f45db8a4-0f76-43e3-88ef-285f11f7e0a3 tempest-VolumesGetTest-1959119330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7adb54fc-29e3-4ff1-abf7-1e9fc4fdda5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:19:05 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-f45db8a4-0f76-43e3-88ef-285f11f7e0a3 tempest-VolumesGetTest-1959119330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7adb54fc-29e3-4ff1-abf7-1e9fc4fdda5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:19:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-938274997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34573540-a969-489a-b684-72b056052d23,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f869a6d249654e13be76ee6a847e4481',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:19:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:19:06Z,use_quota=True,user_id='fbb2502dd9b544f5b144418f0bfe579a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:19:05 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-f45db8a4-0f76-43e3-88ef-285f11f7e0a3 tempest-VolumesGetTest-1959119330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e4e848f-937a-4281-8d75-94a7a55eba03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:19:05 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-f45db8a4-0f76-43e3-88ef-285f11f7e0a3 tempest-VolumesGetTest-1959119330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e4e848f-937a-4281-8d75-94a7a55eba03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:19:05 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-f45db8a4-0f76-43e3-88ef-285f11f7e0a3 tempest-VolumesGetTest-1959119330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7d41ddd-7d94-4bb6-b8b5-58bb74509c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:19:05 devstack cinder-volume[84448]: DEBUG cinder.image.glance [None req-f45db8a4-0f76-43e3-88ef-285f11f7e0a3 tempest-VolumesGetTest-1959119330 None] Creating Keystone auth plugin from conf {{(pid=84448) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 29 15:19:06 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-f45db8a4-0f76-43e3-88ef-285f11f7e0a3 tempest-VolumesGetTest-1959119330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7d41ddd-7d94-4bb6-b8b5-58bb74509c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '34573540-a969-489a-b684-72b056052d23', 'volume_name': 'volume-34573540-a969-489a-b684-72b056052d23', 'volume_size': 1, 'image_id': 'ad86f424-7d2a-4f3b-9577-890075e7dc72', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ad86f424-7d2a-4f3b-9577-890075e7dc72', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '33db0ca5091747b1a3438d70bf53390c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ad86f424-7d2a-4f3b-9577-890075e7dc72', 'created_at': datetime.datetime(2026, 4, 29, 13, 0, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 13, 0, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ad86f424-7d2a-4f3b-9577-890075e7dc72/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:19:06 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-f45db8a4-0f76-43e3-88ef-285f11f7e0a3 tempest-VolumesGetTest-1959119330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4923cd56-5bf9-40bc-adc6-9d4e35e2eb6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:19:06 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-f45db8a4-0f76-43e3-88ef-285f11f7e0a3 tempest-VolumesGetTest-1959119330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4923cd56-5bf9-40bc-adc6-9d4e35e2eb6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:19:06 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-f45db8a4-0f76-43e3-88ef-285f11f7e0a3 tempest-VolumesGetTest-1959119330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b7dd087-c5a0-4e58-9b65-0292137328bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:19:06 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-f45db8a4-0f76-43e3-88ef-285f11f7e0a3 tempest-VolumesGetTest-1959119330 None] Volume 34573540-a969-489a-b684-72b056052d23: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-34573540-a969-489a-b684-72b056052d23', 'volume_size': 1, 'image_id': 'ad86f424-7d2a-4f3b-9577-890075e7dc72', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ad86f424-7d2a-4f3b-9577-890075e7dc72', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '33db0ca5091747b1a3438d70bf53390c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ad86f424-7d2a-4f3b-9577-890075e7dc72', 'created_at': datetime.datetime(2026, 4, 29, 13, 0, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 13, 0, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ad86f424-7d2a-4f3b-9577-890075e7dc72/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 29 15:19:06 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-f45db8a4-0f76-43e3-88ef-285f11f7e0a3 tempest-VolumesGetTest-1959119330 None] Trying to clone 34573540-a969-489a-b684-72b056052d23 from image ad86f424-7d2a-4f3b-9577-890075e7dc72 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ad86f424-7d2a-4f3b-9577-890075e7dc72', 'metadata': {}}]). {{(pid=84448) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 29 15:19:07 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [None req-f45db8a4-0f76-43e3-88ef-285f11f7e0a3 tempest-VolumesGetTest-1959119330 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_tnkwaededevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84448) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 29 15:19:07 devstack cinder-volume[84448]: INFO cinder.image.image_utils [None req-f45db8a4-0f76-43e3-88ef-285f11f7e0a3 tempest-VolumesGetTest-1959119330 None] Image download 20.69 MB at 20.69 MB/s Apr 29 15:19:07 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[164b88c9-b7fe-4338-b008-6dfa48b88831]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:19:07 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f45db8a4-0f76-43e3-88ef-285f11f7e0a3 tempest-VolumesGetTest-1959119330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_tnkwaededevstack@QuobyteHD {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:07 devstack sudo[100085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_tnkwaededevstack@QuobyteHD Apr 29 15:19:07 devstack sudo[100085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:08 devstack sudo[100085]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:08 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f45db8a4-0f76-43e3-88ef-285f11f7e0a3 tempest-VolumesGetTest-1959119330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_tnkwaededevstack@QuobyteHD" returned: 0 in 1.357s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:08 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [None req-f45db8a4-0f76-43e3-88ef-285f11f7e0a3 tempest-VolumesGetTest-1959119330 None] Temporary image ad86f424-7d2a-4f3b-9577-890075e7dc72 is fetched for user fbb2502dd9b544f5b144418f0bfe579a. {{(pid=84448) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 29 15:19:08 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfdd40e5-3f87-4bd1-8b1e-2cab1ae8a173]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:19:08 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f45db8a4-0f76-43e3-88ef-285f11f7e0a3 tempest-VolumesGetTest-1959119330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_tnkwaededevstack@QuobyteHD {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:09 devstack sudo[100092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_tnkwaededevstack@QuobyteHD Apr 29 15:19:09 devstack sudo[100092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:10 devstack sudo[100092]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:10 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f45db8a4-0f76-43e3-88ef-285f11f7e0a3 tempest-VolumesGetTest-1959119330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_tnkwaededevstack@QuobyteHD" returned: 0 in 1.511s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:10 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-f45db8a4-0f76-43e3-88ef-285f11f7e0a3 tempest-VolumesGetTest-1959119330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:19:10 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-d01dd773-3aa5-49d9-8d37-e857fc349213 tempest-GroupSnapshotsTest-1515970109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cb328395-ebed-4da9-9b09-6e2979a309b4 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-36b84d1c-8875-4981-bafd-bb9631e08794" returned: 0 in 5.562s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:10 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43dfba4-a61f-4aaf-b8b9-044c43f37978]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:19:10 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-d01dd773-3aa5-49d9-8d37-e857fc349213 tempest-GroupSnapshotsTest-1515970109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cb328395-ebed-4da9-9b09-6e2979a309b4 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:10 devstack sudo[100097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cb328395-ebed-4da9-9b09-6e2979a309b4 Apr 29 15:19:10 devstack sudo[100097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:11 devstack sudo[100097]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:11 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-d01dd773-3aa5-49d9-8d37-e857fc349213 tempest-GroupSnapshotsTest-1515970109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cb328395-ebed-4da9-9b09-6e2979a309b4" returned: 0 in 0.871s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:11 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [None req-d01dd773-3aa5-49d9-8d37-e857fc349213 tempest-GroupSnapshotsTest-1515970109 None] Image conversion details: src /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cb328395-ebed-4da9-9b09-6e2979a309b4, size 1024.00 MB, duration 5.56 sec, destination /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-36b84d1c-8875-4981-bafd-bb9631e08794 {{(pid=84448) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 15:19:11 devstack cinder-volume[84448]: INFO cinder.image.image_utils [None req-d01dd773-3aa5-49d9-8d37-e857fc349213 tempest-GroupSnapshotsTest-1515970109 None] Converted 1024.00 MB image at 184.09 MB/s Apr 29 15:19:11 devstack cinder-volume[84448]: WARNING cinder.volume.drivers.remotefs [None req-d01dd773-3aa5-49d9-8d37-e857fc349213 tempest-GroupSnapshotsTest-1515970109 None] /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-36b84d1c-8875-4981-bafd-bb9631e08794 is being set with open permissions: ugo+rw: NotImplementedError Apr 29 15:19:11 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-d01dd773-3aa5-49d9-8d37-e857fc349213 tempest-GroupSnapshotsTest-1515970109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-36b84d1c-8875-4981-bafd-bb9631e08794 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:11 devstack sudo[100102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-36b84d1c-8875-4981-bafd-bb9631e08794 Apr 29 15:19:11 devstack sudo[100102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:12 devstack sudo[100102]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:12 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-d01dd773-3aa5-49d9-8d37-e857fc349213 tempest-GroupSnapshotsTest-1515970109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-36b84d1c-8875-4981-bafd-bb9631e08794" returned: 0 in 0.579s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:12 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-d01dd773-3aa5-49d9-8d37-e857fc349213 tempest-GroupSnapshotsTest-1515970109 None] Lock "cinder-quobyte-36b84d1c-8875-4981-bafd-bb9631e08794" released by "_copy_volume_from_snapshot" :: held 8.627s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:19:12 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-d01dd773-3aa5-49d9-8d37-e857fc349213 tempest-GroupSnapshotsTest-1515970109 None] Lock "cinder-quobyte-9311cdb0-7c9f-4ca1-91ec-a07257100bbf-36b84d1c-8875-4981-bafd-bb9631e08794" released by "_create_volume_from_snapshot" :: held 8.664s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:19:12 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-d01dd773-3aa5-49d9-8d37-e857fc349213 tempest-GroupSnapshotsTest-1515970109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.688s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:19:12 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-f45db8a4-0f76-43e3-88ef-285f11f7e0a3 tempest-VolumesGetTest-1959119330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.822s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:19:12 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-f45db8a4-0f76-43e3-88ef-285f11f7e0a3 tempest-VolumesGetTest-1959119330 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:19:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-938274997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34573540-a969-489a-b684-72b056052d23,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f869a6d249654e13be76ee6a847e4481',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:19:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:19:06Z,use_quota=True,user_id='fbb2502dd9b544f5b144418f0bfe579a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:19:12 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-f45db8a4-0f76-43e3-88ef-285f11f7e0a3 tempest-VolumesGetTest-1959119330 None] Creating volume 34573540-a969-489a-b684-72b056052d23 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:19:12 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-f45db8a4-0f76-43e3-88ef-285f11f7e0a3 tempest-VolumesGetTest-1959119330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:19:12 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-f45db8a4-0f76-43e3-88ef-285f11f7e0a3 tempest-VolumesGetTest-1959119330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:19:12 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-f45db8a4-0f76-43e3-88ef-285f11f7e0a3 tempest-VolumesGetTest-1959119330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:19:12 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-f45db8a4-0f76-43e3-88ef-285f11f7e0a3 tempest-VolumesGetTest-1959119330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:19:12 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-f45db8a4-0f76-43e3-88ef-285f11f7e0a3 tempest-VolumesGetTest-1959119330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:19:12 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-f45db8a4-0f76-43e3-88ef-285f11f7e0a3 tempest-VolumesGetTest-1959119330 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:19:12 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-f45db8a4-0f76-43e3-88ef-285f11f7e0a3 tempest-VolumesGetTest-1959119330 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:19:12 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f45db8a4-0f76-43e3-88ef-285f11f7e0a3 tempest-VolumesGetTest-1959119330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-34573540-a969-489a-b684-72b056052d23 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:12 devstack sudo[100105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-34573540-a969-489a-b684-72b056052d23 1073741824 Apr 29 15:19:12 devstack sudo[100105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:12 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-d01dd773-3aa5-49d9-8d37-e857fc349213 tempest-GroupSnapshotsTest-1515970109 None] Create group from source-snapshot-49aacd2b-6e0b-4f6b-929e-22c271bfe2c3 completed successfully. Apr 29 15:19:13 devstack sudo[100105]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:13 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f45db8a4-0f76-43e3-88ef-285f11f7e0a3 tempest-VolumesGetTest-1959119330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-34573540-a969-489a-b684-72b056052d23 1073741824" returned: 0 in 0.776s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:13 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f45db8a4-0f76-43e3-88ef-285f11f7e0a3 tempest-VolumesGetTest-1959119330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-34573540-a969-489a-b684-72b056052d23 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:13 devstack sudo[100111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-34573540-a969-489a-b684-72b056052d23 Apr 29 15:19:13 devstack sudo[100111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:13 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-76e4c654-33ce-46f5-9815-9313ae5bc263 tempest-GroupSnapshotsTest-1515970109 None] Acquiring lock "cinder-quobyte-36b84d1c-8875-4981-bafd-bb9631e08794" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:19:13 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-76e4c654-33ce-46f5-9815-9313ae5bc263 tempest-GroupSnapshotsTest-1515970109 None] Lock "cinder-quobyte-36b84d1c-8875-4981-bafd-bb9631e08794" acquired by "delete_volume" :: waited 0.021s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:19:13 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[764a8de4-51bf-4d35-8147-cd947e7b6324]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:19:13 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-76e4c654-33ce-46f5-9815-9313ae5bc263 tempest-GroupSnapshotsTest-1515970109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-36b84d1c-8875-4981-bafd-bb9631e08794 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:13 devstack sudo[100111]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:13 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f45db8a4-0f76-43e3-88ef-285f11f7e0a3 tempest-VolumesGetTest-1959119330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-34573540-a969-489a-b684-72b056052d23" returned: 0 in 0.621s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:13 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-f45db8a4-0f76-43e3-88ef-285f11f7e0a3 tempest-VolumesGetTest-1959119330 None] <== create_volume: return (1432ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:19:13 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-f45db8a4-0f76-43e3-88ef-285f11f7e0a3 tempest-VolumesGetTest-1959119330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.435s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:19:13 devstack cinder-volume[84448]: DEBUG cinder.volume.volume_utils [None req-f45db8a4-0f76-43e3-88ef-285f11f7e0a3 tempest-VolumesGetTest-1959119330 None] Attempting download of ad86f424-7d2a-4f3b-9577-890075e7dc72 ((None, [{'url': 'file:///opt/stack/data/glance/images/ad86f424-7d2a-4f3b-9577-890075e7dc72', 'metadata': {}}])) to volume 34573540-a969-489a-b684-72b056052d23. {{(pid=84448) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 29 15:19:13 devstack sudo[100114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-36b84d1c-8875-4981-bafd-bb9631e08794 Apr 29 15:19:13 devstack sudo[100114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:13 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[e24bb170-b177-4ac5-8b4d-bf5c32467953]: (4, 'raw') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:19:13 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f45db8a4-0f76-43e3-88ef-285f11f7e0a3 tempest-VolumesGetTest-1959119330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ad86f424-7d2a-4f3b-9577-890075e7dc72_oy_b8t3i {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:13 devstack sudo[100116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ad86f424-7d2a-4f3b-9577-890075e7dc72_oy_b8t3i Apr 29 15:19:13 devstack sudo[100116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:14 devstack sudo[100114]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:14 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-76e4c654-33ce-46f5-9815-9313ae5bc263 tempest-GroupSnapshotsTest-1515970109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-36b84d1c-8875-4981-bafd-bb9631e08794" returned: 0 in 0.738s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:14 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-76e4c654-33ce-46f5-9815-9313ae5bc263 tempest-GroupSnapshotsTest-1515970109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-36b84d1c-8875-4981-bafd-bb9631e08794 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:14 devstack sudo[100123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-36b84d1c-8875-4981-bafd-bb9631e08794 Apr 29 15:19:14 devstack sudo[100123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:14 devstack sudo[100116]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:14 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f45db8a4-0f76-43e3-88ef-285f11f7e0a3 tempest-VolumesGetTest-1959119330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ad86f424-7d2a-4f3b-9577-890075e7dc72_oy_b8t3i" returned: 0 in 0.698s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:14 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f45db8a4-0f76-43e3-88ef-285f11f7e0a3 tempest-VolumesGetTest-1959119330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ad86f424-7d2a-4f3b-9577-890075e7dc72_oy_b8t3i {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:14 devstack sudo[100125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ad86f424-7d2a-4f3b-9577-890075e7dc72_oy_b8t3i Apr 29 15:19:14 devstack sudo[100125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:14 devstack sudo[100123]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:15 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-76e4c654-33ce-46f5-9815-9313ae5bc263 tempest-GroupSnapshotsTest-1515970109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-36b84d1c-8875-4981-bafd-bb9631e08794" returned: 0 in 0.597s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:15 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-76e4c654-33ce-46f5-9815-9313ae5bc263 tempest-GroupSnapshotsTest-1515970109 None] Lock "cinder-quobyte-36b84d1c-8875-4981-bafd-bb9631e08794" released by "delete_volume" :: held 1.375s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:19:15 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-76e4c654-33ce-46f5-9815-9313ae5bc263 tempest-GroupSnapshotsTest-1515970109 None] Created reservations ['003ccd59-1ce5-4c7e-8051-1b71b90e052a'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:19:15 devstack cinder-volume[84448]: WARNING cinder.quota [None req-76e4c654-33ce-46f5-9815-9313ae5bc263 tempest-GroupSnapshotsTest-1515970109 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-177764613 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-177764613, it is now deprecated. Please use the default quota class for default quota. Apr 29 15:19:15 devstack cinder-volume[84448]: WARNING cinder.quota [None req-76e4c654-33ce-46f5-9815-9313ae5bc263 tempest-GroupSnapshotsTest-1515970109 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-177764613 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-177764613, it is now deprecated. Please use the default quota class for default quota. Apr 29 15:19:15 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-76e4c654-33ce-46f5-9815-9313ae5bc263 tempest-GroupSnapshotsTest-1515970109 None] Created reservations ['be6d3760-efc0-4f55-b3ab-1bfea6c7c349', '0914b718-533c-45bd-95e2-70550d87016e', '0f409dda-1d40-4bad-b6ab-2e2c9c374d26', '4c769cd9-f9e2-4847-a819-4b5eeded1517'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:19:15 devstack sudo[100125]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:15 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f45db8a4-0f76-43e3-88ef-285f11f7e0a3 tempest-VolumesGetTest-1959119330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ad86f424-7d2a-4f3b-9577-890075e7dc72_oy_b8t3i" returned: 1 in 0.676s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:15 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f45db8a4-0f76-43e3-88ef-285f11f7e0a3 tempest-VolumesGetTest-1959119330 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ad86f424-7d2a-4f3b-9577-890075e7dc72_oy_b8t3i' failed. Not Retrying. {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 15:19:15 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f0c87d-9e7c-4fdc-b4d1-1b5c844b9527]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:19:15 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f45db8a4-0f76-43e3-88ef-285f11f7e0a3 tempest-VolumesGetTest-1959119330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_tnkwaededevstack@QuobyteHD {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:15 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-76e4c654-33ce-46f5-9815-9313ae5bc263 tempest-GroupSnapshotsTest-1515970109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:19:15 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-76e4c654-33ce-46f5-9815-9313ae5bc263 tempest-GroupSnapshotsTest-1515970109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:19:15 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-76e4c654-33ce-46f5-9815-9313ae5bc263 tempest-GroupSnapshotsTest-1515970109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:19:15 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-76e4c654-33ce-46f5-9815-9313ae5bc263 tempest-GroupSnapshotsTest-1515970109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:19:15 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-76e4c654-33ce-46f5-9815-9313ae5bc263 tempest-GroupSnapshotsTest-1515970109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:19:15 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-76e4c654-33ce-46f5-9815-9313ae5bc263 tempest-GroupSnapshotsTest-1515970109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:15 devstack sudo[100131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:19:15 devstack sudo[100131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:15 devstack sudo[100130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_tnkwaededevstack@QuobyteHD Apr 29 15:19:15 devstack sudo[100130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:15 devstack sudo[100131]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:15 devstack sudo[100130]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:15 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-76e4c654-33ce-46f5-9815-9313ae5bc263 tempest-GroupSnapshotsTest-1515970109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.605s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:15 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-76e4c654-33ce-46f5-9815-9313ae5bc263 tempest-GroupSnapshotsTest-1515970109 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:19:15 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f45db8a4-0f76-43e3-88ef-285f11f7e0a3 tempest-VolumesGetTest-1959119330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_tnkwaededevstack@QuobyteHD" returned: 0 in 0.704s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:15 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [None req-f45db8a4-0f76-43e3-88ef-285f11f7e0a3 tempest-VolumesGetTest-1959119330 None] ad86f424-7d2a-4f3b-9577-890075e7dc72 was qcow2, converting to raw {{(pid=84448) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 29 15:19:15 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f45db8a4-0f76-43e3-88ef-285f11f7e0a3 tempest-VolumesGetTest-1959119330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_tnkwaededevstack@QuobyteHD /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-34573540-a969-489a-b684-72b056052d23 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:15 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-76e4c654-33ce-46f5-9815-9313ae5bc263 tempest-GroupSnapshotsTest-1515970109 None] Delete group completed successfully. Apr 29 15:19:15 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-8b97c803-a2ae-4ca2-b742-3703c0299225 tempest-GroupSnapshotsTest-1515970109 None] group_snapshot 49aacd2b-6e0b-4f6b-929e-22c271bfe2c3: deleting Apr 29 15:19:15 devstack sudo[100139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_tnkwaededevstack@QuobyteHD /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-34573540-a969-489a-b684-72b056052d23 Apr 29 15:19:15 devstack sudo[100139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:15 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-8b97c803-a2ae-4ca2-b742-3703c0299225 tempest-GroupSnapshotsTest-1515970109 None] group_snapshot 49aacd2b-6e0b-4f6b-929e-22c271bfe2c3: deleting {{(pid=84448) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 29 15:19:15 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-8b97c803-a2ae-4ca2-b742-3703c0299225 tempest-GroupSnapshotsTest-1515970109 None] Acquiring lock "cinder-quobyte-cb328395-ebed-4da9-9b09-6e2979a309b4" by "delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:19:15 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-8b97c803-a2ae-4ca2-b742-3703c0299225 tempest-GroupSnapshotsTest-1515970109 None] Lock "cinder-quobyte-cb328395-ebed-4da9-9b09-6e2979a309b4" acquired by "delete_snapshot" :: waited 0.018s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:19:15 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-8b97c803-a2ae-4ca2-b742-3703c0299225 tempest-GroupSnapshotsTest-1515970109 None] Acquiring lock "cinder-quobyte-9311cdb0-7c9f-4ca1-91ec-a07257100bbf" by "_delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:19:16 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-8b97c803-a2ae-4ca2-b742-3703c0299225 tempest-GroupSnapshotsTest-1515970109 None] Lock "cinder-quobyte-9311cdb0-7c9f-4ca1-91ec-a07257100bbf" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:19:16 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-8b97c803-a2ae-4ca2-b742-3703c0299225 tempest-GroupSnapshotsTest-1515970109 None] Deleting offline snapshot 9311cdb0-7c9f-4ca1-91ec-a07257100bbf of volume cb328395-ebed-4da9-9b09-6e2979a309b4 {{(pid=84448) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 15:19:16 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-8b97c803-a2ae-4ca2-b742-3703c0299225 tempest-GroupSnapshotsTest-1515970109 None] snapshot_file for this snap is: volume-cb328395-ebed-4da9-9b09-6e2979a309b4.9311cdb0-7c9f-4ca1-91ec-a07257100bbf {{(pid=84448) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 15:19:16 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[47027e3e-7941-4c29-b613-0242351817d0]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:19:16 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-8b97c803-a2ae-4ca2-b742-3703c0299225 tempest-GroupSnapshotsTest-1515970109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cb328395-ebed-4da9-9b09-6e2979a309b4.9311cdb0-7c9f-4ca1-91ec-a07257100bbf {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:16 devstack sudo[100141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cb328395-ebed-4da9-9b09-6e2979a309b4.9311cdb0-7c9f-4ca1-91ec-a07257100bbf Apr 29 15:19:16 devstack sudo[100141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:16 devstack sudo[100141]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:16 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-8b97c803-a2ae-4ca2-b742-3703c0299225 tempest-GroupSnapshotsTest-1515970109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cb328395-ebed-4da9-9b09-6e2979a309b4.9311cdb0-7c9f-4ca1-91ec-a07257100bbf" returned: 0 in 0.783s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:16 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-8b97c803-a2ae-4ca2-b742-3703c0299225 tempest-GroupSnapshotsTest-1515970109 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb328395-ebed-4da9-9b09-6e2979a309b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84448) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 15:19:16 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[281033ab-08fe-4c5e-b892-b4f7266e98cb]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:19:16 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-8b97c803-a2ae-4ca2-b742-3703c0299225 tempest-GroupSnapshotsTest-1515970109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cb328395-ebed-4da9-9b09-6e2979a309b4 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:16 devstack sudo[100152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cb328395-ebed-4da9-9b09-6e2979a309b4 Apr 29 15:19:16 devstack sudo[100152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:17 devstack sudo[100152]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:17 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-8b97c803-a2ae-4ca2-b742-3703c0299225 tempest-GroupSnapshotsTest-1515970109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cb328395-ebed-4da9-9b09-6e2979a309b4" returned: 0 in 0.786s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:17 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-8b97c803-a2ae-4ca2-b742-3703c0299225 tempest-GroupSnapshotsTest-1515970109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cb328395-ebed-4da9-9b09-6e2979a309b4.9311cdb0-7c9f-4ca1-91ec-a07257100bbf {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:17 devstack sudo[100157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cb328395-ebed-4da9-9b09-6e2979a309b4.9311cdb0-7c9f-4ca1-91ec-a07257100bbf Apr 29 15:19:17 devstack sudo[100157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:17 devstack sudo[100139]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:17 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f45db8a4-0f76-43e3-88ef-285f11f7e0a3 tempest-VolumesGetTest-1959119330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_tnkwaededevstack@QuobyteHD /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-34573540-a969-489a-b684-72b056052d23" returned: 0 in 1.902s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:17 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [None req-f45db8a4-0f76-43e3-88ef-285f11f7e0a3 tempest-VolumesGetTest-1959119330 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_tnkwaededevstack@QuobyteHD, size 112.00 MB, duration 1.90 sec, destination /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-34573540-a969-489a-b684-72b056052d23 {{(pid=84448) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 15:19:17 devstack cinder-volume[84448]: INFO cinder.image.image_utils [None req-f45db8a4-0f76-43e3-88ef-285f11f7e0a3 tempest-VolumesGetTest-1959119330 None] Converted 112.00 MB image at 58.85 MB/s Apr 29 15:19:17 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f45db8a4-0f76-43e3-88ef-285f11f7e0a3 tempest-VolumesGetTest-1959119330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-34573540-a969-489a-b684-72b056052d23 1G {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:17 devstack sudo[100159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-34573540-a969-489a-b684-72b056052d23 1G Apr 29 15:19:17 devstack sudo[100159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:18 devstack sudo[100157]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:18 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-8b97c803-a2ae-4ca2-b742-3703c0299225 tempest-GroupSnapshotsTest-1515970109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cb328395-ebed-4da9-9b09-6e2979a309b4.9311cdb0-7c9f-4ca1-91ec-a07257100bbf" returned: 0 in 0.691s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:18 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-8b97c803-a2ae-4ca2-b742-3703c0299225 tempest-GroupSnapshotsTest-1515970109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cb328395-ebed-4da9-9b09-6e2979a309b4.9311cdb0-7c9f-4ca1-91ec-a07257100bbf {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:18 devstack sudo[100167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cb328395-ebed-4da9-9b09-6e2979a309b4.9311cdb0-7c9f-4ca1-91ec-a07257100bbf Apr 29 15:19:18 devstack sudo[100167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:18 devstack sudo[100159]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:18 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f45db8a4-0f76-43e3-88ef-285f11f7e0a3 tempest-VolumesGetTest-1959119330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-34573540-a969-489a-b684-72b056052d23 1G" returned: 0 in 0.664s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:18 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[c170f99d-47f2-415b-b2f7-376438b1b5b3]: (4, 'raw') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:19:18 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f45db8a4-0f76-43e3-88ef-285f11f7e0a3 tempest-VolumesGetTest-1959119330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-34573540-a969-489a-b684-72b056052d23 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:18 devstack sudo[100169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-34573540-a969-489a-b684-72b056052d23 Apr 29 15:19:18 devstack sudo[100169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:18 devstack sudo[100167]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:18 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-8b97c803-a2ae-4ca2-b742-3703c0299225 tempest-GroupSnapshotsTest-1515970109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cb328395-ebed-4da9-9b09-6e2979a309b4.9311cdb0-7c9f-4ca1-91ec-a07257100bbf" returned: 0 in 0.622s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:19 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-8b97c803-a2ae-4ca2-b742-3703c0299225 tempest-GroupSnapshotsTest-1515970109 None] Lock "cinder-quobyte-9311cdb0-7c9f-4ca1-91ec-a07257100bbf" released by "_delete_snapshot" :: held 3.025s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:19:19 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-8b97c803-a2ae-4ca2-b742-3703c0299225 tempest-GroupSnapshotsTest-1515970109 None] Lock "cinder-quobyte-cb328395-ebed-4da9-9b09-6e2979a309b4" released by "delete_snapshot" :: held 3.051s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:19:19 devstack cinder-volume[84448]: WARNING cinder.quota [None req-8b97c803-a2ae-4ca2-b742-3703c0299225 tempest-GroupSnapshotsTest-1515970109 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-177764613 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-177764613, it is now deprecated. Please use the default quota class for default quota. Apr 29 15:19:19 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-8b97c803-a2ae-4ca2-b742-3703c0299225 tempest-GroupSnapshotsTest-1515970109 None] Created reservations ['3309ba52-e346-4795-9053-00c0e970cc03', '26c39ea4-6efc-4b95-8d10-c34d772c3b35', '163b6972-2926-4b98-99c4-9bfeeb11e856', '207f78ab-c4c3-44dd-9506-5256f3203f78'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:19:19 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-8b97c803-a2ae-4ca2-b742-3703c0299225 tempest-GroupSnapshotsTest-1515970109 None] group_snapshot 49aacd2b-6e0b-4f6b-929e-22c271bfe2c3: deleted successfully Apr 29 15:19:19 devstack sudo[100169]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:19 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f45db8a4-0f76-43e3-88ef-285f11f7e0a3 tempest-VolumesGetTest-1959119330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-34573540-a969-489a-b684-72b056052d23" returned: 0 in 0.752s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:19 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f45db8a4-0f76-43e3-88ef-285f11f7e0a3 tempest-VolumesGetTest-1959119330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-34573540-a969-489a-b684-72b056052d23 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:19 devstack sudo[100174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-34573540-a969-489a-b684-72b056052d23 Apr 29 15:19:19 devstack sudo[100174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:19 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-c43ca416-1b2b-4b63-bbf9-700c78805c95 tempest-GroupSnapshotsTest-1515970109 None] Acquiring lock "cinder-quobyte-cb328395-ebed-4da9-9b09-6e2979a309b4" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:19:19 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-c43ca416-1b2b-4b63-bbf9-700c78805c95 tempest-GroupSnapshotsTest-1515970109 None] Lock "cinder-quobyte-cb328395-ebed-4da9-9b09-6e2979a309b4" acquired by "delete_volume" :: waited 0.026s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:19:19 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef2c834f-5751-49a6-97a4-11e0d1c9ce16]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:19:19 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c43ca416-1b2b-4b63-bbf9-700c78805c95 tempest-GroupSnapshotsTest-1515970109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cb328395-ebed-4da9-9b09-6e2979a309b4 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:19 devstack sudo[100176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cb328395-ebed-4da9-9b09-6e2979a309b4 Apr 29 15:19:19 devstack sudo[100176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:19 devstack sudo[100174]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:19 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f45db8a4-0f76-43e3-88ef-285f11f7e0a3 tempest-VolumesGetTest-1959119330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-34573540-a969-489a-b684-72b056052d23" returned: 1 in 0.741s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:19 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f45db8a4-0f76-43e3-88ef-285f11f7e0a3 tempest-VolumesGetTest-1959119330 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-34573540-a969-489a-b684-72b056052d23' failed. Not Retrying. {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 15:19:19 devstack cinder-volume[84448]: DEBUG cinder.volume.volume_utils [None req-f45db8a4-0f76-43e3-88ef-285f11f7e0a3 tempest-VolumesGetTest-1959119330 None] Downloaded image ad86f424-7d2a-4f3b-9577-890075e7dc72 ((None, [{'url': 'file:///opt/stack/data/glance/images/ad86f424-7d2a-4f3b-9577-890075e7dc72', 'metadata': {}}])) to volume 34573540-a969-489a-b684-72b056052d23 successfully. {{(pid=84448) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 29 15:19:19 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [None req-f45db8a4-0f76-43e3-88ef-285f11f7e0a3 tempest-VolumesGetTest-1959119330 None] Temporary image ad86f424-7d2a-4f3b-9577-890075e7dc72 for user fbb2502dd9b544f5b144418f0bfe579a is deleted. {{(pid=84448) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 29 15:19:19 devstack cinder-volume[84448]: DEBUG cinder.volume.volume_utils [None req-f45db8a4-0f76-43e3-88ef-285f11f7e0a3 tempest-VolumesGetTest-1959119330 None] Marking volume 34573540-a969-489a-b684-72b056052d23 as bootable. {{(pid=84448) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 29 15:19:20 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-f45db8a4-0f76-43e3-88ef-285f11f7e0a3 tempest-VolumesGetTest-1959119330 None] Copying metadata from image ad86f424-7d2a-4f3b-9577-890075e7dc72 to 34573540-a969-489a-b684-72b056052d23. {{(pid=84448) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 29 15:19:20 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-f45db8a4-0f76-43e3-88ef-285f11f7e0a3 tempest-VolumesGetTest-1959119330 None] Creating volume glance metadata for volume 34573540-a969-489a-b684-72b056052d23 backed by image ad86f424-7d2a-4f3b-9577-890075e7dc72 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'ad86f424-7d2a-4f3b-9577-890075e7dc72', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84448) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 29 15:19:20 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-f45db8a4-0f76-43e3-88ef-285f11f7e0a3 tempest-VolumesGetTest-1959119330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b7dd087-c5a0-4e58-9b65-0292137328bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34573540-a969-489a-b684-72b056052d23', 'volume_size': 1, 'image_id': 'ad86f424-7d2a-4f3b-9577-890075e7dc72', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ad86f424-7d2a-4f3b-9577-890075e7dc72', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '33db0ca5091747b1a3438d70bf53390c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ad86f424-7d2a-4f3b-9577-890075e7dc72', 'created_at': datetime.datetime(2026, 4, 29, 13, 0, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 13, 0, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ad86f424-7d2a-4f3b-9577-890075e7dc72/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:19:20 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-f45db8a4-0f76-43e3-88ef-285f11f7e0a3 tempest-VolumesGetTest-1959119330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd2fa9d3-c575-45a2-b4e5-6318d1512a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:19:20 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-f45db8a4-0f76-43e3-88ef-285f11f7e0a3 tempest-VolumesGetTest-1959119330 None] Volume volume-34573540-a969-489a-b684-72b056052d23 (34573540-a969-489a-b684-72b056052d23): created successfully Apr 29 15:19:20 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-f45db8a4-0f76-43e3-88ef-285f11f7e0a3 tempest-VolumesGetTest-1959119330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd2fa9d3-c575-45a2-b4e5-6318d1512a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:19:20 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-f45db8a4-0f76-43e3-88ef-285f11f7e0a3 tempest-VolumesGetTest-1959119330 None] Flow 'volume_create_manager' (bedd2c92-5bcb-4dc4-86eb-b6aa5a2b2791) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:19:20 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-f45db8a4-0f76-43e3-88ef-285f11f7e0a3 tempest-VolumesGetTest-1959119330 None] Created volume successfully. Apr 29 15:19:20 devstack sudo[100176]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:20 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c43ca416-1b2b-4b63-bbf9-700c78805c95 tempest-GroupSnapshotsTest-1515970109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cb328395-ebed-4da9-9b09-6e2979a309b4" returned: 0 in 0.730s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:20 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c43ca416-1b2b-4b63-bbf9-700c78805c95 tempest-GroupSnapshotsTest-1515970109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cb328395-ebed-4da9-9b09-6e2979a309b4 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:20 devstack sudo[100184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cb328395-ebed-4da9-9b09-6e2979a309b4 Apr 29 15:19:20 devstack sudo[100184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:20 devstack sudo[100184]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:20 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c43ca416-1b2b-4b63-bbf9-700c78805c95 tempest-GroupSnapshotsTest-1515970109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cb328395-ebed-4da9-9b09-6e2979a309b4" returned: 0 in 0.595s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:20 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-c43ca416-1b2b-4b63-bbf9-700c78805c95 tempest-GroupSnapshotsTest-1515970109 None] Lock "cinder-quobyte-cb328395-ebed-4da9-9b09-6e2979a309b4" released by "delete_volume" :: held 1.389s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:19:20 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-c43ca416-1b2b-4b63-bbf9-700c78805c95 tempest-GroupSnapshotsTest-1515970109 None] Created reservations ['c81dc6c2-ce03-4d95-b525-c6fb5d855a18'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:19:20 devstack cinder-volume[84448]: WARNING cinder.db.sqlalchemy.api [None req-c43ca416-1b2b-4b63-bbf9-700c78805c95 tempest-GroupSnapshotsTest-1515970109 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-177764613'] Apr 29 15:19:20 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-c43ca416-1b2b-4b63-bbf9-700c78805c95 tempest-GroupSnapshotsTest-1515970109 None] Created reservations ['6e23cfba-3077-4da6-96a1-82b05fa61380', 'b0a08247-f479-45d7-8c52-d75028a1e8a1', '288aa02c-30b8-4e1f-9fd2-b071b4d35b26', '6cbaf3c3-d0ac-4ba5-ab9f-7b282b5c6684'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:19:21 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-c43ca416-1b2b-4b63-bbf9-700c78805c95 tempest-GroupSnapshotsTest-1515970109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:19:21 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-c43ca416-1b2b-4b63-bbf9-700c78805c95 tempest-GroupSnapshotsTest-1515970109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:19:21 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-c43ca416-1b2b-4b63-bbf9-700c78805c95 tempest-GroupSnapshotsTest-1515970109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:19:21 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-c43ca416-1b2b-4b63-bbf9-700c78805c95 tempest-GroupSnapshotsTest-1515970109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:19:21 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-c43ca416-1b2b-4b63-bbf9-700c78805c95 tempest-GroupSnapshotsTest-1515970109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:19:21 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c43ca416-1b2b-4b63-bbf9-700c78805c95 tempest-GroupSnapshotsTest-1515970109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:21 devstack sudo[100187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:19:21 devstack sudo[100187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:21 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad95a1db-1ce0-49c3-a802-be6deccca676 tempest-VolumesGetTest-1959119330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:19:21 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-ad95a1db-1ce0-49c3-a802-be6deccca676 tempest-VolumesGetTest-1959119330 None] Flow 'volume_create_manager' (53f8dbc0-7f03-49ec-8493-690fff2b16f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:19:21 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-ad95a1db-1ce0-49c3-a802-be6deccca676 tempest-VolumesGetTest-1959119330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93ffb4f4-b249-4dbe-88e9-178f132904d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:19:21 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-ad95a1db-1ce0-49c3-a802-be6deccca676 tempest-VolumesGetTest-1959119330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93ffb4f4-b249-4dbe-88e9-178f132904d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:19:21Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-189186979',display_name='tempest-VolumesGetTest-Volume-1911038795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4ae3ab8-e273-4f50-846a-52086b0bef11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f869a6d249654e13be76ee6a847e4481',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:19:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:19:22Z,use_quota=True,user_id='fbb2502dd9b544f5b144418f0bfe579a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:19:21 devstack sudo[100187]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:21 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-ad95a1db-1ce0-49c3-a802-be6deccca676 tempest-VolumesGetTest-1959119330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (050126dd-4cd2-4468-9a66-699c732799c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:19:21 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-ad95a1db-1ce0-49c3-a802-be6deccca676 tempest-VolumesGetTest-1959119330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (050126dd-4cd2-4468-9a66-699c732799c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:19:21 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-ad95a1db-1ce0-49c3-a802-be6deccca676 tempest-VolumesGetTest-1959119330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0ee8f2a-a9a7-4c50-a2cf-18f700a96cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:19:21 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-ad95a1db-1ce0-49c3-a802-be6deccca676 tempest-VolumesGetTest-1959119330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0ee8f2a-a9a7-4c50-a2cf-18f700a96cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4ae3ab8-e273-4f50-846a-52086b0bef11', 'volume_name': 'volume-c4ae3ab8-e273-4f50-846a-52086b0bef11', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:19:21 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-ad95a1db-1ce0-49c3-a802-be6deccca676 tempest-VolumesGetTest-1959119330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78ddd6d6-e393-4c10-9ae9-44174a6deb3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:19:21 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-ad95a1db-1ce0-49c3-a802-be6deccca676 tempest-VolumesGetTest-1959119330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78ddd6d6-e393-4c10-9ae9-44174a6deb3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:19:21 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-ad95a1db-1ce0-49c3-a802-be6deccca676 tempest-VolumesGetTest-1959119330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f38580b-8f21-4892-bc3e-efb2b805aeb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:19:21 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-ad95a1db-1ce0-49c3-a802-be6deccca676 tempest-VolumesGetTest-1959119330 None] Volume c4ae3ab8-e273-4f50-846a-52086b0bef11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4ae3ab8-e273-4f50-846a-52086b0bef11', 'volume_size': 1} Apr 29 15:19:21 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-ad95a1db-1ce0-49c3-a802-be6deccca676 tempest-VolumesGetTest-1959119330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:19:21 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-ad95a1db-1ce0-49c3-a802-be6deccca676 tempest-VolumesGetTest-1959119330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:19:21 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-ad95a1db-1ce0-49c3-a802-be6deccca676 tempest-VolumesGetTest-1959119330 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:19:21Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-189186979',display_name='tempest-VolumesGetTest-Volume-1911038795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4ae3ab8-e273-4f50-846a-52086b0bef11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f869a6d249654e13be76ee6a847e4481',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:19:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:19:22Z,use_quota=True,user_id='fbb2502dd9b544f5b144418f0bfe579a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:19:21 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-ad95a1db-1ce0-49c3-a802-be6deccca676 tempest-VolumesGetTest-1959119330 None] Creating volume c4ae3ab8-e273-4f50-846a-52086b0bef11 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:19:21 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-ad95a1db-1ce0-49c3-a802-be6deccca676 tempest-VolumesGetTest-1959119330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:19:21 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-ad95a1db-1ce0-49c3-a802-be6deccca676 tempest-VolumesGetTest-1959119330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:19:21 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-ad95a1db-1ce0-49c3-a802-be6deccca676 tempest-VolumesGetTest-1959119330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:19:21 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-ad95a1db-1ce0-49c3-a802-be6deccca676 tempest-VolumesGetTest-1959119330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:19:21 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-ad95a1db-1ce0-49c3-a802-be6deccca676 tempest-VolumesGetTest-1959119330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:19:21 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-ad95a1db-1ce0-49c3-a802-be6deccca676 tempest-VolumesGetTest-1959119330 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:19:21 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-ad95a1db-1ce0-49c3-a802-be6deccca676 tempest-VolumesGetTest-1959119330 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:19:21 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ad95a1db-1ce0-49c3-a802-be6deccca676 tempest-VolumesGetTest-1959119330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c4ae3ab8-e273-4f50-846a-52086b0bef11 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:21 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c43ca416-1b2b-4b63-bbf9-700c78805c95 tempest-GroupSnapshotsTest-1515970109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.699s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:21 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-c43ca416-1b2b-4b63-bbf9-700c78805c95 tempest-GroupSnapshotsTest-1515970109 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:19:21 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-c43ca416-1b2b-4b63-bbf9-700c78805c95 tempest-GroupSnapshotsTest-1515970109 None] Delete group completed successfully. Apr 29 15:19:21 devstack sudo[100190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c4ae3ab8-e273-4f50-846a-52086b0bef11 1073741824 Apr 29 15:19:21 devstack sudo[100190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:22 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-50785c2e-3eb6-41e0-b38b-707b099cea7b tempest-GroupSnapshotsTest-1515970109 None] Group tempest-GroupSnapshotsTest-Group-1185643379: creating Apr 29 15:19:22 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-50785c2e-3eb6-41e0-b38b-707b099cea7b tempest-GroupSnapshotsTest-1515970109 None] Group tempest-GroupSnapshotsTest-Group-1185643379: created successfully Apr 29 15:19:22 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-50785c2e-3eb6-41e0-b38b-707b099cea7b tempest-GroupSnapshotsTest-1515970109 None] Create group completed successfully. Apr 29 15:19:22 devstack sudo[100190]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:22 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ad95a1db-1ce0-49c3-a802-be6deccca676 tempest-VolumesGetTest-1959119330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c4ae3ab8-e273-4f50-846a-52086b0bef11 1073741824" returned: 0 in 0.805s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:22 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ad95a1db-1ce0-49c3-a802-be6deccca676 tempest-VolumesGetTest-1959119330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c4ae3ab8-e273-4f50-846a-52086b0bef11 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:22 devstack sudo[100195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c4ae3ab8-e273-4f50-846a-52086b0bef11 Apr 29 15:19:22 devstack sudo[100195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:23 devstack sudo[100195]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:23 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ad95a1db-1ce0-49c3-a802-be6deccca676 tempest-VolumesGetTest-1959119330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c4ae3ab8-e273-4f50-846a-52086b0bef11" returned: 0 in 0.591s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:23 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-ad95a1db-1ce0-49c3-a802-be6deccca676 tempest-VolumesGetTest-1959119330 None] <== create_volume: return (1436ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:19:23 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-ad95a1db-1ce0-49c3-a802-be6deccca676 tempest-VolumesGetTest-1959119330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.438s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:19:23 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-ad95a1db-1ce0-49c3-a802-be6deccca676 tempest-VolumesGetTest-1959119330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f38580b-8f21-4892-bc3e-efb2b805aeb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4ae3ab8-e273-4f50-846a-52086b0bef11', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:19:23 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-ad95a1db-1ce0-49c3-a802-be6deccca676 tempest-VolumesGetTest-1959119330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bcf22de-f6f1-458c-b61c-2660399d2a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:19:23 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-ad95a1db-1ce0-49c3-a802-be6deccca676 tempest-VolumesGetTest-1959119330 None] Volume volume-c4ae3ab8-e273-4f50-846a-52086b0bef11 (c4ae3ab8-e273-4f50-846a-52086b0bef11): created successfully Apr 29 15:19:23 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-ad95a1db-1ce0-49c3-a802-be6deccca676 tempest-VolumesGetTest-1959119330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bcf22de-f6f1-458c-b61c-2660399d2a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:19:23 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-ad95a1db-1ce0-49c3-a802-be6deccca676 tempest-VolumesGetTest-1959119330 None] Flow 'volume_create_manager' (53f8dbc0-7f03-49ec-8493-690fff2b16f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:19:23 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-ad95a1db-1ce0-49c3-a802-be6deccca676 tempest-VolumesGetTest-1959119330 None] Created volume successfully. Apr 29 15:19:23 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-88f1788b-1cdf-41f9-b1d5-39157469f1c8 tempest-GroupSnapshotsTest-1515970109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:19:23 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-88f1788b-1cdf-41f9-b1d5-39157469f1c8 tempest-GroupSnapshotsTest-1515970109 None] Flow 'volume_create_manager' (57b8117f-7218-403f-982f-2ce0bec7e752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:19:23 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-88f1788b-1cdf-41f9-b1d5-39157469f1c8 tempest-GroupSnapshotsTest-1515970109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd2044ea-4a72-400f-a107-6dbe6d37f396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:19:23 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-88f1788b-1cdf-41f9-b1d5-39157469f1c8 tempest-GroupSnapshotsTest-1515970109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd2044ea-4a72-400f-a107-6dbe6d37f396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:19:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1907241121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5c276fbd-0409-40be-8e52-943e0c5402ef,host='devstack@QuobyteHD#QuobyteHD',id=42848a32-2461-428b-9beb-2e1e2747e99b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='148ea8123ca04d2bb37f71e331e6b6cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:19:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:19:24Z,use_quota=True,user_id='4f519a26b0c0480ebe4f6ff33fc56fd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b74fae3-4a54-4464-a2ea-435e2f028917),volume_type_id=9b74fae3-4a54-4464-a2ea-435e2f028917)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:19:23 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-88f1788b-1cdf-41f9-b1d5-39157469f1c8 tempest-GroupSnapshotsTest-1515970109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01c9702b-bf7e-4989-a8bf-83d6f33f19ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:19:23 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-88f1788b-1cdf-41f9-b1d5-39157469f1c8 tempest-GroupSnapshotsTest-1515970109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01c9702b-bf7e-4989-a8bf-83d6f33f19ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:19:23 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-88f1788b-1cdf-41f9-b1d5-39157469f1c8 tempest-GroupSnapshotsTest-1515970109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f20b9560-97ee-46b7-8d10-34ce6352cd82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:19:23 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-88f1788b-1cdf-41f9-b1d5-39157469f1c8 tempest-GroupSnapshotsTest-1515970109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f20b9560-97ee-46b7-8d10-34ce6352cd82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42848a32-2461-428b-9beb-2e1e2747e99b', 'volume_name': 'volume-42848a32-2461-428b-9beb-2e1e2747e99b', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:19:23 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-88f1788b-1cdf-41f9-b1d5-39157469f1c8 tempest-GroupSnapshotsTest-1515970109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (643a030e-0b88-4d5c-aeae-04acb2570141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:19:23 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-88f1788b-1cdf-41f9-b1d5-39157469f1c8 tempest-GroupSnapshotsTest-1515970109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (643a030e-0b88-4d5c-aeae-04acb2570141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:19:23 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-88f1788b-1cdf-41f9-b1d5-39157469f1c8 tempest-GroupSnapshotsTest-1515970109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7de3070e-6386-4455-838c-a40fc1adc74a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:19:23 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-88f1788b-1cdf-41f9-b1d5-39157469f1c8 tempest-GroupSnapshotsTest-1515970109 None] Volume 42848a32-2461-428b-9beb-2e1e2747e99b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42848a32-2461-428b-9beb-2e1e2747e99b', 'volume_size': 1} Apr 29 15:19:23 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-88f1788b-1cdf-41f9-b1d5-39157469f1c8 tempest-GroupSnapshotsTest-1515970109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:19:23 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-88f1788b-1cdf-41f9-b1d5-39157469f1c8 tempest-GroupSnapshotsTest-1515970109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:19:23 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-88f1788b-1cdf-41f9-b1d5-39157469f1c8 tempest-GroupSnapshotsTest-1515970109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5c276fbd-0409-40be-8e52-943e0c5402ef,created_at=2026-04-29T13:19:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1907241121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5c276fbd-0409-40be-8e52-943e0c5402ef,host='devstack@QuobyteHD#QuobyteHD',id=42848a32-2461-428b-9beb-2e1e2747e99b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='148ea8123ca04d2bb37f71e331e6b6cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:19:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:19:24Z,use_quota=True,user_id='4f519a26b0c0480ebe4f6ff33fc56fd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b74fae3-4a54-4464-a2ea-435e2f028917),volume_type_id=9b74fae3-4a54-4464-a2ea-435e2f028917)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:19:23 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-88f1788b-1cdf-41f9-b1d5-39157469f1c8 tempest-GroupSnapshotsTest-1515970109 None] Creating volume 42848a32-2461-428b-9beb-2e1e2747e99b {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:19:23 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-88f1788b-1cdf-41f9-b1d5-39157469f1c8 tempest-GroupSnapshotsTest-1515970109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:19:23 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-88f1788b-1cdf-41f9-b1d5-39157469f1c8 tempest-GroupSnapshotsTest-1515970109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:19:23 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-88f1788b-1cdf-41f9-b1d5-39157469f1c8 tempest-GroupSnapshotsTest-1515970109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:19:23 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-88f1788b-1cdf-41f9-b1d5-39157469f1c8 tempest-GroupSnapshotsTest-1515970109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:19:23 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-88f1788b-1cdf-41f9-b1d5-39157469f1c8 tempest-GroupSnapshotsTest-1515970109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:19:23 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-88f1788b-1cdf-41f9-b1d5-39157469f1c8 tempest-GroupSnapshotsTest-1515970109 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:19:23 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-88f1788b-1cdf-41f9-b1d5-39157469f1c8 tempest-GroupSnapshotsTest-1515970109 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:19:23 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-88f1788b-1cdf-41f9-b1d5-39157469f1c8 tempest-GroupSnapshotsTest-1515970109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-42848a32-2461-428b-9beb-2e1e2747e99b 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:23 devstack sudo[100198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-42848a32-2461-428b-9beb-2e1e2747e99b 1073741824 Apr 29 15:19:23 devstack sudo[100198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:23 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-d8ba87ba-1f43-41d1-aea5-7f4b946b70c7 tempest-VolumesGetTest-1959119330 None] Acquiring lock "cinder-c4ae3ab8-e273-4f50-846a-52086b0bef11-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:19:23 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-d8ba87ba-1f43-41d1-aea5-7f4b946b70c7 tempest-VolumesGetTest-1959119330 None] Lock "cinder-c4ae3ab8-e273-4f50-846a-52086b0bef11-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:19:24 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-d8ba87ba-1f43-41d1-aea5-7f4b946b70c7 tempest-VolumesGetTest-1959119330 None] Acquiring lock "cinder-quobyte-c4ae3ab8-e273-4f50-846a-52086b0bef11" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:19:24 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-d8ba87ba-1f43-41d1-aea5-7f4b946b70c7 tempest-VolumesGetTest-1959119330 None] Lock "cinder-quobyte-c4ae3ab8-e273-4f50-846a-52086b0bef11" acquired by "delete_volume" :: waited 0.014s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:19:24 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b7e049-6434-4f64-ae10-907f66d05064]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:19:24 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-d8ba87ba-1f43-41d1-aea5-7f4b946b70c7 tempest-VolumesGetTest-1959119330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c4ae3ab8-e273-4f50-846a-52086b0bef11 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:24 devstack sudo[100202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c4ae3ab8-e273-4f50-846a-52086b0bef11 Apr 29 15:19:24 devstack sudo[100202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:24 devstack sudo[100198]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:24 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-88f1788b-1cdf-41f9-b1d5-39157469f1c8 tempest-GroupSnapshotsTest-1515970109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-42848a32-2461-428b-9beb-2e1e2747e99b 1073741824" returned: 0 in 0.842s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:24 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-88f1788b-1cdf-41f9-b1d5-39157469f1c8 tempest-GroupSnapshotsTest-1515970109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-42848a32-2461-428b-9beb-2e1e2747e99b {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:24 devstack sudo[100207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-42848a32-2461-428b-9beb-2e1e2747e99b Apr 29 15:19:24 devstack sudo[100207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:24 devstack sudo[100202]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:24 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-d8ba87ba-1f43-41d1-aea5-7f4b946b70c7 tempest-VolumesGetTest-1959119330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c4ae3ab8-e273-4f50-846a-52086b0bef11" returned: 0 in 0.729s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:24 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-d8ba87ba-1f43-41d1-aea5-7f4b946b70c7 tempest-VolumesGetTest-1959119330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c4ae3ab8-e273-4f50-846a-52086b0bef11 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:24 devstack sudo[100212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c4ae3ab8-e273-4f50-846a-52086b0bef11 Apr 29 15:19:24 devstack sudo[100212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:25 devstack sudo[100207]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-88f1788b-1cdf-41f9-b1d5-39157469f1c8 tempest-GroupSnapshotsTest-1515970109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-42848a32-2461-428b-9beb-2e1e2747e99b" returned: 0 in 0.630s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:25 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-88f1788b-1cdf-41f9-b1d5-39157469f1c8 tempest-GroupSnapshotsTest-1515970109 None] <== create_volume: return (1515ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:19:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-88f1788b-1cdf-41f9-b1d5-39157469f1c8 tempest-GroupSnapshotsTest-1515970109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.517s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:19:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-88f1788b-1cdf-41f9-b1d5-39157469f1c8 tempest-GroupSnapshotsTest-1515970109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7de3070e-6386-4455-838c-a40fc1adc74a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42848a32-2461-428b-9beb-2e1e2747e99b', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:19:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-88f1788b-1cdf-41f9-b1d5-39157469f1c8 tempest-GroupSnapshotsTest-1515970109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0273c4ca-70bb-46b6-91f0-22f50680ef5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:19:25 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-88f1788b-1cdf-41f9-b1d5-39157469f1c8 tempest-GroupSnapshotsTest-1515970109 None] Volume volume-42848a32-2461-428b-9beb-2e1e2747e99b (42848a32-2461-428b-9beb-2e1e2747e99b): created successfully Apr 29 15:19:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-88f1788b-1cdf-41f9-b1d5-39157469f1c8 tempest-GroupSnapshotsTest-1515970109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0273c4ca-70bb-46b6-91f0-22f50680ef5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:19:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-88f1788b-1cdf-41f9-b1d5-39157469f1c8 tempest-GroupSnapshotsTest-1515970109 None] Flow 'volume_create_manager' (57b8117f-7218-403f-982f-2ce0bec7e752) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:19:25 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-88f1788b-1cdf-41f9-b1d5-39157469f1c8 tempest-GroupSnapshotsTest-1515970109 None] Created volume successfully. Apr 29 15:19:25 devstack sudo[100212]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-d8ba87ba-1f43-41d1-aea5-7f4b946b70c7 tempest-VolumesGetTest-1959119330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c4ae3ab8-e273-4f50-846a-52086b0bef11" returned: 0 in 0.597s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:25 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-d8ba87ba-1f43-41d1-aea5-7f4b946b70c7 tempest-VolumesGetTest-1959119330 None] Lock "cinder-quobyte-c4ae3ab8-e273-4f50-846a-52086b0bef11" released by "delete_volume" :: held 1.373s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:19:25 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-d8ba87ba-1f43-41d1-aea5-7f4b946b70c7 tempest-VolumesGetTest-1959119330 None] Created reservations ['1c145c25-2ddd-4ad0-b6ea-c69f893a3121', '41fec4d8-6db1-45a6-b58f-6348866cc8d2', 'bf578af7-4c83-479b-825c-c2fc8a71e7c9', '70653285-6dd6-4347-bfc1-02fe5ab176f1'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:19:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-d8ba87ba-1f43-41d1-aea5-7f4b946b70c7 tempest-VolumesGetTest-1959119330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:19:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-d8ba87ba-1f43-41d1-aea5-7f4b946b70c7 tempest-VolumesGetTest-1959119330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:19:25 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-d8ba87ba-1f43-41d1-aea5-7f4b946b70c7 tempest-VolumesGetTest-1959119330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:19:25 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-d8ba87ba-1f43-41d1-aea5-7f4b946b70c7 tempest-VolumesGetTest-1959119330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:19:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-d8ba87ba-1f43-41d1-aea5-7f4b946b70c7 tempest-VolumesGetTest-1959119330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:19:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-d8ba87ba-1f43-41d1-aea5-7f4b946b70c7 tempest-VolumesGetTest-1959119330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:25 devstack sudo[100217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:19:25 devstack sudo[100217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:26 devstack sudo[100217]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-d8ba87ba-1f43-41d1-aea5-7f4b946b70c7 tempest-VolumesGetTest-1959119330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.594s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:26 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-d8ba87ba-1f43-41d1-aea5-7f4b946b70c7 tempest-VolumesGetTest-1959119330 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:19:26 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-d8ba87ba-1f43-41d1-aea5-7f4b946b70c7 tempest-VolumesGetTest-1959119330 None] Deleted volume successfully. Apr 29 15:19:26 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-d8ba87ba-1f43-41d1-aea5-7f4b946b70c7 tempest-VolumesGetTest-1959119330 None] Lock "cinder-c4ae3ab8-e273-4f50-846a-52086b0bef11-delete_volume" released by "delete_volume" :: held 2.182s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:19:26 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fba7b8f-1766-44a2-95d8-54940f105f24 tempest-GroupSnapshotsTest-1515970109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:19:26 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4fba7b8f-1766-44a2-95d8-54940f105f24 tempest-GroupSnapshotsTest-1515970109 None] Flow 'volume_create_manager' (a525e473-5d97-4687-af11-e6429d4df0bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:19:26 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4fba7b8f-1766-44a2-95d8-54940f105f24 tempest-GroupSnapshotsTest-1515970109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1526303e-9f1e-4bf5-8a41-10b807ef5aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:19:26 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-47748a7b-433c-48ef-a0c0-cd11382cb40f tempest-VolumesGetTest-1959119330 None] Acquiring lock "cinder-34573540-a969-489a-b684-72b056052d23-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:19:26 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4fba7b8f-1766-44a2-95d8-54940f105f24 tempest-GroupSnapshotsTest-1515970109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1526303e-9f1e-4bf5-8a41-10b807ef5aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:19:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-555385418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5c276fbd-0409-40be-8e52-943e0c5402ef,host='devstack@QuobyteHD#QuobyteHD',id=055d9f73-8cd1-4175-b2e1-1c88fa3714c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='148ea8123ca04d2bb37f71e331e6b6cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:19:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:19:26Z,use_quota=True,user_id='4f519a26b0c0480ebe4f6ff33fc56fd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b74fae3-4a54-4464-a2ea-435e2f028917),volume_type_id=9b74fae3-4a54-4464-a2ea-435e2f028917)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:19:26 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4fba7b8f-1766-44a2-95d8-54940f105f24 tempest-GroupSnapshotsTest-1515970109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f7a492d-d992-4c3a-a4f6-0aec8c345ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:19:26 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4fba7b8f-1766-44a2-95d8-54940f105f24 tempest-GroupSnapshotsTest-1515970109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f7a492d-d992-4c3a-a4f6-0aec8c345ec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:19:26 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4fba7b8f-1766-44a2-95d8-54940f105f24 tempest-GroupSnapshotsTest-1515970109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82d8a2c2-10a8-46d2-8cbe-452157299c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:19:26 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4fba7b8f-1766-44a2-95d8-54940f105f24 tempest-GroupSnapshotsTest-1515970109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82d8a2c2-10a8-46d2-8cbe-452157299c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '055d9f73-8cd1-4175-b2e1-1c88fa3714c1', 'volume_name': 'volume-055d9f73-8cd1-4175-b2e1-1c88fa3714c1', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:19:26 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4fba7b8f-1766-44a2-95d8-54940f105f24 tempest-GroupSnapshotsTest-1515970109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bac9e71d-6bfa-4153-ae37-57cb8f4c50ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:19:26 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4fba7b8f-1766-44a2-95d8-54940f105f24 tempest-GroupSnapshotsTest-1515970109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bac9e71d-6bfa-4153-ae37-57cb8f4c50ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:19:26 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4fba7b8f-1766-44a2-95d8-54940f105f24 tempest-GroupSnapshotsTest-1515970109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9d3f9e9-9233-4c2a-9e26-c14b4561bee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:19:26 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-4fba7b8f-1766-44a2-95d8-54940f105f24 tempest-GroupSnapshotsTest-1515970109 None] Volume 055d9f73-8cd1-4175-b2e1-1c88fa3714c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-055d9f73-8cd1-4175-b2e1-1c88fa3714c1', 'volume_size': 1} Apr 29 15:19:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-4fba7b8f-1766-44a2-95d8-54940f105f24 tempest-GroupSnapshotsTest-1515970109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:19:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-4fba7b8f-1766-44a2-95d8-54940f105f24 tempest-GroupSnapshotsTest-1515970109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:19:26 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-4fba7b8f-1766-44a2-95d8-54940f105f24 tempest-GroupSnapshotsTest-1515970109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5c276fbd-0409-40be-8e52-943e0c5402ef,created_at=2026-04-29T13:19:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-555385418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5c276fbd-0409-40be-8e52-943e0c5402ef,host='devstack@QuobyteHD#QuobyteHD',id=055d9f73-8cd1-4175-b2e1-1c88fa3714c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='148ea8123ca04d2bb37f71e331e6b6cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:19:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:19:26Z,use_quota=True,user_id='4f519a26b0c0480ebe4f6ff33fc56fd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b74fae3-4a54-4464-a2ea-435e2f028917),volume_type_id=9b74fae3-4a54-4464-a2ea-435e2f028917)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:19:26 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-4fba7b8f-1766-44a2-95d8-54940f105f24 tempest-GroupSnapshotsTest-1515970109 None] Creating volume 055d9f73-8cd1-4175-b2e1-1c88fa3714c1 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:19:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-4fba7b8f-1766-44a2-95d8-54940f105f24 tempest-GroupSnapshotsTest-1515970109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:19:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-4fba7b8f-1766-44a2-95d8-54940f105f24 tempest-GroupSnapshotsTest-1515970109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:19:26 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-4fba7b8f-1766-44a2-95d8-54940f105f24 tempest-GroupSnapshotsTest-1515970109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:19:26 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-4fba7b8f-1766-44a2-95d8-54940f105f24 tempest-GroupSnapshotsTest-1515970109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:19:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-4fba7b8f-1766-44a2-95d8-54940f105f24 tempest-GroupSnapshotsTest-1515970109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:19:26 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-4fba7b8f-1766-44a2-95d8-54940f105f24 tempest-GroupSnapshotsTest-1515970109 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:19:26 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-4fba7b8f-1766-44a2-95d8-54940f105f24 tempest-GroupSnapshotsTest-1515970109 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:19:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-4fba7b8f-1766-44a2-95d8-54940f105f24 tempest-GroupSnapshotsTest-1515970109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-055d9f73-8cd1-4175-b2e1-1c88fa3714c1 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:26 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-47748a7b-433c-48ef-a0c0-cd11382cb40f tempest-VolumesGetTest-1959119330 None] Lock "cinder-34573540-a969-489a-b684-72b056052d23-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:19:26 devstack sudo[100220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-055d9f73-8cd1-4175-b2e1-1c88fa3714c1 1073741824 Apr 29 15:19:26 devstack sudo[100220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:26 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-47748a7b-433c-48ef-a0c0-cd11382cb40f tempest-VolumesGetTest-1959119330 None] Acquiring lock "cinder-quobyte-34573540-a969-489a-b684-72b056052d23" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:19:26 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-47748a7b-433c-48ef-a0c0-cd11382cb40f tempest-VolumesGetTest-1959119330 None] Lock "cinder-quobyte-34573540-a969-489a-b684-72b056052d23" acquired by "delete_volume" :: waited 0.018s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:19:26 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0eaeffb-fdd3-4d19-b5e9-a9390c526d9f]: (4, 'raw') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:19:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-47748a7b-433c-48ef-a0c0-cd11382cb40f tempest-VolumesGetTest-1959119330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-34573540-a969-489a-b684-72b056052d23 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:26 devstack sudo[100222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-34573540-a969-489a-b684-72b056052d23 Apr 29 15:19:26 devstack sudo[100222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:27 devstack sudo[100220]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-4fba7b8f-1766-44a2-95d8-54940f105f24 tempest-GroupSnapshotsTest-1515970109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-055d9f73-8cd1-4175-b2e1-1c88fa3714c1 1073741824" returned: 0 in 0.798s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-4fba7b8f-1766-44a2-95d8-54940f105f24 tempest-GroupSnapshotsTest-1515970109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-055d9f73-8cd1-4175-b2e1-1c88fa3714c1 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:27 devstack sudo[100229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-055d9f73-8cd1-4175-b2e1-1c88fa3714c1 Apr 29 15:19:27 devstack sudo[100222]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:27 devstack sudo[100229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-47748a7b-433c-48ef-a0c0-cd11382cb40f tempest-VolumesGetTest-1959119330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-34573540-a969-489a-b684-72b056052d23" returned: 0 in 0.741s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-47748a7b-433c-48ef-a0c0-cd11382cb40f tempest-VolumesGetTest-1959119330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-34573540-a969-489a-b684-72b056052d23 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:27 devstack sudo[100231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-34573540-a969-489a-b684-72b056052d23 Apr 29 15:19:27 devstack sudo[100231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:27 devstack sudo[100229]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-4fba7b8f-1766-44a2-95d8-54940f105f24 tempest-GroupSnapshotsTest-1515970109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-055d9f73-8cd1-4175-b2e1-1c88fa3714c1" returned: 0 in 0.632s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:27 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-4fba7b8f-1766-44a2-95d8-54940f105f24 tempest-GroupSnapshotsTest-1515970109 None] <== create_volume: return (1474ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:19:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-4fba7b8f-1766-44a2-95d8-54940f105f24 tempest-GroupSnapshotsTest-1515970109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.476s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:19:27 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4fba7b8f-1766-44a2-95d8-54940f105f24 tempest-GroupSnapshotsTest-1515970109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9d3f9e9-9233-4c2a-9e26-c14b4561bee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-055d9f73-8cd1-4175-b2e1-1c88fa3714c1', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:19:27 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4fba7b8f-1766-44a2-95d8-54940f105f24 tempest-GroupSnapshotsTest-1515970109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59465f67-d015-46d9-b7a4-5cb09299cb88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:19:27 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-4fba7b8f-1766-44a2-95d8-54940f105f24 tempest-GroupSnapshotsTest-1515970109 None] Volume volume-055d9f73-8cd1-4175-b2e1-1c88fa3714c1 (055d9f73-8cd1-4175-b2e1-1c88fa3714c1): created successfully Apr 29 15:19:27 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4fba7b8f-1766-44a2-95d8-54940f105f24 tempest-GroupSnapshotsTest-1515970109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59465f67-d015-46d9-b7a4-5cb09299cb88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:19:27 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4fba7b8f-1766-44a2-95d8-54940f105f24 tempest-GroupSnapshotsTest-1515970109 None] Flow 'volume_create_manager' (a525e473-5d97-4687-af11-e6429d4df0bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:19:27 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-4fba7b8f-1766-44a2-95d8-54940f105f24 tempest-GroupSnapshotsTest-1515970109 None] Created volume successfully. Apr 29 15:19:27 devstack sudo[100231]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-47748a7b-433c-48ef-a0c0-cd11382cb40f tempest-VolumesGetTest-1959119330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-34573540-a969-489a-b684-72b056052d23" returned: 1 in 0.764s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-47748a7b-433c-48ef-a0c0-cd11382cb40f tempest-VolumesGetTest-1959119330 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-34573540-a969-489a-b684-72b056052d23' failed. Not Retrying. {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 15:19:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-47748a7b-433c-48ef-a0c0-cd11382cb40f tempest-VolumesGetTest-1959119330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-34573540-a969-489a-b684-72b056052d23 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:27 devstack sudo[100237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-34573540-a969-489a-b684-72b056052d23 Apr 29 15:19:27 devstack sudo[100237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:28 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-040e9e5b-b9bb-464d-bc5d-b346de63b924 tempest-GroupSnapshotsTest-1515970109 None] Update group completed successfully. Apr 29 15:19:28 devstack sudo[100237]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-47748a7b-433c-48ef-a0c0-cd11382cb40f tempest-VolumesGetTest-1959119330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-34573540-a969-489a-b684-72b056052d23" returned: 0 in 0.692s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:28 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-47748a7b-433c-48ef-a0c0-cd11382cb40f tempest-VolumesGetTest-1959119330 None] Lock "cinder-quobyte-34573540-a969-489a-b684-72b056052d23" released by "delete_volume" :: held 2.271s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:19:28 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-47748a7b-433c-48ef-a0c0-cd11382cb40f tempest-VolumesGetTest-1959119330 None] Created reservations ['7e2b4030-a72a-48cb-9901-03b7cdabf4bf', 'd215e89b-0e7b-4c07-a0a9-8a1574eedee6', 'c7b00dce-e958-4461-a1dc-d5fd209769eb', '5db41484-5918-4064-9f53-1e0bd4920b54'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:19:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-47748a7b-433c-48ef-a0c0-cd11382cb40f tempest-VolumesGetTest-1959119330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:19:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-47748a7b-433c-48ef-a0c0-cd11382cb40f tempest-VolumesGetTest-1959119330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:19:28 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-47748a7b-433c-48ef-a0c0-cd11382cb40f tempest-VolumesGetTest-1959119330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:19:28 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-47748a7b-433c-48ef-a0c0-cd11382cb40f tempest-VolumesGetTest-1959119330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:19:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-47748a7b-433c-48ef-a0c0-cd11382cb40f tempest-VolumesGetTest-1959119330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:19:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-47748a7b-433c-48ef-a0c0-cd11382cb40f tempest-VolumesGetTest-1959119330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:28 devstack sudo[100276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:19:28 devstack sudo[100276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:29 devstack sudo[100276]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-47748a7b-433c-48ef-a0c0-cd11382cb40f tempest-VolumesGetTest-1959119330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.595s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:29 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-47748a7b-433c-48ef-a0c0-cd11382cb40f tempest-VolumesGetTest-1959119330 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:19:29 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-47748a7b-433c-48ef-a0c0-cd11382cb40f tempest-VolumesGetTest-1959119330 None] Deleted volume successfully. Apr 29 15:19:29 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-47748a7b-433c-48ef-a0c0-cd11382cb40f tempest-VolumesGetTest-1959119330 None] Lock "cinder-34573540-a969-489a-b684-72b056052d23-delete_volume" released by "delete_volume" :: held 3.053s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:19:29 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-afc6f858-787d-44e8-b78b-8e88bbc63fe5 tempest-GroupSnapshotsTest-1515970109 None] Update group completed successfully. Apr 29 15:19:30 devstack cinder-volume[84448]: DEBUG oslo_service.periodic_task [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84448) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 15:19:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:19:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:19:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:19:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:19:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:19:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:30 devstack sudo[100279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:19:30 devstack sudo[100279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:30 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-cf894ff4-9102-4167-87f7-1fe6f26e78ce tempest-GroupSnapshotsTest-1515970109 None] Update group completed successfully. Apr 29 15:19:31 devstack sudo[100279]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.682s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:31 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:19:32 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-23263119-759d-474a-98a4-23ea0fedd0a3 tempest-GroupSnapshotsTest-1515970109 None] Update group completed successfully. Apr 29 15:19:33 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-787c229e-b1f1-4bfe-8433-ae1d4dac4464 tempest-GroupSnapshotsTest-1515970109 None] GroupSnapshot 7379588b-ab31-4578-b312-5822a8ba2630: creating. Apr 29 15:19:33 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-787c229e-b1f1-4bfe-8433-ae1d4dac4464 tempest-GroupSnapshotsTest-1515970109 None] Group snapshot 7379588b-ab31-4578-b312-5822a8ba2630: creating. {{(pid=84448) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 29 15:19:33 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-787c229e-b1f1-4bfe-8433-ae1d4dac4464 tempest-GroupSnapshotsTest-1515970109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:19:33 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-787c229e-b1f1-4bfe-8433-ae1d4dac4464 tempest-GroupSnapshotsTest-1515970109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:19:33 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-787c229e-b1f1-4bfe-8433-ae1d4dac4464 tempest-GroupSnapshotsTest-1515970109 None] Creating offline snapshot 595aa7bf-93bf-4bc1-96c5-672bb2aa5b0c of volume 42848a32-2461-428b-9beb-2e1e2747e99b {{(pid=84448) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 15:19:33 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa227825-f560-451f-bb16-f27b0d4ff955]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:19:33 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-787c229e-b1f1-4bfe-8433-ae1d4dac4464 tempest-GroupSnapshotsTest-1515970109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-42848a32-2461-428b-9beb-2e1e2747e99b {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:33 devstack sudo[100316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-42848a32-2461-428b-9beb-2e1e2747e99b Apr 29 15:19:33 devstack sudo[100316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:34 devstack sudo[100316]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:34 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-787c229e-b1f1-4bfe-8433-ae1d4dac4464 tempest-GroupSnapshotsTest-1515970109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-42848a32-2461-428b-9beb-2e1e2747e99b" returned: 0 in 0.758s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:34 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-787c229e-b1f1-4bfe-8433-ae1d4dac4464 tempest-GroupSnapshotsTest-1515970109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-42848a32-2461-428b-9beb-2e1e2747e99b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-42848a32-2461-428b-9beb-2e1e2747e99b.595aa7bf-93bf-4bc1-96c5-672bb2aa5b0c 1G {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:34 devstack sudo[100321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-42848a32-2461-428b-9beb-2e1e2747e99b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-42848a32-2461-428b-9beb-2e1e2747e99b.595aa7bf-93bf-4bc1-96c5-672bb2aa5b0c 1G Apr 29 15:19:34 devstack sudo[100321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:35 devstack sudo[100321]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:35 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-787c229e-b1f1-4bfe-8433-ae1d4dac4464 tempest-GroupSnapshotsTest-1515970109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-42848a32-2461-428b-9beb-2e1e2747e99b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-42848a32-2461-428b-9beb-2e1e2747e99b.595aa7bf-93bf-4bc1-96c5-672bb2aa5b0c 1G" returned: 0 in 0.891s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:35 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-787c229e-b1f1-4bfe-8433-ae1d4dac4464 tempest-GroupSnapshotsTest-1515970109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42848a32-2461-428b-9beb-2e1e2747e99b -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-42848a32-2461-428b-9beb-2e1e2747e99b.595aa7bf-93bf-4bc1-96c5-672bb2aa5b0c {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:35 devstack sudo[100326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42848a32-2461-428b-9beb-2e1e2747e99b -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-42848a32-2461-428b-9beb-2e1e2747e99b.595aa7bf-93bf-4bc1-96c5-672bb2aa5b0c Apr 29 15:19:35 devstack sudo[100326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:35 devstack sudo[100326]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:35 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-787c229e-b1f1-4bfe-8433-ae1d4dac4464 tempest-GroupSnapshotsTest-1515970109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42848a32-2461-428b-9beb-2e1e2747e99b -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-42848a32-2461-428b-9beb-2e1e2747e99b.595aa7bf-93bf-4bc1-96c5-672bb2aa5b0c" returned: 0 in 0.679s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:35 devstack cinder-volume[84448]: WARNING cinder.volume.drivers.remotefs [None req-787c229e-b1f1-4bfe-8433-ae1d4dac4464 tempest-GroupSnapshotsTest-1515970109 None] /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-42848a32-2461-428b-9beb-2e1e2747e99b.595aa7bf-93bf-4bc1-96c5-672bb2aa5b0c is being set with open permissions: ugo+rw: NotImplementedError Apr 29 15:19:35 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-787c229e-b1f1-4bfe-8433-ae1d4dac4464 tempest-GroupSnapshotsTest-1515970109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-42848a32-2461-428b-9beb-2e1e2747e99b.595aa7bf-93bf-4bc1-96c5-672bb2aa5b0c {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:35 devstack sudo[100332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-42848a32-2461-428b-9beb-2e1e2747e99b.595aa7bf-93bf-4bc1-96c5-672bb2aa5b0c Apr 29 15:19:35 devstack sudo[100332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:36 devstack sudo[100332]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:36 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-787c229e-b1f1-4bfe-8433-ae1d4dac4464 tempest-GroupSnapshotsTest-1515970109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-42848a32-2461-428b-9beb-2e1e2747e99b.595aa7bf-93bf-4bc1-96c5-672bb2aa5b0c" returned: 0 in 0.722s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:36 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-787c229e-b1f1-4bfe-8433-ae1d4dac4464 tempest-GroupSnapshotsTest-1515970109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-42848a32-2461-428b-9beb-2e1e2747e99b.info {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:36 devstack sudo[100335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-42848a32-2461-428b-9beb-2e1e2747e99b.info Apr 29 15:19:36 devstack sudo[100335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:37 devstack sudo[100335]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-787c229e-b1f1-4bfe-8433-ae1d4dac4464 tempest-GroupSnapshotsTest-1515970109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-42848a32-2461-428b-9beb-2e1e2747e99b.info" returned: 0 in 0.669s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:37 devstack cinder-volume[84448]: WARNING cinder.volume.drivers.remotefs [None req-787c229e-b1f1-4bfe-8433-ae1d4dac4464 tempest-GroupSnapshotsTest-1515970109 None] /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-42848a32-2461-428b-9beb-2e1e2747e99b.info is being set with open permissions: ugo+rw: NotImplementedError Apr 29 15:19:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-787c229e-b1f1-4bfe-8433-ae1d4dac4464 tempest-GroupSnapshotsTest-1515970109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-42848a32-2461-428b-9beb-2e1e2747e99b.info {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:37 devstack sudo[100338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-42848a32-2461-428b-9beb-2e1e2747e99b.info Apr 29 15:19:37 devstack sudo[100338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:38 devstack sudo[100338]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-787c229e-b1f1-4bfe-8433-ae1d4dac4464 tempest-GroupSnapshotsTest-1515970109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-42848a32-2461-428b-9beb-2e1e2747e99b.info" returned: 0 in 0.734s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-787c229e-b1f1-4bfe-8433-ae1d4dac4464 tempest-GroupSnapshotsTest-1515970109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.549s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:19:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-787c229e-b1f1-4bfe-8433-ae1d4dac4464 tempest-GroupSnapshotsTest-1515970109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:19:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-787c229e-b1f1-4bfe-8433-ae1d4dac4464 tempest-GroupSnapshotsTest-1515970109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:19:38 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-787c229e-b1f1-4bfe-8433-ae1d4dac4464 tempest-GroupSnapshotsTest-1515970109 None] Creating offline snapshot bcfbf0c2-42e1-4f42-ad4d-09043a6fb229 of volume 055d9f73-8cd1-4175-b2e1-1c88fa3714c1 {{(pid=84448) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 15:19:38 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[adfc1e67-ef86-4c9f-8793-ed264a7ce14a]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:19:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-787c229e-b1f1-4bfe-8433-ae1d4dac4464 tempest-GroupSnapshotsTest-1515970109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-055d9f73-8cd1-4175-b2e1-1c88fa3714c1 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:38 devstack sudo[100341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-055d9f73-8cd1-4175-b2e1-1c88fa3714c1 Apr 29 15:19:38 devstack sudo[100341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:38 devstack sudo[100341]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-787c229e-b1f1-4bfe-8433-ae1d4dac4464 tempest-GroupSnapshotsTest-1515970109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-055d9f73-8cd1-4175-b2e1-1c88fa3714c1" returned: 0 in 0.738s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-787c229e-b1f1-4bfe-8433-ae1d4dac4464 tempest-GroupSnapshotsTest-1515970109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-055d9f73-8cd1-4175-b2e1-1c88fa3714c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-055d9f73-8cd1-4175-b2e1-1c88fa3714c1.bcfbf0c2-42e1-4f42-ad4d-09043a6fb229 1G {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:38 devstack sudo[100346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-055d9f73-8cd1-4175-b2e1-1c88fa3714c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-055d9f73-8cd1-4175-b2e1-1c88fa3714c1.bcfbf0c2-42e1-4f42-ad4d-09043a6fb229 1G Apr 29 15:19:38 devstack sudo[100346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:39 devstack sudo[100346]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:39 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-787c229e-b1f1-4bfe-8433-ae1d4dac4464 tempest-GroupSnapshotsTest-1515970109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-055d9f73-8cd1-4175-b2e1-1c88fa3714c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-055d9f73-8cd1-4175-b2e1-1c88fa3714c1.bcfbf0c2-42e1-4f42-ad4d-09043a6fb229 1G" returned: 0 in 0.795s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:39 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-787c229e-b1f1-4bfe-8433-ae1d4dac4464 tempest-GroupSnapshotsTest-1515970109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-055d9f73-8cd1-4175-b2e1-1c88fa3714c1 -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-055d9f73-8cd1-4175-b2e1-1c88fa3714c1.bcfbf0c2-42e1-4f42-ad4d-09043a6fb229 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:39 devstack sudo[100353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-055d9f73-8cd1-4175-b2e1-1c88fa3714c1 -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-055d9f73-8cd1-4175-b2e1-1c88fa3714c1.bcfbf0c2-42e1-4f42-ad4d-09043a6fb229 Apr 29 15:19:39 devstack sudo[100353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:40 devstack sudo[100353]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:40 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-787c229e-b1f1-4bfe-8433-ae1d4dac4464 tempest-GroupSnapshotsTest-1515970109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-055d9f73-8cd1-4175-b2e1-1c88fa3714c1 -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-055d9f73-8cd1-4175-b2e1-1c88fa3714c1.bcfbf0c2-42e1-4f42-ad4d-09043a6fb229" returned: 0 in 0.744s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:40 devstack cinder-volume[84448]: WARNING cinder.volume.drivers.remotefs [None req-787c229e-b1f1-4bfe-8433-ae1d4dac4464 tempest-GroupSnapshotsTest-1515970109 None] /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-055d9f73-8cd1-4175-b2e1-1c88fa3714c1.bcfbf0c2-42e1-4f42-ad4d-09043a6fb229 is being set with open permissions: ugo+rw: NotImplementedError Apr 29 15:19:40 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-787c229e-b1f1-4bfe-8433-ae1d4dac4464 tempest-GroupSnapshotsTest-1515970109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-055d9f73-8cd1-4175-b2e1-1c88fa3714c1.bcfbf0c2-42e1-4f42-ad4d-09043a6fb229 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:40 devstack sudo[100358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-055d9f73-8cd1-4175-b2e1-1c88fa3714c1.bcfbf0c2-42e1-4f42-ad4d-09043a6fb229 Apr 29 15:19:40 devstack sudo[100358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:40 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-3230f5b0-5c3f-47e9-ad13-f67f0cb3144f tempest-VolumesSnapshotTestJSON-1135480884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:19:40 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-3230f5b0-5c3f-47e9-ad13-f67f0cb3144f tempest-VolumesSnapshotTestJSON-1135480884 None] Flow 'volume_create_manager' (6f6c89f6-18b5-457c-b736-99cf1b872f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:19:40 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-3230f5b0-5c3f-47e9-ad13-f67f0cb3144f tempest-VolumesSnapshotTestJSON-1135480884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0424cfb5-d4b6-47ae-bf83-8a1662c479d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:19:40 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-3230f5b0-5c3f-47e9-ad13-f67f0cb3144f tempest-VolumesSnapshotTestJSON-1135480884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0424cfb5-d4b6-47ae-bf83-8a1662c479d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:19:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1530962192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8cd99a3-e297-4595-bda9-861fb8b99371,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e482872055f43a59a50317dcf761896',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:19:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:19:41Z,use_quota=True,user_id='38745d6b3d0b4b658fbbef2ced9dc889',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:19:40 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-3230f5b0-5c3f-47e9-ad13-f67f0cb3144f tempest-VolumesSnapshotTestJSON-1135480884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bddd8df-7a65-4172-be99-23507988e334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:19:40 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-3230f5b0-5c3f-47e9-ad13-f67f0cb3144f tempest-VolumesSnapshotTestJSON-1135480884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bddd8df-7a65-4172-be99-23507988e334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:19:40 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-3230f5b0-5c3f-47e9-ad13-f67f0cb3144f tempest-VolumesSnapshotTestJSON-1135480884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44eb1aa8-0c06-47d4-a447-2dc2912dad8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:19:40 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-3230f5b0-5c3f-47e9-ad13-f67f0cb3144f tempest-VolumesSnapshotTestJSON-1135480884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44eb1aa8-0c06-47d4-a447-2dc2912dad8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8cd99a3-e297-4595-bda9-861fb8b99371', 'volume_name': 'volume-a8cd99a3-e297-4595-bda9-861fb8b99371', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:19:40 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-3230f5b0-5c3f-47e9-ad13-f67f0cb3144f tempest-VolumesSnapshotTestJSON-1135480884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e20bd63-4ded-4c74-a899-f11edc23a4c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:19:40 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-3230f5b0-5c3f-47e9-ad13-f67f0cb3144f tempest-VolumesSnapshotTestJSON-1135480884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e20bd63-4ded-4c74-a899-f11edc23a4c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:19:40 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-3230f5b0-5c3f-47e9-ad13-f67f0cb3144f tempest-VolumesSnapshotTestJSON-1135480884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d1852a6-268c-4a54-99a3-b9d470da17d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:19:40 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-3230f5b0-5c3f-47e9-ad13-f67f0cb3144f tempest-VolumesSnapshotTestJSON-1135480884 None] Volume a8cd99a3-e297-4595-bda9-861fb8b99371: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8cd99a3-e297-4595-bda9-861fb8b99371', 'volume_size': 1} Apr 29 15:19:40 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-3230f5b0-5c3f-47e9-ad13-f67f0cb3144f tempest-VolumesSnapshotTestJSON-1135480884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:19:41 devstack sudo[100358]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-787c229e-b1f1-4bfe-8433-ae1d4dac4464 tempest-GroupSnapshotsTest-1515970109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-055d9f73-8cd1-4175-b2e1-1c88fa3714c1.bcfbf0c2-42e1-4f42-ad4d-09043a6fb229" returned: 0 in 0.598s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-787c229e-b1f1-4bfe-8433-ae1d4dac4464 tempest-GroupSnapshotsTest-1515970109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-055d9f73-8cd1-4175-b2e1-1c88fa3714c1.info {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:41 devstack sudo[100361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-055d9f73-8cd1-4175-b2e1-1c88fa3714c1.info Apr 29 15:19:41 devstack sudo[100361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:41 devstack sudo[100361]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-787c229e-b1f1-4bfe-8433-ae1d4dac4464 tempest-GroupSnapshotsTest-1515970109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-055d9f73-8cd1-4175-b2e1-1c88fa3714c1.info" returned: 0 in 0.597s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:41 devstack cinder-volume[84448]: WARNING cinder.volume.drivers.remotefs [None req-787c229e-b1f1-4bfe-8433-ae1d4dac4464 tempest-GroupSnapshotsTest-1515970109 None] /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-055d9f73-8cd1-4175-b2e1-1c88fa3714c1.info is being set with open permissions: ugo+rw: NotImplementedError Apr 29 15:19:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-787c229e-b1f1-4bfe-8433-ae1d4dac4464 tempest-GroupSnapshotsTest-1515970109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-055d9f73-8cd1-4175-b2e1-1c88fa3714c1.info {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:41 devstack sudo[100364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-055d9f73-8cd1-4175-b2e1-1c88fa3714c1.info Apr 29 15:19:41 devstack sudo[100364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:42 devstack sudo[100364]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:42 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-787c229e-b1f1-4bfe-8433-ae1d4dac4464 tempest-GroupSnapshotsTest-1515970109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-055d9f73-8cd1-4175-b2e1-1c88fa3714c1.info" returned: 0 in 0.595s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:42 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-787c229e-b1f1-4bfe-8433-ae1d4dac4464 tempest-GroupSnapshotsTest-1515970109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.160s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:19:42 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-3230f5b0-5c3f-47e9-ad13-f67f0cb3144f tempest-VolumesSnapshotTestJSON-1135480884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.427s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:19:42 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-3230f5b0-5c3f-47e9-ad13-f67f0cb3144f tempest-VolumesSnapshotTestJSON-1135480884 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:19:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1530962192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8cd99a3-e297-4595-bda9-861fb8b99371,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e482872055f43a59a50317dcf761896',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:19:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:19:41Z,use_quota=True,user_id='38745d6b3d0b4b658fbbef2ced9dc889',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:19:42 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-3230f5b0-5c3f-47e9-ad13-f67f0cb3144f tempest-VolumesSnapshotTestJSON-1135480884 None] Creating volume a8cd99a3-e297-4595-bda9-861fb8b99371 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:19:42 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-3230f5b0-5c3f-47e9-ad13-f67f0cb3144f tempest-VolumesSnapshotTestJSON-1135480884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:19:42 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-3230f5b0-5c3f-47e9-ad13-f67f0cb3144f tempest-VolumesSnapshotTestJSON-1135480884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:19:42 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-3230f5b0-5c3f-47e9-ad13-f67f0cb3144f tempest-VolumesSnapshotTestJSON-1135480884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:19:42 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-3230f5b0-5c3f-47e9-ad13-f67f0cb3144f tempest-VolumesSnapshotTestJSON-1135480884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:19:42 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-3230f5b0-5c3f-47e9-ad13-f67f0cb3144f tempest-VolumesSnapshotTestJSON-1135480884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:19:42 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-3230f5b0-5c3f-47e9-ad13-f67f0cb3144f tempest-VolumesSnapshotTestJSON-1135480884 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:19:42 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-3230f5b0-5c3f-47e9-ad13-f67f0cb3144f tempest-VolumesSnapshotTestJSON-1135480884 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:19:42 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-3230f5b0-5c3f-47e9-ad13-f67f0cb3144f tempest-VolumesSnapshotTestJSON-1135480884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a8cd99a3-e297-4595-bda9-861fb8b99371 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:42 devstack sudo[100368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a8cd99a3-e297-4595-bda9-861fb8b99371 1073741824 Apr 29 15:19:42 devstack sudo[100368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:42 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-787c229e-b1f1-4bfe-8433-ae1d4dac4464 tempest-GroupSnapshotsTest-1515970109 None] group_snapshot 7379588b-ab31-4578-b312-5822a8ba2630: created successfully Apr 29 15:19:43 devstack sudo[100368]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:43 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-3230f5b0-5c3f-47e9-ad13-f67f0cb3144f tempest-VolumesSnapshotTestJSON-1135480884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a8cd99a3-e297-4595-bda9-861fb8b99371 1073741824" returned: 0 in 0.809s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:43 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-559dbace-8f42-4090-a651-242296df5406 tempest-GroupSnapshotsTest-1515970109 None] group_snapshot 7379588b-ab31-4578-b312-5822a8ba2630: deleting Apr 29 15:19:43 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-3230f5b0-5c3f-47e9-ad13-f67f0cb3144f tempest-VolumesSnapshotTestJSON-1135480884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a8cd99a3-e297-4595-bda9-861fb8b99371 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:43 devstack sudo[100375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a8cd99a3-e297-4595-bda9-861fb8b99371 Apr 29 15:19:43 devstack sudo[100375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:43 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-559dbace-8f42-4090-a651-242296df5406 tempest-GroupSnapshotsTest-1515970109 None] group_snapshot 7379588b-ab31-4578-b312-5822a8ba2630: deleting {{(pid=84448) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 29 15:19:43 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-559dbace-8f42-4090-a651-242296df5406 tempest-GroupSnapshotsTest-1515970109 None] Acquiring lock "cinder-quobyte-42848a32-2461-428b-9beb-2e1e2747e99b" by "delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:19:43 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-559dbace-8f42-4090-a651-242296df5406 tempest-GroupSnapshotsTest-1515970109 None] Lock "cinder-quobyte-42848a32-2461-428b-9beb-2e1e2747e99b" acquired by "delete_snapshot" :: waited 0.017s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:19:43 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-559dbace-8f42-4090-a651-242296df5406 tempest-GroupSnapshotsTest-1515970109 None] Acquiring lock "cinder-quobyte-595aa7bf-93bf-4bc1-96c5-672bb2aa5b0c" by "_delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:19:43 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-559dbace-8f42-4090-a651-242296df5406 tempest-GroupSnapshotsTest-1515970109 None] Lock "cinder-quobyte-595aa7bf-93bf-4bc1-96c5-672bb2aa5b0c" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:19:43 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-559dbace-8f42-4090-a651-242296df5406 tempest-GroupSnapshotsTest-1515970109 None] Deleting offline snapshot 595aa7bf-93bf-4bc1-96c5-672bb2aa5b0c of volume 42848a32-2461-428b-9beb-2e1e2747e99b {{(pid=84448) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 15:19:43 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-559dbace-8f42-4090-a651-242296df5406 tempest-GroupSnapshotsTest-1515970109 None] snapshot_file for this snap is: volume-42848a32-2461-428b-9beb-2e1e2747e99b.595aa7bf-93bf-4bc1-96c5-672bb2aa5b0c {{(pid=84448) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 15:19:43 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[091b4a81-b8fd-4f04-ae4e-69397225f860]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:19:43 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-559dbace-8f42-4090-a651-242296df5406 tempest-GroupSnapshotsTest-1515970109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-42848a32-2461-428b-9beb-2e1e2747e99b.595aa7bf-93bf-4bc1-96c5-672bb2aa5b0c {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:43 devstack sudo[100377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-42848a32-2461-428b-9beb-2e1e2747e99b.595aa7bf-93bf-4bc1-96c5-672bb2aa5b0c Apr 29 15:19:43 devstack sudo[100377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:43 devstack sudo[100375]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:43 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-3230f5b0-5c3f-47e9-ad13-f67f0cb3144f tempest-VolumesSnapshotTestJSON-1135480884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a8cd99a3-e297-4595-bda9-861fb8b99371" returned: 0 in 0.647s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:43 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-3230f5b0-5c3f-47e9-ad13-f67f0cb3144f tempest-VolumesSnapshotTestJSON-1135480884 None] <== create_volume: return (1507ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:19:43 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-3230f5b0-5c3f-47e9-ad13-f67f0cb3144f tempest-VolumesSnapshotTestJSON-1135480884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.511s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:19:43 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-3230f5b0-5c3f-47e9-ad13-f67f0cb3144f tempest-VolumesSnapshotTestJSON-1135480884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d1852a6-268c-4a54-99a3-b9d470da17d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8cd99a3-e297-4595-bda9-861fb8b99371', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:19:43 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-3230f5b0-5c3f-47e9-ad13-f67f0cb3144f tempest-VolumesSnapshotTestJSON-1135480884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65e437a8-8996-4b83-8a1e-aecb5b8a90f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:19:43 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-3230f5b0-5c3f-47e9-ad13-f67f0cb3144f tempest-VolumesSnapshotTestJSON-1135480884 None] Volume volume-a8cd99a3-e297-4595-bda9-861fb8b99371 (a8cd99a3-e297-4595-bda9-861fb8b99371): created successfully Apr 29 15:19:43 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-3230f5b0-5c3f-47e9-ad13-f67f0cb3144f tempest-VolumesSnapshotTestJSON-1135480884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65e437a8-8996-4b83-8a1e-aecb5b8a90f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:19:43 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-3230f5b0-5c3f-47e9-ad13-f67f0cb3144f tempest-VolumesSnapshotTestJSON-1135480884 None] Flow 'volume_create_manager' (6f6c89f6-18b5-457c-b736-99cf1b872f79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:19:43 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-3230f5b0-5c3f-47e9-ad13-f67f0cb3144f tempest-VolumesSnapshotTestJSON-1135480884 None] Created volume successfully. Apr 29 15:19:44 devstack sudo[100377]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:44 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-559dbace-8f42-4090-a651-242296df5406 tempest-GroupSnapshotsTest-1515970109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-42848a32-2461-428b-9beb-2e1e2747e99b.595aa7bf-93bf-4bc1-96c5-672bb2aa5b0c" returned: 0 in 0.768s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:44 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-559dbace-8f42-4090-a651-242296df5406 tempest-GroupSnapshotsTest-1515970109 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-42848a32-2461-428b-9beb-2e1e2747e99b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84448) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 15:19:44 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e74a861-d1b3-42eb-a80f-3e79fefe8812]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:19:44 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-559dbace-8f42-4090-a651-242296df5406 tempest-GroupSnapshotsTest-1515970109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-42848a32-2461-428b-9beb-2e1e2747e99b {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:44 devstack sudo[100383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-42848a32-2461-428b-9beb-2e1e2747e99b Apr 29 15:19:44 devstack sudo[100383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:44 devstack sudo[100383]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:44 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-559dbace-8f42-4090-a651-242296df5406 tempest-GroupSnapshotsTest-1515970109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-42848a32-2461-428b-9beb-2e1e2747e99b" returned: 0 in 0.726s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:44 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-559dbace-8f42-4090-a651-242296df5406 tempest-GroupSnapshotsTest-1515970109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-42848a32-2461-428b-9beb-2e1e2747e99b.595aa7bf-93bf-4bc1-96c5-672bb2aa5b0c {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:44 devstack sudo[100389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-42848a32-2461-428b-9beb-2e1e2747e99b.595aa7bf-93bf-4bc1-96c5-672bb2aa5b0c Apr 29 15:19:44 devstack sudo[100389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:45 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-dd0120d4-1c3c-42fc-8327-902f2133cc11 tempest-VolumesSnapshotTestJSON-1135480884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:19:45 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-dd0120d4-1c3c-42fc-8327-902f2133cc11 tempest-VolumesSnapshotTestJSON-1135480884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:19:45 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-dd0120d4-1c3c-42fc-8327-902f2133cc11 tempest-VolumesSnapshotTestJSON-1135480884 None] Creating offline snapshot 8302c9cf-2522-4b91-9231-8e066508387d of volume a8cd99a3-e297-4595-bda9-861fb8b99371 {{(pid=84448) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 15:19:45 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb64e25-a229-4ec7-ac71-5883924e5821]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:19:45 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-dd0120d4-1c3c-42fc-8327-902f2133cc11 tempest-VolumesSnapshotTestJSON-1135480884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a8cd99a3-e297-4595-bda9-861fb8b99371 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:45 devstack sudo[100392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a8cd99a3-e297-4595-bda9-861fb8b99371 Apr 29 15:19:45 devstack sudo[100392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:45 devstack sudo[100389]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:45 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-559dbace-8f42-4090-a651-242296df5406 tempest-GroupSnapshotsTest-1515970109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-42848a32-2461-428b-9beb-2e1e2747e99b.595aa7bf-93bf-4bc1-96c5-672bb2aa5b0c" returned: 0 in 0.787s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:45 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-559dbace-8f42-4090-a651-242296df5406 tempest-GroupSnapshotsTest-1515970109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-42848a32-2461-428b-9beb-2e1e2747e99b.595aa7bf-93bf-4bc1-96c5-672bb2aa5b0c {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:45 devstack sudo[100399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-42848a32-2461-428b-9beb-2e1e2747e99b.595aa7bf-93bf-4bc1-96c5-672bb2aa5b0c Apr 29 15:19:45 devstack sudo[100399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:46 devstack sudo[100392]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:46 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-dd0120d4-1c3c-42fc-8327-902f2133cc11 tempest-VolumesSnapshotTestJSON-1135480884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a8cd99a3-e297-4595-bda9-861fb8b99371" returned: 0 in 0.826s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:46 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-dd0120d4-1c3c-42fc-8327-902f2133cc11 tempest-VolumesSnapshotTestJSON-1135480884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a8cd99a3-e297-4595-bda9-861fb8b99371,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a8cd99a3-e297-4595-bda9-861fb8b99371.8302c9cf-2522-4b91-9231-8e066508387d 1G {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:46 devstack sudo[100406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a8cd99a3-e297-4595-bda9-861fb8b99371,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a8cd99a3-e297-4595-bda9-861fb8b99371.8302c9cf-2522-4b91-9231-8e066508387d 1G Apr 29 15:19:46 devstack sudo[100406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:46 devstack sudo[100399]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:46 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-559dbace-8f42-4090-a651-242296df5406 tempest-GroupSnapshotsTest-1515970109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-42848a32-2461-428b-9beb-2e1e2747e99b.595aa7bf-93bf-4bc1-96c5-672bb2aa5b0c" returned: 0 in 0.624s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:46 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-559dbace-8f42-4090-a651-242296df5406 tempest-GroupSnapshotsTest-1515970109 None] Lock "cinder-quobyte-595aa7bf-93bf-4bc1-96c5-672bb2aa5b0c" released by "_delete_snapshot" :: held 3.014s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:19:46 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-559dbace-8f42-4090-a651-242296df5406 tempest-GroupSnapshotsTest-1515970109 None] Lock "cinder-quobyte-42848a32-2461-428b-9beb-2e1e2747e99b" released by "delete_snapshot" :: held 3.042s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:19:46 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-559dbace-8f42-4090-a651-242296df5406 tempest-GroupSnapshotsTest-1515970109 None] Acquiring lock "cinder-quobyte-055d9f73-8cd1-4175-b2e1-1c88fa3714c1" by "delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:19:46 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-559dbace-8f42-4090-a651-242296df5406 tempest-GroupSnapshotsTest-1515970109 None] Lock "cinder-quobyte-055d9f73-8cd1-4175-b2e1-1c88fa3714c1" acquired by "delete_snapshot" :: waited 0.014s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:19:46 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-559dbace-8f42-4090-a651-242296df5406 tempest-GroupSnapshotsTest-1515970109 None] Acquiring lock "cinder-quobyte-bcfbf0c2-42e1-4f42-ad4d-09043a6fb229" by "_delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:19:46 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-559dbace-8f42-4090-a651-242296df5406 tempest-GroupSnapshotsTest-1515970109 None] Lock "cinder-quobyte-bcfbf0c2-42e1-4f42-ad4d-09043a6fb229" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:19:46 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-559dbace-8f42-4090-a651-242296df5406 tempest-GroupSnapshotsTest-1515970109 None] Deleting offline snapshot bcfbf0c2-42e1-4f42-ad4d-09043a6fb229 of volume 055d9f73-8cd1-4175-b2e1-1c88fa3714c1 {{(pid=84448) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 15:19:46 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-559dbace-8f42-4090-a651-242296df5406 tempest-GroupSnapshotsTest-1515970109 None] snapshot_file for this snap is: volume-055d9f73-8cd1-4175-b2e1-1c88fa3714c1.bcfbf0c2-42e1-4f42-ad4d-09043a6fb229 {{(pid=84448) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 15:19:46 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2396e8c-581a-4074-8d8a-c3e11e940de4]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:19:46 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-559dbace-8f42-4090-a651-242296df5406 tempest-GroupSnapshotsTest-1515970109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-055d9f73-8cd1-4175-b2e1-1c88fa3714c1.bcfbf0c2-42e1-4f42-ad4d-09043a6fb229 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:46 devstack sudo[100408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-055d9f73-8cd1-4175-b2e1-1c88fa3714c1.bcfbf0c2-42e1-4f42-ad4d-09043a6fb229 Apr 29 15:19:46 devstack sudo[100408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:46 devstack sudo[100406]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:46 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-dd0120d4-1c3c-42fc-8327-902f2133cc11 tempest-VolumesSnapshotTestJSON-1135480884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a8cd99a3-e297-4595-bda9-861fb8b99371,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a8cd99a3-e297-4595-bda9-861fb8b99371.8302c9cf-2522-4b91-9231-8e066508387d 1G" returned: 0 in 0.756s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:46 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-dd0120d4-1c3c-42fc-8327-902f2133cc11 tempest-VolumesSnapshotTestJSON-1135480884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8cd99a3-e297-4595-bda9-861fb8b99371 -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a8cd99a3-e297-4595-bda9-861fb8b99371.8302c9cf-2522-4b91-9231-8e066508387d {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:46 devstack sudo[100413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8cd99a3-e297-4595-bda9-861fb8b99371 -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a8cd99a3-e297-4595-bda9-861fb8b99371.8302c9cf-2522-4b91-9231-8e066508387d Apr 29 15:19:46 devstack sudo[100413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:47 devstack sudo[100408]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:47 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-559dbace-8f42-4090-a651-242296df5406 tempest-GroupSnapshotsTest-1515970109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-055d9f73-8cd1-4175-b2e1-1c88fa3714c1.bcfbf0c2-42e1-4f42-ad4d-09043a6fb229" returned: 0 in 0.723s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:47 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-559dbace-8f42-4090-a651-242296df5406 tempest-GroupSnapshotsTest-1515970109 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-055d9f73-8cd1-4175-b2e1-1c88fa3714c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84448) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 15:19:47 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4325687-ab2c-4bd6-ba45-8de2efd76dc3]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:19:47 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-559dbace-8f42-4090-a651-242296df5406 tempest-GroupSnapshotsTest-1515970109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-055d9f73-8cd1-4175-b2e1-1c88fa3714c1 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:47 devstack sudo[100418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-055d9f73-8cd1-4175-b2e1-1c88fa3714c1 Apr 29 15:19:47 devstack sudo[100418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:47 devstack sudo[100413]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:47 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-dd0120d4-1c3c-42fc-8327-902f2133cc11 tempest-VolumesSnapshotTestJSON-1135480884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8cd99a3-e297-4595-bda9-861fb8b99371 -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a8cd99a3-e297-4595-bda9-861fb8b99371.8302c9cf-2522-4b91-9231-8e066508387d" returned: 0 in 0.665s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:47 devstack cinder-volume[84448]: WARNING cinder.volume.drivers.remotefs [None req-dd0120d4-1c3c-42fc-8327-902f2133cc11 tempest-VolumesSnapshotTestJSON-1135480884 None] /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a8cd99a3-e297-4595-bda9-861fb8b99371.8302c9cf-2522-4b91-9231-8e066508387d is being set with open permissions: ugo+rw Apr 29 15:19:47 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-dd0120d4-1c3c-42fc-8327-902f2133cc11 tempest-VolumesSnapshotTestJSON-1135480884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a8cd99a3-e297-4595-bda9-861fb8b99371.8302c9cf-2522-4b91-9231-8e066508387d {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:47 devstack sudo[100424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a8cd99a3-e297-4595-bda9-861fb8b99371.8302c9cf-2522-4b91-9231-8e066508387d Apr 29 15:19:47 devstack sudo[100424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:47 devstack sudo[100418]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:47 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-559dbace-8f42-4090-a651-242296df5406 tempest-GroupSnapshotsTest-1515970109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-055d9f73-8cd1-4175-b2e1-1c88fa3714c1" returned: 0 in 0.760s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:47 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-559dbace-8f42-4090-a651-242296df5406 tempest-GroupSnapshotsTest-1515970109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-055d9f73-8cd1-4175-b2e1-1c88fa3714c1.bcfbf0c2-42e1-4f42-ad4d-09043a6fb229 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:47 devstack sudo[100429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-055d9f73-8cd1-4175-b2e1-1c88fa3714c1.bcfbf0c2-42e1-4f42-ad4d-09043a6fb229 Apr 29 15:19:47 devstack sudo[100429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:48 devstack sudo[100424]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:48 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-dd0120d4-1c3c-42fc-8327-902f2133cc11 tempest-VolumesSnapshotTestJSON-1135480884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a8cd99a3-e297-4595-bda9-861fb8b99371.8302c9cf-2522-4b91-9231-8e066508387d" returned: 0 in 0.593s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:48 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-dd0120d4-1c3c-42fc-8327-902f2133cc11 tempest-VolumesSnapshotTestJSON-1135480884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a8cd99a3-e297-4595-bda9-861fb8b99371.info {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:48 devstack sudo[100432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a8cd99a3-e297-4595-bda9-861fb8b99371.info Apr 29 15:19:48 devstack sudo[100432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:48 devstack sudo[100429]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:48 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-559dbace-8f42-4090-a651-242296df5406 tempest-GroupSnapshotsTest-1515970109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-055d9f73-8cd1-4175-b2e1-1c88fa3714c1.bcfbf0c2-42e1-4f42-ad4d-09043a6fb229" returned: 0 in 0.685s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:48 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-559dbace-8f42-4090-a651-242296df5406 tempest-GroupSnapshotsTest-1515970109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-055d9f73-8cd1-4175-b2e1-1c88fa3714c1.bcfbf0c2-42e1-4f42-ad4d-09043a6fb229 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:48 devstack sudo[100438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-055d9f73-8cd1-4175-b2e1-1c88fa3714c1.bcfbf0c2-42e1-4f42-ad4d-09043a6fb229 Apr 29 15:19:48 devstack sudo[100438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:48 devstack sudo[100432]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:48 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-dd0120d4-1c3c-42fc-8327-902f2133cc11 tempest-VolumesSnapshotTestJSON-1135480884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a8cd99a3-e297-4595-bda9-861fb8b99371.info" returned: 0 in 0.604s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:48 devstack cinder-volume[84448]: WARNING cinder.volume.drivers.remotefs [None req-dd0120d4-1c3c-42fc-8327-902f2133cc11 tempest-VolumesSnapshotTestJSON-1135480884 None] /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a8cd99a3-e297-4595-bda9-861fb8b99371.info is being set with open permissions: ugo+rw Apr 29 15:19:48 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-dd0120d4-1c3c-42fc-8327-902f2133cc11 tempest-VolumesSnapshotTestJSON-1135480884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a8cd99a3-e297-4595-bda9-861fb8b99371.info {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:48 devstack sudo[100441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a8cd99a3-e297-4595-bda9-861fb8b99371.info Apr 29 15:19:48 devstack sudo[100441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:49 devstack sudo[100438]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:49 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-559dbace-8f42-4090-a651-242296df5406 tempest-GroupSnapshotsTest-1515970109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-055d9f73-8cd1-4175-b2e1-1c88fa3714c1.bcfbf0c2-42e1-4f42-ad4d-09043a6fb229" returned: 0 in 0.637s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:49 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-559dbace-8f42-4090-a651-242296df5406 tempest-GroupSnapshotsTest-1515970109 None] Lock "cinder-quobyte-bcfbf0c2-42e1-4f42-ad4d-09043a6fb229" released by "_delete_snapshot" :: held 2.904s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:19:49 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-559dbace-8f42-4090-a651-242296df5406 tempest-GroupSnapshotsTest-1515970109 None] Lock "cinder-quobyte-055d9f73-8cd1-4175-b2e1-1c88fa3714c1" released by "delete_snapshot" :: held 2.927s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:19:49 devstack cinder-volume[84448]: WARNING cinder.quota [None req-559dbace-8f42-4090-a651-242296df5406 tempest-GroupSnapshotsTest-1515970109 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1163180549 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1163180549, it is now deprecated. Please use the default quota class for default quota. Apr 29 15:19:49 devstack cinder-volume[84448]: WARNING cinder.quota [None req-559dbace-8f42-4090-a651-242296df5406 tempest-GroupSnapshotsTest-1515970109 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1163180549 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1163180549, it is now deprecated. Please use the default quota class for default quota. Apr 29 15:19:49 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-559dbace-8f42-4090-a651-242296df5406 tempest-GroupSnapshotsTest-1515970109 None] Created reservations ['52c554d2-9079-480d-8233-fbdea816dd28', '94274ddd-9e00-42a0-9222-c72835ffb951', '3458076c-6ee0-4b8f-bcd0-3cc38c272523', '26025c7f-f4e5-4f93-b489-faf201e14a94'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:19:49 devstack sudo[100441]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:49 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-dd0120d4-1c3c-42fc-8327-902f2133cc11 tempest-VolumesSnapshotTestJSON-1135480884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a8cd99a3-e297-4595-bda9-861fb8b99371.info" returned: 0 in 0.624s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:49 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-dd0120d4-1c3c-42fc-8327-902f2133cc11 tempest-VolumesSnapshotTestJSON-1135480884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.157s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:19:49 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-dd0120d4-1c3c-42fc-8327-902f2133cc11 tempest-VolumesSnapshotTestJSON-1135480884 None] Create snapshot completed successfully Apr 29 15:19:49 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-559dbace-8f42-4090-a651-242296df5406 tempest-GroupSnapshotsTest-1515970109 None] Created reservations ['142306f8-067f-45e4-8322-c671c60fe862', '4877caa4-398b-4315-a5b2-bb0674411afd', '6969aab1-9113-4bce-9599-ddd3f177d62f', '205d03e1-341a-4021-85e9-42e914c8958c'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:19:49 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-559dbace-8f42-4090-a651-242296df5406 tempest-GroupSnapshotsTest-1515970109 None] group_snapshot 7379588b-ab31-4578-b312-5822a8ba2630: deleted successfully Apr 29 15:19:49 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-7dbb8853-6cc7-4d67-abfc-0b619d698423 tempest-GroupSnapshotsTest-1515970109 None] Acquiring lock "cinder-quobyte-055d9f73-8cd1-4175-b2e1-1c88fa3714c1" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:19:49 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-7dbb8853-6cc7-4d67-abfc-0b619d698423 tempest-GroupSnapshotsTest-1515970109 None] Lock "cinder-quobyte-055d9f73-8cd1-4175-b2e1-1c88fa3714c1" acquired by "delete_volume" :: waited 0.022s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:19:49 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[877f793c-64bf-4ca6-9996-10f6e8cc7136]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:19:49 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7dbb8853-6cc7-4d67-abfc-0b619d698423 tempest-GroupSnapshotsTest-1515970109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-055d9f73-8cd1-4175-b2e1-1c88fa3714c1 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:50 devstack sudo[100445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-055d9f73-8cd1-4175-b2e1-1c88fa3714c1 Apr 29 15:19:50 devstack sudo[100445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:50 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-1feed888-f626-4053-93e4-1527ffd0bdcf tempest-VolumesSnapshotTestJSON-1135480884 None] Acquiring lock "cinder-8302c9cf-2522-4b91-9231-8e066508387d-delete_snapshot" by "delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:19:50 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-1feed888-f626-4053-93e4-1527ffd0bdcf tempest-VolumesSnapshotTestJSON-1135480884 None] Lock "cinder-8302c9cf-2522-4b91-9231-8e066508387d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:19:50 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-1feed888-f626-4053-93e4-1527ffd0bdcf tempest-VolumesSnapshotTestJSON-1135480884 None] Acquiring lock "cinder-quobyte-a8cd99a3-e297-4595-bda9-861fb8b99371" by "delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:19:50 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-1feed888-f626-4053-93e4-1527ffd0bdcf tempest-VolumesSnapshotTestJSON-1135480884 None] Lock "cinder-quobyte-a8cd99a3-e297-4595-bda9-861fb8b99371" acquired by "delete_snapshot" :: waited 0.013s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:19:50 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-1feed888-f626-4053-93e4-1527ffd0bdcf tempest-VolumesSnapshotTestJSON-1135480884 None] Acquiring lock "cinder-quobyte-8302c9cf-2522-4b91-9231-8e066508387d" by "_delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:19:50 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-1feed888-f626-4053-93e4-1527ffd0bdcf tempest-VolumesSnapshotTestJSON-1135480884 None] Lock "cinder-quobyte-8302c9cf-2522-4b91-9231-8e066508387d" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:19:50 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-1feed888-f626-4053-93e4-1527ffd0bdcf tempest-VolumesSnapshotTestJSON-1135480884 None] Deleting offline snapshot 8302c9cf-2522-4b91-9231-8e066508387d of volume a8cd99a3-e297-4595-bda9-861fb8b99371 {{(pid=84448) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 15:19:50 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-1feed888-f626-4053-93e4-1527ffd0bdcf tempest-VolumesSnapshotTestJSON-1135480884 None] snapshot_file for this snap is: volume-a8cd99a3-e297-4595-bda9-861fb8b99371.8302c9cf-2522-4b91-9231-8e066508387d {{(pid=84448) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 15:19:50 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[72df33d6-2788-499f-b60a-5777cdbceaba]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:19:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1feed888-f626-4053-93e4-1527ffd0bdcf tempest-VolumesSnapshotTestJSON-1135480884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a8cd99a3-e297-4595-bda9-861fb8b99371.8302c9cf-2522-4b91-9231-8e066508387d {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:50 devstack sudo[100445]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7dbb8853-6cc7-4d67-abfc-0b619d698423 tempest-GroupSnapshotsTest-1515970109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-055d9f73-8cd1-4175-b2e1-1c88fa3714c1" returned: 0 in 0.750s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7dbb8853-6cc7-4d67-abfc-0b619d698423 tempest-GroupSnapshotsTest-1515970109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-055d9f73-8cd1-4175-b2e1-1c88fa3714c1 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:50 devstack sudo[100451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-055d9f73-8cd1-4175-b2e1-1c88fa3714c1 Apr 29 15:19:50 devstack sudo[100451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:50 devstack sudo[100450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a8cd99a3-e297-4595-bda9-861fb8b99371.8302c9cf-2522-4b91-9231-8e066508387d Apr 29 15:19:50 devstack sudo[100450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:51 devstack sudo[100451]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:51 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7dbb8853-6cc7-4d67-abfc-0b619d698423 tempest-GroupSnapshotsTest-1515970109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-055d9f73-8cd1-4175-b2e1-1c88fa3714c1" returned: 0 in 0.592s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:51 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-7dbb8853-6cc7-4d67-abfc-0b619d698423 tempest-GroupSnapshotsTest-1515970109 None] Lock "cinder-quobyte-055d9f73-8cd1-4175-b2e1-1c88fa3714c1" released by "delete_volume" :: held 1.417s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:19:51 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-7dbb8853-6cc7-4d67-abfc-0b619d698423 tempest-GroupSnapshotsTest-1515970109 None] Acquiring lock "cinder-quobyte-42848a32-2461-428b-9beb-2e1e2747e99b" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:19:51 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-7dbb8853-6cc7-4d67-abfc-0b619d698423 tempest-GroupSnapshotsTest-1515970109 None] Lock "cinder-quobyte-42848a32-2461-428b-9beb-2e1e2747e99b" acquired by "delete_volume" :: waited 0.014s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:19:51 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a9b1c58-34f7-4e60-8f26-65eba29821c2]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:19:51 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7dbb8853-6cc7-4d67-abfc-0b619d698423 tempest-GroupSnapshotsTest-1515970109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-42848a32-2461-428b-9beb-2e1e2747e99b {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:51 devstack sudo[100450]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:51 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1feed888-f626-4053-93e4-1527ffd0bdcf tempest-VolumesSnapshotTestJSON-1135480884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a8cd99a3-e297-4595-bda9-861fb8b99371.8302c9cf-2522-4b91-9231-8e066508387d" returned: 0 in 0.756s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:51 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-1feed888-f626-4053-93e4-1527ffd0bdcf tempest-VolumesSnapshotTestJSON-1135480884 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8cd99a3-e297-4595-bda9-861fb8b99371(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84448) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 15:19:51 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd41aa7-7747-4aea-b73e-850710aa69c9]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:19:51 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1feed888-f626-4053-93e4-1527ffd0bdcf tempest-VolumesSnapshotTestJSON-1135480884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a8cd99a3-e297-4595-bda9-861fb8b99371 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:51 devstack sudo[100458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-42848a32-2461-428b-9beb-2e1e2747e99b Apr 29 15:19:51 devstack sudo[100458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:51 devstack sudo[100459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a8cd99a3-e297-4595-bda9-861fb8b99371 Apr 29 15:19:51 devstack sudo[100459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:52 devstack sudo[100458]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7dbb8853-6cc7-4d67-abfc-0b619d698423 tempest-GroupSnapshotsTest-1515970109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-42848a32-2461-428b-9beb-2e1e2747e99b" returned: 0 in 0.746s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7dbb8853-6cc7-4d67-abfc-0b619d698423 tempest-GroupSnapshotsTest-1515970109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-42848a32-2461-428b-9beb-2e1e2747e99b {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:52 devstack sudo[100468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-42848a32-2461-428b-9beb-2e1e2747e99b Apr 29 15:19:52 devstack sudo[100468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:52 devstack sudo[100459]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1feed888-f626-4053-93e4-1527ffd0bdcf tempest-VolumesSnapshotTestJSON-1135480884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a8cd99a3-e297-4595-bda9-861fb8b99371" returned: 0 in 0.748s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1feed888-f626-4053-93e4-1527ffd0bdcf tempest-VolumesSnapshotTestJSON-1135480884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a8cd99a3-e297-4595-bda9-861fb8b99371.8302c9cf-2522-4b91-9231-8e066508387d {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:52 devstack sudo[100470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a8cd99a3-e297-4595-bda9-861fb8b99371.8302c9cf-2522-4b91-9231-8e066508387d Apr 29 15:19:52 devstack sudo[100470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:52 devstack sudo[100468]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7dbb8853-6cc7-4d67-abfc-0b619d698423 tempest-GroupSnapshotsTest-1515970109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-42848a32-2461-428b-9beb-2e1e2747e99b" returned: 0 in 0.600s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:52 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-7dbb8853-6cc7-4d67-abfc-0b619d698423 tempest-GroupSnapshotsTest-1515970109 None] Lock "cinder-quobyte-42848a32-2461-428b-9beb-2e1e2747e99b" released by "delete_volume" :: held 1.412s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:19:52 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-7dbb8853-6cc7-4d67-abfc-0b619d698423 tempest-GroupSnapshotsTest-1515970109 None] Created reservations ['d6c02e85-b74f-4169-9a66-1b9694150ed2'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:19:52 devstack cinder-volume[84448]: WARNING cinder.quota [None req-7dbb8853-6cc7-4d67-abfc-0b619d698423 tempest-GroupSnapshotsTest-1515970109 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1163180549 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1163180549, it is now deprecated. Please use the default quota class for default quota. Apr 29 15:19:52 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-7dbb8853-6cc7-4d67-abfc-0b619d698423 tempest-GroupSnapshotsTest-1515970109 None] Created reservations ['a03e12f7-e7b2-4ce5-8c16-54ef09115f76', 'dea7167c-0f46-4887-bb5b-0c8409b18afe', '831d19b9-00ac-4ba9-aa5a-22cba1a97d1d', '10bba91b-73dd-46d9-b48e-1394a727158d'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:19:52 devstack sudo[100470]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1feed888-f626-4053-93e4-1527ffd0bdcf tempest-VolumesSnapshotTestJSON-1135480884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a8cd99a3-e297-4595-bda9-861fb8b99371.8302c9cf-2522-4b91-9231-8e066508387d" returned: 0 in 0.724s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1feed888-f626-4053-93e4-1527ffd0bdcf tempest-VolumesSnapshotTestJSON-1135480884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a8cd99a3-e297-4595-bda9-861fb8b99371.8302c9cf-2522-4b91-9231-8e066508387d {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:52 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-7dbb8853-6cc7-4d67-abfc-0b619d698423 tempest-GroupSnapshotsTest-1515970109 None] Created reservations ['2ad3cfa4-60bd-424b-910a-68ebd30d3081', '29e724a4-cc73-46c7-acee-ff887f8bba3d', '6ef76028-50e7-4251-8f87-3cac8bb2586c', 'fa859ca0-d35f-4cf2-bc18-c4e355ec9c74'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:19:52 devstack sudo[100476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a8cd99a3-e297-4595-bda9-861fb8b99371.8302c9cf-2522-4b91-9231-8e066508387d Apr 29 15:19:52 devstack sudo[100476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-7dbb8853-6cc7-4d67-abfc-0b619d698423 tempest-GroupSnapshotsTest-1515970109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:19:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-7dbb8853-6cc7-4d67-abfc-0b619d698423 tempest-GroupSnapshotsTest-1515970109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:19:53 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-7dbb8853-6cc7-4d67-abfc-0b619d698423 tempest-GroupSnapshotsTest-1515970109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:19:53 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-7dbb8853-6cc7-4d67-abfc-0b619d698423 tempest-GroupSnapshotsTest-1515970109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:19:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-7dbb8853-6cc7-4d67-abfc-0b619d698423 tempest-GroupSnapshotsTest-1515970109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:19:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7dbb8853-6cc7-4d67-abfc-0b619d698423 tempest-GroupSnapshotsTest-1515970109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:53 devstack sudo[100478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:19:53 devstack sudo[100478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:53 devstack sudo[100476]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1feed888-f626-4053-93e4-1527ffd0bdcf tempest-VolumesSnapshotTestJSON-1135480884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a8cd99a3-e297-4595-bda9-861fb8b99371.8302c9cf-2522-4b91-9231-8e066508387d" returned: 0 in 0.648s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:53 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-1feed888-f626-4053-93e4-1527ffd0bdcf tempest-VolumesSnapshotTestJSON-1135480884 None] Lock "cinder-quobyte-8302c9cf-2522-4b91-9231-8e066508387d" released by "_delete_snapshot" :: held 3.018s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:19:53 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-1feed888-f626-4053-93e4-1527ffd0bdcf tempest-VolumesSnapshotTestJSON-1135480884 None] Lock "cinder-quobyte-a8cd99a3-e297-4595-bda9-861fb8b99371" released by "delete_snapshot" :: held 3.040s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:19:53 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-613af04d-7341-4a43-8d3f-caeeec6bb23c tempest-GroupSnapshotsTest-1515970109 None] Group tempest-GroupSnapshotsTest-Group-2043923978: creating Apr 29 15:19:53 devstack sudo[100478]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7dbb8853-6cc7-4d67-abfc-0b619d698423 tempest-GroupSnapshotsTest-1515970109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.677s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:53 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-7dbb8853-6cc7-4d67-abfc-0b619d698423 tempest-GroupSnapshotsTest-1515970109 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:19:53 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-7dbb8853-6cc7-4d67-abfc-0b619d698423 tempest-GroupSnapshotsTest-1515970109 None] Delete group completed successfully. Apr 29 15:19:53 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-613af04d-7341-4a43-8d3f-caeeec6bb23c tempest-GroupSnapshotsTest-1515970109 None] Group tempest-GroupSnapshotsTest-Group-2043923978: created successfully Apr 29 15:19:53 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-1feed888-f626-4053-93e4-1527ffd0bdcf tempest-VolumesSnapshotTestJSON-1135480884 None] Created reservations ['59bde430-09a4-41e9-bab2-4533305e51d6', 'ba8ff435-821d-4cc0-9abc-3c729f545338', '723f2413-b43e-4c54-bbe9-6e0ebabfefb6', '7dce740e-2f6a-4024-8edd-fc36934fc44a'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:19:53 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-613af04d-7341-4a43-8d3f-caeeec6bb23c tempest-GroupSnapshotsTest-1515970109 None] Create group completed successfully. Apr 29 15:19:53 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-1feed888-f626-4053-93e4-1527ffd0bdcf tempest-VolumesSnapshotTestJSON-1135480884 None] Delete snapshot completed successfully. Apr 29 15:19:53 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-1feed888-f626-4053-93e4-1527ffd0bdcf tempest-VolumesSnapshotTestJSON-1135480884 None] Lock "cinder-8302c9cf-2522-4b91-9231-8e066508387d-delete_snapshot" released by "delete_snapshot" :: held 3.245s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:19:55 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-455de916-788a-4c20-bace-4191660e91e9 tempest-GroupSnapshotsTest-1515970109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:19:55 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-455de916-788a-4c20-bace-4191660e91e9 tempest-GroupSnapshotsTest-1515970109 None] Flow 'volume_create_manager' (097759e4-7322-4bc9-baea-d2c184c11852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:19:55 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-455de916-788a-4c20-bace-4191660e91e9 tempest-GroupSnapshotsTest-1515970109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4837f3d3-909c-425c-847a-84046fd514bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:19:55 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-455de916-788a-4c20-bace-4191660e91e9 tempest-GroupSnapshotsTest-1515970109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4837f3d3-909c-425c-847a-84046fd514bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:19:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-534233484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1d5498d8-f057-465c-a9cc-a4bfa2581cb1,host='devstack@QuobyteHD#QuobyteHD',id=0ae8700b-0692-4495-9e34-d8cdff49a6a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='148ea8123ca04d2bb37f71e331e6b6cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:19:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:19:55Z,use_quota=True,user_id='4f519a26b0c0480ebe4f6ff33fc56fd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c32646f-58b1-49a2-adfc-4180c77effdf),volume_type_id=4c32646f-58b1-49a2-adfc-4180c77effdf)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:19:55 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-455de916-788a-4c20-bace-4191660e91e9 tempest-GroupSnapshotsTest-1515970109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26a5903c-adf2-48a6-9b31-0a75a5dc550f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:19:55 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-455de916-788a-4c20-bace-4191660e91e9 tempest-GroupSnapshotsTest-1515970109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26a5903c-adf2-48a6-9b31-0a75a5dc550f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:19:55 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-455de916-788a-4c20-bace-4191660e91e9 tempest-GroupSnapshotsTest-1515970109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f30cc38c-10f1-4d0b-833a-7267808cfbf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:19:55 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-455de916-788a-4c20-bace-4191660e91e9 tempest-GroupSnapshotsTest-1515970109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f30cc38c-10f1-4d0b-833a-7267808cfbf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ae8700b-0692-4495-9e34-d8cdff49a6a0', 'volume_name': 'volume-0ae8700b-0692-4495-9e34-d8cdff49a6a0', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:19:55 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-455de916-788a-4c20-bace-4191660e91e9 tempest-GroupSnapshotsTest-1515970109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89945658-e25a-4b91-a467-44a17201fbc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:19:55 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-455de916-788a-4c20-bace-4191660e91e9 tempest-GroupSnapshotsTest-1515970109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89945658-e25a-4b91-a467-44a17201fbc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:19:55 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-455de916-788a-4c20-bace-4191660e91e9 tempest-GroupSnapshotsTest-1515970109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13bd2a80-55f4-40e5-b012-be509a797d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:19:55 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-455de916-788a-4c20-bace-4191660e91e9 tempest-GroupSnapshotsTest-1515970109 None] Volume 0ae8700b-0692-4495-9e34-d8cdff49a6a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ae8700b-0692-4495-9e34-d8cdff49a6a0', 'volume_size': 1} Apr 29 15:19:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-455de916-788a-4c20-bace-4191660e91e9 tempest-GroupSnapshotsTest-1515970109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:19:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-455de916-788a-4c20-bace-4191660e91e9 tempest-GroupSnapshotsTest-1515970109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:19:55 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-455de916-788a-4c20-bace-4191660e91e9 tempest-GroupSnapshotsTest-1515970109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1d5498d8-f057-465c-a9cc-a4bfa2581cb1,created_at=2026-04-29T13:19:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-534233484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1d5498d8-f057-465c-a9cc-a4bfa2581cb1,host='devstack@QuobyteHD#QuobyteHD',id=0ae8700b-0692-4495-9e34-d8cdff49a6a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='148ea8123ca04d2bb37f71e331e6b6cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:19:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:19:55Z,use_quota=True,user_id='4f519a26b0c0480ebe4f6ff33fc56fd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c32646f-58b1-49a2-adfc-4180c77effdf),volume_type_id=4c32646f-58b1-49a2-adfc-4180c77effdf)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:19:55 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-455de916-788a-4c20-bace-4191660e91e9 tempest-GroupSnapshotsTest-1515970109 None] Creating volume 0ae8700b-0692-4495-9e34-d8cdff49a6a0 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:19:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-455de916-788a-4c20-bace-4191660e91e9 tempest-GroupSnapshotsTest-1515970109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:19:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-455de916-788a-4c20-bace-4191660e91e9 tempest-GroupSnapshotsTest-1515970109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:19:55 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-455de916-788a-4c20-bace-4191660e91e9 tempest-GroupSnapshotsTest-1515970109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:19:55 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-455de916-788a-4c20-bace-4191660e91e9 tempest-GroupSnapshotsTest-1515970109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:19:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-455de916-788a-4c20-bace-4191660e91e9 tempest-GroupSnapshotsTest-1515970109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:19:55 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-455de916-788a-4c20-bace-4191660e91e9 tempest-GroupSnapshotsTest-1515970109 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:19:55 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-455de916-788a-4c20-bace-4191660e91e9 tempest-GroupSnapshotsTest-1515970109 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:19:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-455de916-788a-4c20-bace-4191660e91e9 tempest-GroupSnapshotsTest-1515970109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0ae8700b-0692-4495-9e34-d8cdff49a6a0 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:55 devstack sudo[100482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0ae8700b-0692-4495-9e34-d8cdff49a6a0 1073741824 Apr 29 15:19:55 devstack sudo[100482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:55 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a8c77a0-f7c9-466f-a649-559d2ff336bf tempest-VolumesSnapshotTestJSON-1135480884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:19:55 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4a8c77a0-f7c9-466f-a649-559d2ff336bf tempest-VolumesSnapshotTestJSON-1135480884 None] Flow 'volume_create_manager' (da289283-4043-4872-8ac0-688e3dc1db17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:19:55 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4a8c77a0-f7c9-466f-a649-559d2ff336bf tempest-VolumesSnapshotTestJSON-1135480884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (097a4270-ed34-4f60-91b6-fe4fe2b951f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:19:55 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4a8c77a0-f7c9-466f-a649-559d2ff336bf tempest-VolumesSnapshotTestJSON-1135480884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (097a4270-ed34-4f60-91b6-fe4fe2b951f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:19:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1140503140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e482872055f43a59a50317dcf761896',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:19:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:19:55Z,use_quota=True,user_id='38745d6b3d0b4b658fbbef2ced9dc889',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:19:55 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4a8c77a0-f7c9-466f-a649-559d2ff336bf tempest-VolumesSnapshotTestJSON-1135480884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2eca6944-73bb-40ed-8730-df9672a4ec5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:19:55 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4a8c77a0-f7c9-466f-a649-559d2ff336bf tempest-VolumesSnapshotTestJSON-1135480884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2eca6944-73bb-40ed-8730-df9672a4ec5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:19:55 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4a8c77a0-f7c9-466f-a649-559d2ff336bf tempest-VolumesSnapshotTestJSON-1135480884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf4555b7-abda-4a37-bf75-5d4f336529c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:19:55 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4a8c77a0-f7c9-466f-a649-559d2ff336bf tempest-VolumesSnapshotTestJSON-1135480884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf4555b7-abda-4a37-bf75-5d4f336529c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1', 'volume_name': 'volume-c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:19:55 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4a8c77a0-f7c9-466f-a649-559d2ff336bf tempest-VolumesSnapshotTestJSON-1135480884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65937102-020d-4d1a-8114-2a494769d5ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:19:55 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4a8c77a0-f7c9-466f-a649-559d2ff336bf tempest-VolumesSnapshotTestJSON-1135480884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65937102-020d-4d1a-8114-2a494769d5ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:19:55 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4a8c77a0-f7c9-466f-a649-559d2ff336bf tempest-VolumesSnapshotTestJSON-1135480884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04f5ba94-6d26-4926-922a-db8caaf435c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:19:55 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-4a8c77a0-f7c9-466f-a649-559d2ff336bf tempest-VolumesSnapshotTestJSON-1135480884 None] Volume c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1', 'volume_size': 1} Apr 29 15:19:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-4a8c77a0-f7c9-466f-a649-559d2ff336bf tempest-VolumesSnapshotTestJSON-1135480884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:19:56 devstack sudo[100482]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-455de916-788a-4c20-bace-4191660e91e9 tempest-GroupSnapshotsTest-1515970109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0ae8700b-0692-4495-9e34-d8cdff49a6a0 1073741824" returned: 0 in 0.793s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-455de916-788a-4c20-bace-4191660e91e9 tempest-GroupSnapshotsTest-1515970109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0ae8700b-0692-4495-9e34-d8cdff49a6a0 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:56 devstack sudo[100489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0ae8700b-0692-4495-9e34-d8cdff49a6a0 Apr 29 15:19:56 devstack sudo[100489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:56 devstack sudo[100489]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-455de916-788a-4c20-bace-4191660e91e9 tempest-GroupSnapshotsTest-1515970109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0ae8700b-0692-4495-9e34-d8cdff49a6a0" returned: 0 in 0.613s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:56 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-455de916-788a-4c20-bace-4191660e91e9 tempest-GroupSnapshotsTest-1515970109 None] <== create_volume: return (1481ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:19:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-455de916-788a-4c20-bace-4191660e91e9 tempest-GroupSnapshotsTest-1515970109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.485s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:19:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-4a8c77a0-f7c9-466f-a649-559d2ff336bf tempest-VolumesSnapshotTestJSON-1135480884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.353s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:19:56 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-4a8c77a0-f7c9-466f-a649-559d2ff336bf tempest-VolumesSnapshotTestJSON-1135480884 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:19:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1140503140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e482872055f43a59a50317dcf761896',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:19:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:19:55Z,use_quota=True,user_id='38745d6b3d0b4b658fbbef2ced9dc889',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:19:56 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-4a8c77a0-f7c9-466f-a649-559d2ff336bf tempest-VolumesSnapshotTestJSON-1135480884 None] Creating volume c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:19:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-4a8c77a0-f7c9-466f-a649-559d2ff336bf tempest-VolumesSnapshotTestJSON-1135480884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:19:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-4a8c77a0-f7c9-466f-a649-559d2ff336bf tempest-VolumesSnapshotTestJSON-1135480884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:19:56 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-4a8c77a0-f7c9-466f-a649-559d2ff336bf tempest-VolumesSnapshotTestJSON-1135480884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:19:56 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-4a8c77a0-f7c9-466f-a649-559d2ff336bf tempest-VolumesSnapshotTestJSON-1135480884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:19:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-4a8c77a0-f7c9-466f-a649-559d2ff336bf tempest-VolumesSnapshotTestJSON-1135480884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:19:56 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-4a8c77a0-f7c9-466f-a649-559d2ff336bf tempest-VolumesSnapshotTestJSON-1135480884 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:19:56 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-4a8c77a0-f7c9-466f-a649-559d2ff336bf tempest-VolumesSnapshotTestJSON-1135480884 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:19:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-4a8c77a0-f7c9-466f-a649-559d2ff336bf tempest-VolumesSnapshotTestJSON-1135480884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:56 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-455de916-788a-4c20-bace-4191660e91e9 tempest-GroupSnapshotsTest-1515970109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13bd2a80-55f4-40e5-b012-be509a797d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ae8700b-0692-4495-9e34-d8cdff49a6a0', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:19:56 devstack sudo[100492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1 1073741824 Apr 29 15:19:56 devstack sudo[100492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:56 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-455de916-788a-4c20-bace-4191660e91e9 tempest-GroupSnapshotsTest-1515970109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac62b9c5-42a4-486d-8292-1aebdfb1b205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:19:56 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-455de916-788a-4c20-bace-4191660e91e9 tempest-GroupSnapshotsTest-1515970109 None] Volume volume-0ae8700b-0692-4495-9e34-d8cdff49a6a0 (0ae8700b-0692-4495-9e34-d8cdff49a6a0): created successfully Apr 29 15:19:56 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-455de916-788a-4c20-bace-4191660e91e9 tempest-GroupSnapshotsTest-1515970109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac62b9c5-42a4-486d-8292-1aebdfb1b205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:19:56 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-455de916-788a-4c20-bace-4191660e91e9 tempest-GroupSnapshotsTest-1515970109 None] Flow 'volume_create_manager' (097759e4-7322-4bc9-baea-d2c184c11852) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:19:56 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-455de916-788a-4c20-bace-4191660e91e9 tempest-GroupSnapshotsTest-1515970109 None] Created volume successfully. Apr 29 15:19:57 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-74600210-d144-49af-9ccf-60dee73ed521 tempest-GroupSnapshotsTest-1515970109 None] GroupSnapshot 610dc333-6c32-4243-9f43-147d43488c1b: creating. Apr 29 15:19:57 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-74600210-d144-49af-9ccf-60dee73ed521 tempest-GroupSnapshotsTest-1515970109 None] Group snapshot 610dc333-6c32-4243-9f43-147d43488c1b: creating. {{(pid=84448) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 29 15:19:57 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-74600210-d144-49af-9ccf-60dee73ed521 tempest-GroupSnapshotsTest-1515970109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:19:57 devstack sudo[100492]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:57 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-4a8c77a0-f7c9-466f-a649-559d2ff336bf tempest-VolumesSnapshotTestJSON-1135480884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1 1073741824" returned: 0 in 0.871s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:57 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-4a8c77a0-f7c9-466f-a649-559d2ff336bf tempest-VolumesSnapshotTestJSON-1135480884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:57 devstack sudo[100498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1 Apr 29 15:19:57 devstack sudo[100498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:58 devstack sudo[100498]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:58 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-4a8c77a0-f7c9-466f-a649-559d2ff336bf tempest-VolumesSnapshotTestJSON-1135480884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1" returned: 0 in 0.577s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:58 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-4a8c77a0-f7c9-466f-a649-559d2ff336bf tempest-VolumesSnapshotTestJSON-1135480884 None] <== create_volume: return (1483ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:19:58 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-4a8c77a0-f7c9-466f-a649-559d2ff336bf tempest-VolumesSnapshotTestJSON-1135480884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.486s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:19:58 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-74600210-d144-49af-9ccf-60dee73ed521 tempest-GroupSnapshotsTest-1515970109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.620s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:19:58 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:SELECT=139,cinder:INSERT=37,cinder:UPDATE=129,cinder:DELETE=8 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:19:58 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:SELECT=146,cinder:INSERT=42,cinder:UPDATE=151,cinder:DELETE=4 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:19:58 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4a8c77a0-f7c9-466f-a649-559d2ff336bf tempest-VolumesSnapshotTestJSON-1135480884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04f5ba94-6d26-4926-922a-db8caaf435c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:19:58 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4a8c77a0-f7c9-466f-a649-559d2ff336bf tempest-VolumesSnapshotTestJSON-1135480884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4d5e4e2-8292-40e5-a15a-e6752b9ef8db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:19:58 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-74600210-d144-49af-9ccf-60dee73ed521 tempest-GroupSnapshotsTest-1515970109 None] Creating offline snapshot ba55056f-4440-495c-b7c6-c499226ca72a of volume 0ae8700b-0692-4495-9e34-d8cdff49a6a0 {{(pid=84448) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 15:19:58 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-4a8c77a0-f7c9-466f-a649-559d2ff336bf tempest-VolumesSnapshotTestJSON-1135480884 None] Volume volume-c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1 (c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1): created successfully Apr 29 15:19:58 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4a8c77a0-f7c9-466f-a649-559d2ff336bf tempest-VolumesSnapshotTestJSON-1135480884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4d5e4e2-8292-40e5-a15a-e6752b9ef8db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:19:58 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4a8c77a0-f7c9-466f-a649-559d2ff336bf tempest-VolumesSnapshotTestJSON-1135480884 None] Flow 'volume_create_manager' (da289283-4043-4872-8ac0-688e3dc1db17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:19:58 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[d79fc1b0-338a-4b4a-ba79-a640e5634fcd]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:19:58 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-74600210-d144-49af-9ccf-60dee73ed521 tempest-GroupSnapshotsTest-1515970109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0ae8700b-0692-4495-9e34-d8cdff49a6a0 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:58 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-4a8c77a0-f7c9-466f-a649-559d2ff336bf tempest-VolumesSnapshotTestJSON-1135480884 None] Created volume successfully. Apr 29 15:19:58 devstack sudo[100501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0ae8700b-0692-4495-9e34-d8cdff49a6a0 Apr 29 15:19:58 devstack sudo[100501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:58 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-1919019d-0ef9-4392-a9f2-f1f3674b41ac tempest-VolumesSnapshotTestJSON-1135480884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:19:59 devstack sudo[100501]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:59 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-74600210-d144-49af-9ccf-60dee73ed521 tempest-GroupSnapshotsTest-1515970109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0ae8700b-0692-4495-9e34-d8cdff49a6a0" returned: 0 in 0.739s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:59 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-74600210-d144-49af-9ccf-60dee73ed521 tempest-GroupSnapshotsTest-1515970109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0ae8700b-0692-4495-9e34-d8cdff49a6a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0ae8700b-0692-4495-9e34-d8cdff49a6a0.ba55056f-4440-495c-b7c6-c499226ca72a 1G {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:59 devstack sudo[100506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0ae8700b-0692-4495-9e34-d8cdff49a6a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0ae8700b-0692-4495-9e34-d8cdff49a6a0.ba55056f-4440-495c-b7c6-c499226ca72a 1G Apr 29 15:19:59 devstack sudo[100506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:19:59 devstack sudo[100506]: pam_unix(sudo:session): session closed for user root Apr 29 15:19:59 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-74600210-d144-49af-9ccf-60dee73ed521 tempest-GroupSnapshotsTest-1515970109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0ae8700b-0692-4495-9e34-d8cdff49a6a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0ae8700b-0692-4495-9e34-d8cdff49a6a0.ba55056f-4440-495c-b7c6-c499226ca72a 1G" returned: 0 in 0.739s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:19:59 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-74600210-d144-49af-9ccf-60dee73ed521 tempest-GroupSnapshotsTest-1515970109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ae8700b-0692-4495-9e34-d8cdff49a6a0 -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0ae8700b-0692-4495-9e34-d8cdff49a6a0.ba55056f-4440-495c-b7c6-c499226ca72a {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:19:59 devstack sudo[100512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ae8700b-0692-4495-9e34-d8cdff49a6a0 -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0ae8700b-0692-4495-9e34-d8cdff49a6a0.ba55056f-4440-495c-b7c6-c499226ca72a Apr 29 15:19:59 devstack sudo[100512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:20:00 devstack sudo[100512]: pam_unix(sudo:session): session closed for user root Apr 29 15:20:00 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-74600210-d144-49af-9ccf-60dee73ed521 tempest-GroupSnapshotsTest-1515970109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ae8700b-0692-4495-9e34-d8cdff49a6a0 -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0ae8700b-0692-4495-9e34-d8cdff49a6a0.ba55056f-4440-495c-b7c6-c499226ca72a" returned: 0 in 0.641s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:20:00 devstack cinder-volume[84448]: WARNING cinder.volume.drivers.remotefs [None req-74600210-d144-49af-9ccf-60dee73ed521 tempest-GroupSnapshotsTest-1515970109 None] /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0ae8700b-0692-4495-9e34-d8cdff49a6a0.ba55056f-4440-495c-b7c6-c499226ca72a is being set with open permissions: ugo+rw: NotImplementedError Apr 29 15:20:00 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-74600210-d144-49af-9ccf-60dee73ed521 tempest-GroupSnapshotsTest-1515970109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0ae8700b-0692-4495-9e34-d8cdff49a6a0.ba55056f-4440-495c-b7c6-c499226ca72a {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:20:00 devstack sudo[100517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0ae8700b-0692-4495-9e34-d8cdff49a6a0.ba55056f-4440-495c-b7c6-c499226ca72a Apr 29 15:20:00 devstack sudo[100517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:20:01 devstack sudo[100517]: pam_unix(sudo:session): session closed for user root Apr 29 15:20:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-74600210-d144-49af-9ccf-60dee73ed521 tempest-GroupSnapshotsTest-1515970109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0ae8700b-0692-4495-9e34-d8cdff49a6a0.ba55056f-4440-495c-b7c6-c499226ca72a" returned: 0 in 0.578s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:20:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-74600210-d144-49af-9ccf-60dee73ed521 tempest-GroupSnapshotsTest-1515970109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0ae8700b-0692-4495-9e34-d8cdff49a6a0.info {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:20:01 devstack sudo[100520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0ae8700b-0692-4495-9e34-d8cdff49a6a0.info Apr 29 15:20:01 devstack sudo[100520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:20:01 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-124befa8-9add-42af-a589-7a53b0466bf0 req-a9f5c459-802a-4e0f-9b54-cf715574146b tempest-AttachVolumeTestJSON-1394496241 None] Terminate volume connection completed successfully. Apr 29 15:20:01 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-124befa8-9add-42af-a589-7a53b0466bf0 req-a9f5c459-802a-4e0f-9b54-cf715574146b tempest-AttachVolumeTestJSON-1394496241 None] Deleting attachment 40b1c3ca-0d36-49c0-af24-8491eb819616. {{(pid=84448) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 15:20:01 devstack sudo[100520]: pam_unix(sudo:session): session closed for user root Apr 29 15:20:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-74600210-d144-49af-9ccf-60dee73ed521 tempest-GroupSnapshotsTest-1515970109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0ae8700b-0692-4495-9e34-d8cdff49a6a0.info" returned: 0 in 0.615s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:20:01 devstack cinder-volume[84448]: WARNING cinder.volume.drivers.remotefs [None req-74600210-d144-49af-9ccf-60dee73ed521 tempest-GroupSnapshotsTest-1515970109 None] /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0ae8700b-0692-4495-9e34-d8cdff49a6a0.info is being set with open permissions: ugo+rw: NotImplementedError Apr 29 15:20:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-74600210-d144-49af-9ccf-60dee73ed521 tempest-GroupSnapshotsTest-1515970109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0ae8700b-0692-4495-9e34-d8cdff49a6a0.info {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:20:01 devstack sudo[100523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0ae8700b-0692-4495-9e34-d8cdff49a6a0.info Apr 29 15:20:01 devstack sudo[100523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:20:02 devstack sudo[100523]: pam_unix(sudo:session): session closed for user root Apr 29 15:20:02 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-74600210-d144-49af-9ccf-60dee73ed521 tempest-GroupSnapshotsTest-1515970109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0ae8700b-0692-4495-9e34-d8cdff49a6a0.info" returned: 0 in 0.570s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:20:02 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-74600210-d144-49af-9ccf-60dee73ed521 tempest-GroupSnapshotsTest-1515970109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.986s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:20:02 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-1919019d-0ef9-4392-a9f2-f1f3674b41ac tempest-VolumesSnapshotTestJSON-1135480884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.541s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:20:02 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-1919019d-0ef9-4392-a9f2-f1f3674b41ac tempest-VolumesSnapshotTestJSON-1135480884 None] Creating offline snapshot 5899041b-1471-4df5-aaea-40ccbf453649 of volume c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1 {{(pid=84448) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 15:20:02 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18c50df-76a7-4a31-8774-0f7a9754fadd]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:20:02 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1919019d-0ef9-4392-a9f2-f1f3674b41ac tempest-VolumesSnapshotTestJSON-1135480884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:20:02 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-74600210-d144-49af-9ccf-60dee73ed521 tempest-GroupSnapshotsTest-1515970109 None] group_snapshot 610dc333-6c32-4243-9f43-147d43488c1b: created successfully Apr 29 15:20:02 devstack sudo[100526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1 Apr 29 15:20:02 devstack sudo[100526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:20:03 devstack sudo[100526]: pam_unix(sudo:session): session closed for user root Apr 29 15:20:03 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1919019d-0ef9-4392-a9f2-f1f3674b41ac tempest-VolumesSnapshotTestJSON-1135480884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1" returned: 0 in 0.730s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:20:03 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1919019d-0ef9-4392-a9f2-f1f3674b41ac tempest-VolumesSnapshotTestJSON-1135480884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1.5899041b-1471-4df5-aaea-40ccbf453649 1G {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:20:03 devstack sudo[100531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1.5899041b-1471-4df5-aaea-40ccbf453649 1G Apr 29 15:20:03 devstack sudo[100531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:20:03 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-568667b5-2f09-438c-b37d-931a83ec4ee8 tempest-GroupSnapshotsTest-1515970109 None] group_snapshot 610dc333-6c32-4243-9f43-147d43488c1b: deleting Apr 29 15:20:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-568667b5-2f09-438c-b37d-931a83ec4ee8 tempest-GroupSnapshotsTest-1515970109 None] group_snapshot 610dc333-6c32-4243-9f43-147d43488c1b: deleting {{(pid=84448) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 29 15:20:03 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-568667b5-2f09-438c-b37d-931a83ec4ee8 tempest-GroupSnapshotsTest-1515970109 None] Acquiring lock "cinder-quobyte-0ae8700b-0692-4495-9e34-d8cdff49a6a0" by "delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:20:03 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-568667b5-2f09-438c-b37d-931a83ec4ee8 tempest-GroupSnapshotsTest-1515970109 None] Lock "cinder-quobyte-0ae8700b-0692-4495-9e34-d8cdff49a6a0" acquired by "delete_snapshot" :: waited 0.019s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:20:03 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-568667b5-2f09-438c-b37d-931a83ec4ee8 tempest-GroupSnapshotsTest-1515970109 None] Acquiring lock "cinder-quobyte-ba55056f-4440-495c-b7c6-c499226ca72a" by "_delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:20:03 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-568667b5-2f09-438c-b37d-931a83ec4ee8 tempest-GroupSnapshotsTest-1515970109 None] Lock "cinder-quobyte-ba55056f-4440-495c-b7c6-c499226ca72a" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:20:03 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-568667b5-2f09-438c-b37d-931a83ec4ee8 tempest-GroupSnapshotsTest-1515970109 None] Deleting offline snapshot ba55056f-4440-495c-b7c6-c499226ca72a of volume 0ae8700b-0692-4495-9e34-d8cdff49a6a0 {{(pid=84448) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 15:20:03 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-568667b5-2f09-438c-b37d-931a83ec4ee8 tempest-GroupSnapshotsTest-1515970109 None] snapshot_file for this snap is: volume-0ae8700b-0692-4495-9e34-d8cdff49a6a0.ba55056f-4440-495c-b7c6-c499226ca72a {{(pid=84448) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 15:20:03 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e0eed1-edf3-423b-a2f3-2b8976dfb612]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:20:03 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-568667b5-2f09-438c-b37d-931a83ec4ee8 tempest-GroupSnapshotsTest-1515970109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0ae8700b-0692-4495-9e34-d8cdff49a6a0.ba55056f-4440-495c-b7c6-c499226ca72a {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:20:03 devstack sudo[100533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0ae8700b-0692-4495-9e34-d8cdff49a6a0.ba55056f-4440-495c-b7c6-c499226ca72a Apr 29 15:20:03 devstack sudo[100533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:20:03 devstack sudo[100531]: pam_unix(sudo:session): session closed for user root Apr 29 15:20:03 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1919019d-0ef9-4392-a9f2-f1f3674b41ac tempest-VolumesSnapshotTestJSON-1135480884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1.5899041b-1471-4df5-aaea-40ccbf453649 1G" returned: 0 in 0.898s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:20:03 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1919019d-0ef9-4392-a9f2-f1f3674b41ac tempest-VolumesSnapshotTestJSON-1135480884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1 -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1.5899041b-1471-4df5-aaea-40ccbf453649 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:20:04 devstack sudo[100541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1 -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1.5899041b-1471-4df5-aaea-40ccbf453649 Apr 29 15:20:04 devstack sudo[100541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:20:04 devstack sudo[100533]: pam_unix(sudo:session): session closed for user root Apr 29 15:20:04 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-568667b5-2f09-438c-b37d-931a83ec4ee8 tempest-GroupSnapshotsTest-1515970109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0ae8700b-0692-4495-9e34-d8cdff49a6a0.ba55056f-4440-495c-b7c6-c499226ca72a" returned: 0 in 0.758s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:20:04 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-568667b5-2f09-438c-b37d-931a83ec4ee8 tempest-GroupSnapshotsTest-1515970109 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ae8700b-0692-4495-9e34-d8cdff49a6a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84448) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 15:20:04 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f9ab04-b10f-4d24-af6c-a0cb0e36efe8]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:20:04 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-568667b5-2f09-438c-b37d-931a83ec4ee8 tempest-GroupSnapshotsTest-1515970109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0ae8700b-0692-4495-9e34-d8cdff49a6a0 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:20:04 devstack sudo[100543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0ae8700b-0692-4495-9e34-d8cdff49a6a0 Apr 29 15:20:04 devstack sudo[100543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:20:04 devstack sudo[100541]: pam_unix(sudo:session): session closed for user root Apr 29 15:20:04 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1919019d-0ef9-4392-a9f2-f1f3674b41ac tempest-VolumesSnapshotTestJSON-1135480884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1 -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1.5899041b-1471-4df5-aaea-40ccbf453649" returned: 0 in 0.671s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:20:04 devstack cinder-volume[84448]: WARNING cinder.volume.drivers.remotefs [None req-1919019d-0ef9-4392-a9f2-f1f3674b41ac tempest-VolumesSnapshotTestJSON-1135480884 None] /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1.5899041b-1471-4df5-aaea-40ccbf453649 is being set with open permissions: ugo+rw Apr 29 15:20:04 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1919019d-0ef9-4392-a9f2-f1f3674b41ac tempest-VolumesSnapshotTestJSON-1135480884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1.5899041b-1471-4df5-aaea-40ccbf453649 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:20:04 devstack sudo[100550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1.5899041b-1471-4df5-aaea-40ccbf453649 Apr 29 15:20:04 devstack sudo[100550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:20:04 devstack sudo[100543]: pam_unix(sudo:session): session closed for user root Apr 29 15:20:04 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-568667b5-2f09-438c-b37d-931a83ec4ee8 tempest-GroupSnapshotsTest-1515970109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0ae8700b-0692-4495-9e34-d8cdff49a6a0" returned: 0 in 0.718s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:20:04 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-568667b5-2f09-438c-b37d-931a83ec4ee8 tempest-GroupSnapshotsTest-1515970109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0ae8700b-0692-4495-9e34-d8cdff49a6a0.ba55056f-4440-495c-b7c6-c499226ca72a {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:20:04 devstack sudo[100553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0ae8700b-0692-4495-9e34-d8cdff49a6a0.ba55056f-4440-495c-b7c6-c499226ca72a Apr 29 15:20:04 devstack sudo[100553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:20:05 devstack sudo[100550]: pam_unix(sudo:session): session closed for user root Apr 29 15:20:05 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1919019d-0ef9-4392-a9f2-f1f3674b41ac tempest-VolumesSnapshotTestJSON-1135480884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1.5899041b-1471-4df5-aaea-40ccbf453649" returned: 0 in 0.634s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:20:05 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1919019d-0ef9-4392-a9f2-f1f3674b41ac tempest-VolumesSnapshotTestJSON-1135480884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1.info {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:20:05 devstack sudo[100558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1.info Apr 29 15:20:05 devstack sudo[100558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:20:05 devstack sudo[100553]: pam_unix(sudo:session): session closed for user root Apr 29 15:20:05 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-568667b5-2f09-438c-b37d-931a83ec4ee8 tempest-GroupSnapshotsTest-1515970109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0ae8700b-0692-4495-9e34-d8cdff49a6a0.ba55056f-4440-495c-b7c6-c499226ca72a" returned: 0 in 0.769s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:20:05 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-568667b5-2f09-438c-b37d-931a83ec4ee8 tempest-GroupSnapshotsTest-1515970109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0ae8700b-0692-4495-9e34-d8cdff49a6a0.ba55056f-4440-495c-b7c6-c499226ca72a {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:20:05 devstack sudo[100562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0ae8700b-0692-4495-9e34-d8cdff49a6a0.ba55056f-4440-495c-b7c6-c499226ca72a Apr 29 15:20:05 devstack sudo[100562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:20:05 devstack sudo[100558]: pam_unix(sudo:session): session closed for user root Apr 29 15:20:05 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1919019d-0ef9-4392-a9f2-f1f3674b41ac tempest-VolumesSnapshotTestJSON-1135480884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1.info" returned: 0 in 0.638s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:20:05 devstack cinder-volume[84448]: WARNING cinder.volume.drivers.remotefs [None req-1919019d-0ef9-4392-a9f2-f1f3674b41ac tempest-VolumesSnapshotTestJSON-1135480884 None] /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1.info is being set with open permissions: ugo+rw Apr 29 15:20:05 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1919019d-0ef9-4392-a9f2-f1f3674b41ac tempest-VolumesSnapshotTestJSON-1135480884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1.info {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:20:05 devstack sudo[100565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1.info Apr 29 15:20:05 devstack sudo[100565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:20:06 devstack sudo[100562]: pam_unix(sudo:session): session closed for user root Apr 29 15:20:06 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-568667b5-2f09-438c-b37d-931a83ec4ee8 tempest-GroupSnapshotsTest-1515970109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0ae8700b-0692-4495-9e34-d8cdff49a6a0.ba55056f-4440-495c-b7c6-c499226ca72a" returned: 0 in 0.635s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:20:06 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-568667b5-2f09-438c-b37d-931a83ec4ee8 tempest-GroupSnapshotsTest-1515970109 None] Lock "cinder-quobyte-ba55056f-4440-495c-b7c6-c499226ca72a" released by "_delete_snapshot" :: held 3.050s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:20:06 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-568667b5-2f09-438c-b37d-931a83ec4ee8 tempest-GroupSnapshotsTest-1515970109 None] Lock "cinder-quobyte-0ae8700b-0692-4495-9e34-d8cdff49a6a0" released by "delete_snapshot" :: held 3.075s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:20:06 devstack cinder-volume[84448]: WARNING cinder.quota [None req-568667b5-2f09-438c-b37d-931a83ec4ee8 tempest-GroupSnapshotsTest-1515970109 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-987276203 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-987276203, it is now deprecated. Please use the default quota class for default quota. Apr 29 15:20:06 devstack cinder-volume[84448]: WARNING cinder.quota [None req-568667b5-2f09-438c-b37d-931a83ec4ee8 tempest-GroupSnapshotsTest-1515970109 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-987276203 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-987276203, it is now deprecated. Please use the default quota class for default quota. Apr 29 15:20:06 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-568667b5-2f09-438c-b37d-931a83ec4ee8 tempest-GroupSnapshotsTest-1515970109 None] Created reservations ['fb2de95b-4ff0-47da-a603-2009bd80ca89', '3190d5ab-abc7-4f6c-8c79-d67ecde0718f', 'ecfa0898-06a1-4afa-9734-97247eb8b634', 'c101a7ca-fba7-4d1c-aab1-b558c8128d02'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:20:06 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-568667b5-2f09-438c-b37d-931a83ec4ee8 tempest-GroupSnapshotsTest-1515970109 None] group_snapshot 610dc333-6c32-4243-9f43-147d43488c1b: deleted successfully Apr 29 15:20:06 devstack sudo[100565]: pam_unix(sudo:session): session closed for user root Apr 29 15:20:06 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1919019d-0ef9-4392-a9f2-f1f3674b41ac tempest-VolumesSnapshotTestJSON-1135480884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1.info" returned: 0 in 0.706s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:20:06 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-1919019d-0ef9-4392-a9f2-f1f3674b41ac tempest-VolumesSnapshotTestJSON-1135480884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.377s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:20:06 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-1919019d-0ef9-4392-a9f2-f1f3674b41ac tempest-VolumesSnapshotTestJSON-1135480884 None] Create snapshot completed successfully Apr 29 15:20:07 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-4835a9c6-f360-4331-a892-303e7c6d6c6d tempest-VolumesSnapshotTestJSON-1135480884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:20:07 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4835a9c6-f360-4331-a892-303e7c6d6c6d tempest-VolumesSnapshotTestJSON-1135480884 None] Flow 'volume_create_manager' (412982e6-d232-43e4-84d5-89f1c53297a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:20:07 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4835a9c6-f360-4331-a892-303e7c6d6c6d tempest-VolumesSnapshotTestJSON-1135480884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90df7b8e-5260-4ebe-8431-21009ab9d65f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:20:07 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4835a9c6-f360-4331-a892-303e7c6d6c6d tempest-VolumesSnapshotTestJSON-1135480884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90df7b8e-5260-4ebe-8431-21009ab9d65f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:20:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1381662541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=635122fc-e782-4e92-a82d-85ad5b51b7ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e482872055f43a59a50317dcf761896',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:20:07Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=5899041b-1471-4df5-aaea-40ccbf453649,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:20:07Z,use_quota=True,user_id='38745d6b3d0b4b658fbbef2ced9dc889',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:20:07 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4835a9c6-f360-4331-a892-303e7c6d6c6d tempest-VolumesSnapshotTestJSON-1135480884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa8fc9f1-0d78-442b-8b28-6e9536e80f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:20:07 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4835a9c6-f360-4331-a892-303e7c6d6c6d tempest-VolumesSnapshotTestJSON-1135480884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa8fc9f1-0d78-442b-8b28-6e9536e80f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:20:07 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4835a9c6-f360-4331-a892-303e7c6d6c6d tempest-VolumesSnapshotTestJSON-1135480884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21582ef9-df39-48b9-9180-01405fed9aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:20:07 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4835a9c6-f360-4331-a892-303e7c6d6c6d tempest-VolumesSnapshotTestJSON-1135480884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21582ef9-df39-48b9-9180-01405fed9aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '635122fc-e782-4e92-a82d-85ad5b51b7ec', 'volume_name': 'volume-635122fc-e782-4e92-a82d-85ad5b51b7ec', 'volume_size': 2, 'snapshot_id': '5899041b-1471-4df5-aaea-40ccbf453649'}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:20:07 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4835a9c6-f360-4331-a892-303e7c6d6c6d tempest-VolumesSnapshotTestJSON-1135480884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d756035-0192-4bca-8a38-06b6a85aa383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:20:07 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4835a9c6-f360-4331-a892-303e7c6d6c6d tempest-VolumesSnapshotTestJSON-1135480884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d756035-0192-4bca-8a38-06b6a85aa383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:20:07 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4835a9c6-f360-4331-a892-303e7c6d6c6d tempest-VolumesSnapshotTestJSON-1135480884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12cb89ea-ed6f-40a0-bb43-5b41481968b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:20:07 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-4835a9c6-f360-4331-a892-303e7c6d6c6d tempest-VolumesSnapshotTestJSON-1135480884 None] Volume 635122fc-e782-4e92-a82d-85ad5b51b7ec: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-635122fc-e782-4e92-a82d-85ad5b51b7ec', 'volume_size': 2, 'snapshot_id': '5899041b-1471-4df5-aaea-40ccbf453649'} Apr 29 15:20:07 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-4835a9c6-f360-4331-a892-303e7c6d6c6d tempest-VolumesSnapshotTestJSON-1135480884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:20:07 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-4835a9c6-f360-4331-a892-303e7c6d6c6d tempest-VolumesSnapshotTestJSON-1135480884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:20:07 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-4835a9c6-f360-4331-a892-303e7c6d6c6d tempest-VolumesSnapshotTestJSON-1135480884 None] Acquiring lock "cinder-quobyte-5899041b-1471-4df5-aaea-40ccbf453649-635122fc-e782-4e92-a82d-85ad5b51b7ec" by "_create_volume_from_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:20:07 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-4835a9c6-f360-4331-a892-303e7c6d6c6d tempest-VolumesSnapshotTestJSON-1135480884 None] Lock "cinder-quobyte-5899041b-1471-4df5-aaea-40ccbf453649-635122fc-e782-4e92-a82d-85ad5b51b7ec" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:20:07 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-4835a9c6-f360-4331-a892-303e7c6d6c6d tempest-VolumesSnapshotTestJSON-1135480884 None] Creating volume 635122fc-e782-4e92-a82d-85ad5b51b7ec from snapshot 5899041b-1471-4df5-aaea-40ccbf453649 {{(pid=84448) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 15:20:07 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-4835a9c6-f360-4331-a892-303e7c6d6c6d tempest-VolumesSnapshotTestJSON-1135480884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:20:07 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-4835a9c6-f360-4331-a892-303e7c6d6c6d tempest-VolumesSnapshotTestJSON-1135480884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:20:07 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-4835a9c6-f360-4331-a892-303e7c6d6c6d tempest-VolumesSnapshotTestJSON-1135480884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:20:07 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-4835a9c6-f360-4331-a892-303e7c6d6c6d tempest-VolumesSnapshotTestJSON-1135480884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:20:07 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-4835a9c6-f360-4331-a892-303e7c6d6c6d tempest-VolumesSnapshotTestJSON-1135480884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:20:07 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-4835a9c6-f360-4331-a892-303e7c6d6c6d tempest-VolumesSnapshotTestJSON-1135480884 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:20:07 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-4835a9c6-f360-4331-a892-303e7c6d6c6d tempest-VolumesSnapshotTestJSON-1135480884 None] Acquiring lock "cinder-quobyte-635122fc-e782-4e92-a82d-85ad5b51b7ec" by "_copy_volume_from_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:20:07 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-4835a9c6-f360-4331-a892-303e7c6d6c6d tempest-VolumesSnapshotTestJSON-1135480884 None] Lock "cinder-quobyte-635122fc-e782-4e92-a82d-85ad5b51b7ec" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:20:07 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-4835a9c6-f360-4331-a892-303e7c6d6c6d tempest-VolumesSnapshotTestJSON-1135480884 None] snapshot: 5899041b-1471-4df5-aaea-40ccbf453649, volume: 635122fc-e782-4e92-a82d-85ad5b51b7ec, {{(pid=84448) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 15:20:07 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-4835a9c6-f360-4331-a892-303e7c6d6c6d tempest-VolumesSnapshotTestJSON-1135480884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:20:07 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-4835a9c6-f360-4331-a892-303e7c6d6c6d tempest-VolumesSnapshotTestJSON-1135480884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:20:07 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-4835a9c6-f360-4331-a892-303e7c6d6c6d tempest-VolumesSnapshotTestJSON-1135480884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:20:07 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-4835a9c6-f360-4331-a892-303e7c6d6c6d tempest-VolumesSnapshotTestJSON-1135480884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:20:07 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-4835a9c6-f360-4331-a892-303e7c6d6c6d tempest-VolumesSnapshotTestJSON-1135480884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:20:07 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b753450-c615-4560-84c4-162060305287]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:20:07 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-4835a9c6-f360-4331-a892-303e7c6d6c6d tempest-VolumesSnapshotTestJSON-1135480884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1.5899041b-1471-4df5-aaea-40ccbf453649 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:20:07 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-4d130577-7e0e-4bad-9bbe-eecd58abfa9e tempest-GroupSnapshotsTest-1515970109 None] Acquiring lock "cinder-quobyte-0ae8700b-0692-4495-9e34-d8cdff49a6a0" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:20:07 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-4d130577-7e0e-4bad-9bbe-eecd58abfa9e tempest-GroupSnapshotsTest-1515970109 None] Lock "cinder-quobyte-0ae8700b-0692-4495-9e34-d8cdff49a6a0" acquired by "delete_volume" :: waited 0.021s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:20:07 devstack sudo[100571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1.5899041b-1471-4df5-aaea-40ccbf453649 Apr 29 15:20:07 devstack sudo[100571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:20:07 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad6d9f3d-4cfc-455a-b4cf-fcd334e8f35c]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:20:07 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-4d130577-7e0e-4bad-9bbe-eecd58abfa9e tempest-GroupSnapshotsTest-1515970109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0ae8700b-0692-4495-9e34-d8cdff49a6a0 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:20:07 devstack sudo[100573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0ae8700b-0692-4495-9e34-d8cdff49a6a0 Apr 29 15:20:07 devstack sudo[100573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:20:08 devstack sudo[100571]: pam_unix(sudo:session): session closed for user root Apr 29 15:20:08 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-4835a9c6-f360-4331-a892-303e7c6d6c6d tempest-VolumesSnapshotTestJSON-1135480884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1.5899041b-1471-4df5-aaea-40ccbf453649" returned: 0 in 0.725s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:20:08 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-4835a9c6-f360-4331-a892-303e7c6d6c6d tempest-VolumesSnapshotTestJSON-1135480884 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84448) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 15:20:08 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-4835a9c6-f360-4331-a892-303e7c6d6c6d tempest-VolumesSnapshotTestJSON-1135480884 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1 {{(pid=84448) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 15:20:08 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-4835a9c6-f360-4331-a892-303e7c6d6c6d tempest-VolumesSnapshotTestJSON-1135480884 None] Creating direct copy from snapshot {{(pid=84448) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 15:20:08 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[47283a66-d958-4a2d-a81d-2b1a6bc0081d]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:20:08 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-4835a9c6-f360-4331-a892-303e7c6d6c6d tempest-VolumesSnapshotTestJSON-1135480884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:20:08 devstack sudo[100579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1 Apr 29 15:20:08 devstack sudo[100579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:20:08 devstack sudo[100573]: pam_unix(sudo:session): session closed for user root Apr 29 15:20:08 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-4d130577-7e0e-4bad-9bbe-eecd58abfa9e tempest-GroupSnapshotsTest-1515970109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0ae8700b-0692-4495-9e34-d8cdff49a6a0" returned: 0 in 0.774s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:20:08 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-4d130577-7e0e-4bad-9bbe-eecd58abfa9e tempest-GroupSnapshotsTest-1515970109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0ae8700b-0692-4495-9e34-d8cdff49a6a0 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:20:08 devstack sudo[100583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0ae8700b-0692-4495-9e34-d8cdff49a6a0 Apr 29 15:20:08 devstack sudo[100583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:20:09 devstack sudo[100579]: pam_unix(sudo:session): session closed for user root Apr 29 15:20:09 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-4835a9c6-f360-4331-a892-303e7c6d6c6d tempest-VolumesSnapshotTestJSON-1135480884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1" returned: 0 in 0.766s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:20:09 devstack cinder-volume[84448]: DEBUG cinder.utils [None req-4835a9c6-f360-4331-a892-303e7c6d6c6d tempest-VolumesSnapshotTestJSON-1135480884 None] Path /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-635122fc-e782-4e92-a82d-85ad5b51b7ec not found in is_blk_device check {{(pid=84448) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 15:20:09 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-4835a9c6-f360-4331-a892-303e7c6d6c6d tempest-VolumesSnapshotTestJSON-1135480884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-635122fc-e782-4e92-a82d-85ad5b51b7ec {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:20:09 devstack sudo[100583]: pam_unix(sudo:session): session closed for user root Apr 29 15:20:09 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-4d130577-7e0e-4bad-9bbe-eecd58abfa9e tempest-GroupSnapshotsTest-1515970109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0ae8700b-0692-4495-9e34-d8cdff49a6a0" returned: 0 in 0.608s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:20:09 devstack sudo[100589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-635122fc-e782-4e92-a82d-85ad5b51b7ec Apr 29 15:20:09 devstack sudo[100589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:20:09 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-4d130577-7e0e-4bad-9bbe-eecd58abfa9e tempest-GroupSnapshotsTest-1515970109 None] Lock "cinder-quobyte-0ae8700b-0692-4495-9e34-d8cdff49a6a0" released by "delete_volume" :: held 1.467s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:20:09 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-4d130577-7e0e-4bad-9bbe-eecd58abfa9e tempest-GroupSnapshotsTest-1515970109 None] Created reservations ['c1ea853c-a7e1-4530-89bd-ff72eeed675c'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:20:09 devstack cinder-volume[84448]: WARNING cinder.quota [None req-4d130577-7e0e-4bad-9bbe-eecd58abfa9e tempest-GroupSnapshotsTest-1515970109 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-987276203 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-987276203, it is now deprecated. Please use the default quota class for default quota. Apr 29 15:20:09 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-4d130577-7e0e-4bad-9bbe-eecd58abfa9e tempest-GroupSnapshotsTest-1515970109 None] Created reservations ['d63e4784-a088-4194-847a-44095d8b80e6', '6e298bac-d836-4ad4-ab51-df25db65cad8', '29c1b375-233e-42fd-a52f-6419546d331d', 'a088a594-19a2-491f-bd43-9bb6c37b7727'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:20:09 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-4d130577-7e0e-4bad-9bbe-eecd58abfa9e tempest-GroupSnapshotsTest-1515970109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:20:09 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-4d130577-7e0e-4bad-9bbe-eecd58abfa9e tempest-GroupSnapshotsTest-1515970109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:20:09 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-4d130577-7e0e-4bad-9bbe-eecd58abfa9e tempest-GroupSnapshotsTest-1515970109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:20:09 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-4d130577-7e0e-4bad-9bbe-eecd58abfa9e tempest-GroupSnapshotsTest-1515970109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:20:09 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-4d130577-7e0e-4bad-9bbe-eecd58abfa9e tempest-GroupSnapshotsTest-1515970109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:20:09 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-4d130577-7e0e-4bad-9bbe-eecd58abfa9e tempest-GroupSnapshotsTest-1515970109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:20:09 devstack sudo[100591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:20:09 devstack sudo[100591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:20:10 devstack sudo[100591]: pam_unix(sudo:session): session closed for user root Apr 29 15:20:10 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-4d130577-7e0e-4bad-9bbe-eecd58abfa9e tempest-GroupSnapshotsTest-1515970109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.777s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:20:10 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-4d130577-7e0e-4bad-9bbe-eecd58abfa9e tempest-GroupSnapshotsTest-1515970109 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:20:10 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-4d130577-7e0e-4bad-9bbe-eecd58abfa9e tempest-GroupSnapshotsTest-1515970109 None] Delete group completed successfully. Apr 29 15:20:14 devstack sudo[100589]: pam_unix(sudo:session): session closed for user root Apr 29 15:20:15 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-4835a9c6-f360-4331-a892-303e7c6d6c6d tempest-VolumesSnapshotTestJSON-1135480884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-635122fc-e782-4e92-a82d-85ad5b51b7ec" returned: 0 in 5.791s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:20:15 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cab2263-e44c-40fc-997c-b96c71ab6bbf]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:20:15 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-4835a9c6-f360-4331-a892-303e7c6d6c6d tempest-VolumesSnapshotTestJSON-1135480884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:20:15 devstack sudo[100607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1 Apr 29 15:20:15 devstack sudo[100607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:20:16 devstack sudo[100607]: pam_unix(sudo:session): session closed for user root Apr 29 15:20:16 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-4835a9c6-f360-4331-a892-303e7c6d6c6d tempest-VolumesSnapshotTestJSON-1135480884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1" returned: 0 in 1.040s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:20:16 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [None req-4835a9c6-f360-4331-a892-303e7c6d6c6d tempest-VolumesSnapshotTestJSON-1135480884 None] Image conversion details: src /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1, size 1024.00 MB, duration 5.79 sec, destination /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-635122fc-e782-4e92-a82d-85ad5b51b7ec {{(pid=84448) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 15:20:16 devstack cinder-volume[84448]: INFO cinder.image.image_utils [None req-4835a9c6-f360-4331-a892-303e7c6d6c6d tempest-VolumesSnapshotTestJSON-1135480884 None] Converted 1024.00 MB image at 176.79 MB/s Apr 29 15:20:16 devstack cinder-volume[84448]: WARNING cinder.volume.drivers.remotefs [None req-4835a9c6-f360-4331-a892-303e7c6d6c6d tempest-VolumesSnapshotTestJSON-1135480884 None] /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-635122fc-e782-4e92-a82d-85ad5b51b7ec is being set with open permissions: ugo+rw Apr 29 15:20:16 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-4835a9c6-f360-4331-a892-303e7c6d6c6d tempest-VolumesSnapshotTestJSON-1135480884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-635122fc-e782-4e92-a82d-85ad5b51b7ec {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:20:16 devstack sudo[100613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-635122fc-e782-4e92-a82d-85ad5b51b7ec Apr 29 15:20:16 devstack sudo[100613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:20:16 devstack sudo[100613]: pam_unix(sudo:session): session closed for user root Apr 29 15:20:16 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-4835a9c6-f360-4331-a892-303e7c6d6c6d tempest-VolumesSnapshotTestJSON-1135480884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-635122fc-e782-4e92-a82d-85ad5b51b7ec" returned: 0 in 0.615s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:20:16 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-4835a9c6-f360-4331-a892-303e7c6d6c6d tempest-VolumesSnapshotTestJSON-1135480884 None] Lock "cinder-quobyte-635122fc-e782-4e92-a82d-85ad5b51b7ec" released by "_copy_volume_from_snapshot" :: held 9.067s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:20:16 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-4835a9c6-f360-4331-a892-303e7c6d6c6d tempest-VolumesSnapshotTestJSON-1135480884 None] Lock "cinder-quobyte-5899041b-1471-4df5-aaea-40ccbf453649-635122fc-e782-4e92-a82d-85ad5b51b7ec" released by "_create_volume_from_snapshot" :: held 9.105s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:20:16 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-4835a9c6-f360-4331-a892-303e7c6d6c6d tempest-VolumesSnapshotTestJSON-1135480884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.124s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:20:16 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4835a9c6-f360-4331-a892-303e7c6d6c6d tempest-VolumesSnapshotTestJSON-1135480884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12cb89ea-ed6f-40a0-bb43-5b41481968b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-635122fc-e782-4e92-a82d-85ad5b51b7ec', 'volume_size': 2, 'snapshot_id': '5899041b-1471-4df5-aaea-40ccbf453649'}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:20:16 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4835a9c6-f360-4331-a892-303e7c6d6c6d tempest-VolumesSnapshotTestJSON-1135480884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (371ce2ce-5b24-4267-9c26-25ac96682147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:20:16 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-4835a9c6-f360-4331-a892-303e7c6d6c6d tempest-VolumesSnapshotTestJSON-1135480884 None] Volume volume-635122fc-e782-4e92-a82d-85ad5b51b7ec (635122fc-e782-4e92-a82d-85ad5b51b7ec): created successfully Apr 29 15:20:16 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4835a9c6-f360-4331-a892-303e7c6d6c6d tempest-VolumesSnapshotTestJSON-1135480884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (371ce2ce-5b24-4267-9c26-25ac96682147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:20:16 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4835a9c6-f360-4331-a892-303e7c6d6c6d tempest-VolumesSnapshotTestJSON-1135480884 None] Flow 'volume_create_manager' (412982e6-d232-43e4-84d5-89f1c53297a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:20:16 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-4835a9c6-f360-4331-a892-303e7c6d6c6d tempest-VolumesSnapshotTestJSON-1135480884 None] Created volume successfully. Apr 29 15:20:17 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-34968d4c-4768-4004-8c86-0d06b711ed4b tempest-VolumesSnapshotTestJSON-1135480884 None] Acquiring lock "cinder-635122fc-e782-4e92-a82d-85ad5b51b7ec-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:20:17 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-34968d4c-4768-4004-8c86-0d06b711ed4b tempest-VolumesSnapshotTestJSON-1135480884 None] Lock "cinder-635122fc-e782-4e92-a82d-85ad5b51b7ec-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:20:17 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-34968d4c-4768-4004-8c86-0d06b711ed4b tempest-VolumesSnapshotTestJSON-1135480884 None] Acquiring lock "cinder-quobyte-635122fc-e782-4e92-a82d-85ad5b51b7ec" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:20:17 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-34968d4c-4768-4004-8c86-0d06b711ed4b tempest-VolumesSnapshotTestJSON-1135480884 None] Lock "cinder-quobyte-635122fc-e782-4e92-a82d-85ad5b51b7ec" acquired by "delete_volume" :: waited 0.024s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:20:17 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a19a60-41ec-4d80-b3df-014771bf5366]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:20:17 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-34968d4c-4768-4004-8c86-0d06b711ed4b tempest-VolumesSnapshotTestJSON-1135480884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-635122fc-e782-4e92-a82d-85ad5b51b7ec {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:20:17 devstack sudo[100618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-635122fc-e782-4e92-a82d-85ad5b51b7ec Apr 29 15:20:17 devstack sudo[100618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:20:18 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-d8d7d199-73ac-48e4-b642-6b4d576ccc1f tempest-GroupSnapshotsV319Test-1474533239 None] Group tempest-GroupSnapshotsV319Test-Group-684579317: creating Apr 29 15:20:18 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-d8d7d199-73ac-48e4-b642-6b4d576ccc1f tempest-GroupSnapshotsV319Test-1474533239 None] Group tempest-GroupSnapshotsV319Test-Group-684579317: created successfully Apr 29 15:20:18 devstack sudo[100618]: pam_unix(sudo:session): session closed for user root Apr 29 15:20:18 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-d8d7d199-73ac-48e4-b642-6b4d576ccc1f tempest-GroupSnapshotsV319Test-1474533239 None] Create group completed successfully. Apr 29 15:20:18 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-34968d4c-4768-4004-8c86-0d06b711ed4b tempest-VolumesSnapshotTestJSON-1135480884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-635122fc-e782-4e92-a82d-85ad5b51b7ec" returned: 0 in 0.779s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:20:18 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-34968d4c-4768-4004-8c86-0d06b711ed4b tempest-VolumesSnapshotTestJSON-1135480884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-635122fc-e782-4e92-a82d-85ad5b51b7ec {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:20:18 devstack sudo[100623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-635122fc-e782-4e92-a82d-85ad5b51b7ec Apr 29 15:20:18 devstack sudo[100623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:20:19 devstack sudo[100623]: pam_unix(sudo:session): session closed for user root Apr 29 15:20:19 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-34968d4c-4768-4004-8c86-0d06b711ed4b tempest-VolumesSnapshotTestJSON-1135480884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-635122fc-e782-4e92-a82d-85ad5b51b7ec" returned: 0 in 0.596s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:20:19 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-34968d4c-4768-4004-8c86-0d06b711ed4b tempest-VolumesSnapshotTestJSON-1135480884 None] Lock "cinder-quobyte-635122fc-e782-4e92-a82d-85ad5b51b7ec" released by "delete_volume" :: held 1.433s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:20:19 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-34968d4c-4768-4004-8c86-0d06b711ed4b tempest-VolumesSnapshotTestJSON-1135480884 None] Created reservations ['3ecdd1a4-4d68-4408-b744-1aca571539d6', 'dcba3f2d-b74d-4a8b-a05b-b4e03fc81dd7', 'ddb72cce-dd6c-415e-a369-d8ebc666670a', '6a3e5e8f-0d52-42d8-8b56-e5754a4eaa3e'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:20:19 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-34968d4c-4768-4004-8c86-0d06b711ed4b tempest-VolumesSnapshotTestJSON-1135480884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:20:19 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-34968d4c-4768-4004-8c86-0d06b711ed4b tempest-VolumesSnapshotTestJSON-1135480884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:20:19 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-34968d4c-4768-4004-8c86-0d06b711ed4b tempest-VolumesSnapshotTestJSON-1135480884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:20:19 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-34968d4c-4768-4004-8c86-0d06b711ed4b tempest-VolumesSnapshotTestJSON-1135480884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:20:19 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-34968d4c-4768-4004-8c86-0d06b711ed4b tempest-VolumesSnapshotTestJSON-1135480884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:20:19 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-34968d4c-4768-4004-8c86-0d06b711ed4b tempest-VolumesSnapshotTestJSON-1135480884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:20:19 devstack sudo[100626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:20:19 devstack sudo[100626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:20:19 devstack sudo[100626]: pam_unix(sudo:session): session closed for user root Apr 29 15:20:19 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-34968d4c-4768-4004-8c86-0d06b711ed4b tempest-VolumesSnapshotTestJSON-1135480884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.597s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:20:19 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-34968d4c-4768-4004-8c86-0d06b711ed4b tempest-VolumesSnapshotTestJSON-1135480884 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:20:19 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-34968d4c-4768-4004-8c86-0d06b711ed4b tempest-VolumesSnapshotTestJSON-1135480884 None] Deleted volume successfully. Apr 29 15:20:19 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-34968d4c-4768-4004-8c86-0d06b711ed4b tempest-VolumesSnapshotTestJSON-1135480884 None] Lock "cinder-635122fc-e782-4e92-a82d-85ad5b51b7ec-delete_volume" released by "delete_volume" :: held 2.253s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:20:19 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-19315cc1-ac87-4cba-85f0-ef8c6575150e tempest-VolumesSnapshotTestJSON-1135480884 None] Acquiring lock "cinder-5899041b-1471-4df5-aaea-40ccbf453649-delete_snapshot" by "delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:20:19 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-19315cc1-ac87-4cba-85f0-ef8c6575150e tempest-VolumesSnapshotTestJSON-1135480884 None] Lock "cinder-5899041b-1471-4df5-aaea-40ccbf453649-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:20:19 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-19315cc1-ac87-4cba-85f0-ef8c6575150e tempest-VolumesSnapshotTestJSON-1135480884 None] Acquiring lock "cinder-quobyte-c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1" by "delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:20:19 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-19315cc1-ac87-4cba-85f0-ef8c6575150e tempest-VolumesSnapshotTestJSON-1135480884 None] Lock "cinder-quobyte-c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1" acquired by "delete_snapshot" :: waited 0.016s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:20:19 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-19315cc1-ac87-4cba-85f0-ef8c6575150e tempest-VolumesSnapshotTestJSON-1135480884 None] Acquiring lock "cinder-quobyte-5899041b-1471-4df5-aaea-40ccbf453649" by "_delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:20:20 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-19315cc1-ac87-4cba-85f0-ef8c6575150e tempest-VolumesSnapshotTestJSON-1135480884 None] Lock "cinder-quobyte-5899041b-1471-4df5-aaea-40ccbf453649" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:20:20 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-19315cc1-ac87-4cba-85f0-ef8c6575150e tempest-VolumesSnapshotTestJSON-1135480884 None] Deleting offline snapshot 5899041b-1471-4df5-aaea-40ccbf453649 of volume c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1 {{(pid=84448) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 15:20:20 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-19315cc1-ac87-4cba-85f0-ef8c6575150e tempest-VolumesSnapshotTestJSON-1135480884 None] snapshot_file for this snap is: volume-c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1.5899041b-1471-4df5-aaea-40ccbf453649 {{(pid=84448) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 15:20:20 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf8f20ba-4839-4c8f-8773-47ed672d8843]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:20:20 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-19315cc1-ac87-4cba-85f0-ef8c6575150e tempest-VolumesSnapshotTestJSON-1135480884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1.5899041b-1471-4df5-aaea-40ccbf453649 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:20:20 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c5b89fd-d61a-4d2b-9157-e109f5d4f5cf tempest-GroupSnapshotsV319Test-1474533239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:20:20 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-7c5b89fd-d61a-4d2b-9157-e109f5d4f5cf tempest-GroupSnapshotsV319Test-1474533239 None] Flow 'volume_create_manager' (6cb01d18-6120-4405-94cd-9d2969feb35d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:20:20 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-7c5b89fd-d61a-4d2b-9157-e109f5d4f5cf tempest-GroupSnapshotsV319Test-1474533239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d92a58f-abef-40c9-8050-84f2d0ef9b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:20:20 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-7c5b89fd-d61a-4d2b-9157-e109f5d4f5cf tempest-GroupSnapshotsV319Test-1474533239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d92a58f-abef-40c9-8050-84f2d0ef9b81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:20:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1208340774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f3c5217d-f5fd-4a9e-9fb1-d1ece6a0d58f,host='devstack@QuobyteHD#QuobyteHD',id=748b5653-f2fe-4d24-ad54-dbcc80385395,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6faf7cb3d51411c9f0d5f945b6b4ebb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:20:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:20:20Z,use_quota=True,user_id='20115854ef8d4895bab2d62ce964f013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a2dc69b-49b5-43e7-88a8-04bd480f0486),volume_type_id=1a2dc69b-49b5-43e7-88a8-04bd480f0486)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:20:20 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-7c5b89fd-d61a-4d2b-9157-e109f5d4f5cf tempest-GroupSnapshotsV319Test-1474533239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e7e24f8-a08f-4513-aa22-c63f83dac41d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:20:20 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-7c5b89fd-d61a-4d2b-9157-e109f5d4f5cf tempest-GroupSnapshotsV319Test-1474533239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e7e24f8-a08f-4513-aa22-c63f83dac41d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:20:20 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-7c5b89fd-d61a-4d2b-9157-e109f5d4f5cf tempest-GroupSnapshotsV319Test-1474533239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b0fffc1-96de-47cb-9a4f-5f2c537f711a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:20:20 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-7c5b89fd-d61a-4d2b-9157-e109f5d4f5cf tempest-GroupSnapshotsV319Test-1474533239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b0fffc1-96de-47cb-9a4f-5f2c537f711a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '748b5653-f2fe-4d24-ad54-dbcc80385395', 'volume_name': 'volume-748b5653-f2fe-4d24-ad54-dbcc80385395', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:20:20 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-7c5b89fd-d61a-4d2b-9157-e109f5d4f5cf tempest-GroupSnapshotsV319Test-1474533239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (248306ef-24c3-4a66-8c03-38a6a7c5070a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:20:20 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-7c5b89fd-d61a-4d2b-9157-e109f5d4f5cf tempest-GroupSnapshotsV319Test-1474533239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (248306ef-24c3-4a66-8c03-38a6a7c5070a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:20:20 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-7c5b89fd-d61a-4d2b-9157-e109f5d4f5cf tempest-GroupSnapshotsV319Test-1474533239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2de81da-9970-4df5-93c0-062253a24223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:20:20 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-7c5b89fd-d61a-4d2b-9157-e109f5d4f5cf tempest-GroupSnapshotsV319Test-1474533239 None] Volume 748b5653-f2fe-4d24-ad54-dbcc80385395: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-748b5653-f2fe-4d24-ad54-dbcc80385395', 'volume_size': 1} Apr 29 15:20:20 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-7c5b89fd-d61a-4d2b-9157-e109f5d4f5cf tempest-GroupSnapshotsV319Test-1474533239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:20:20 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-7c5b89fd-d61a-4d2b-9157-e109f5d4f5cf tempest-GroupSnapshotsV319Test-1474533239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:20:20 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-7c5b89fd-d61a-4d2b-9157-e109f5d4f5cf tempest-GroupSnapshotsV319Test-1474533239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f3c5217d-f5fd-4a9e-9fb1-d1ece6a0d58f,created_at=2026-04-29T13:20:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1208340774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f3c5217d-f5fd-4a9e-9fb1-d1ece6a0d58f,host='devstack@QuobyteHD#QuobyteHD',id=748b5653-f2fe-4d24-ad54-dbcc80385395,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6faf7cb3d51411c9f0d5f945b6b4ebb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:20:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:20:20Z,use_quota=True,user_id='20115854ef8d4895bab2d62ce964f013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a2dc69b-49b5-43e7-88a8-04bd480f0486),volume_type_id=1a2dc69b-49b5-43e7-88a8-04bd480f0486)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:20:20 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-7c5b89fd-d61a-4d2b-9157-e109f5d4f5cf tempest-GroupSnapshotsV319Test-1474533239 None] Creating volume 748b5653-f2fe-4d24-ad54-dbcc80385395 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:20:20 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-7c5b89fd-d61a-4d2b-9157-e109f5d4f5cf tempest-GroupSnapshotsV319Test-1474533239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:20:20 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-7c5b89fd-d61a-4d2b-9157-e109f5d4f5cf tempest-GroupSnapshotsV319Test-1474533239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:20:20 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-7c5b89fd-d61a-4d2b-9157-e109f5d4f5cf tempest-GroupSnapshotsV319Test-1474533239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:20:20 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-7c5b89fd-d61a-4d2b-9157-e109f5d4f5cf tempest-GroupSnapshotsV319Test-1474533239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:20:20 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-7c5b89fd-d61a-4d2b-9157-e109f5d4f5cf tempest-GroupSnapshotsV319Test-1474533239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:20:20 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-7c5b89fd-d61a-4d2b-9157-e109f5d4f5cf tempest-GroupSnapshotsV319Test-1474533239 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:20:20 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-7c5b89fd-d61a-4d2b-9157-e109f5d4f5cf tempest-GroupSnapshotsV319Test-1474533239 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:20:20 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7c5b89fd-d61a-4d2b-9157-e109f5d4f5cf tempest-GroupSnapshotsV319Test-1474533239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-748b5653-f2fe-4d24-ad54-dbcc80385395 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:20:20 devstack sudo[100629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1.5899041b-1471-4df5-aaea-40ccbf453649 Apr 29 15:20:20 devstack sudo[100629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:20:20 devstack sudo[100631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-748b5653-f2fe-4d24-ad54-dbcc80385395 1073741824 Apr 29 15:20:20 devstack sudo[100631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:20:20 devstack sudo[100629]: pam_unix(sudo:session): session closed for user root Apr 29 15:20:20 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-19315cc1-ac87-4cba-85f0-ef8c6575150e tempest-VolumesSnapshotTestJSON-1135480884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1.5899041b-1471-4df5-aaea-40ccbf453649" returned: 0 in 0.729s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:20:20 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-19315cc1-ac87-4cba-85f0-ef8c6575150e tempest-VolumesSnapshotTestJSON-1135480884 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84448) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 15:20:20 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec605551-1480-40a6-aac7-ceb00c5d13fa]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:20:20 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-19315cc1-ac87-4cba-85f0-ef8c6575150e tempest-VolumesSnapshotTestJSON-1135480884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:20:20 devstack sudo[100641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1 Apr 29 15:20:20 devstack sudo[100641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:20:20 devstack sudo[100631]: pam_unix(sudo:session): session closed for user root Apr 29 15:20:20 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7c5b89fd-d61a-4d2b-9157-e109f5d4f5cf tempest-GroupSnapshotsV319Test-1474533239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-748b5653-f2fe-4d24-ad54-dbcc80385395 1073741824" returned: 0 in 0.799s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:20:21 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7c5b89fd-d61a-4d2b-9157-e109f5d4f5cf tempest-GroupSnapshotsV319Test-1474533239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-748b5653-f2fe-4d24-ad54-dbcc80385395 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:20:21 devstack sudo[100643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-748b5653-f2fe-4d24-ad54-dbcc80385395 Apr 29 15:20:21 devstack sudo[100643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:20:21 devstack sudo[100641]: pam_unix(sudo:session): session closed for user root Apr 29 15:20:21 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-19315cc1-ac87-4cba-85f0-ef8c6575150e tempest-VolumesSnapshotTestJSON-1135480884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1" returned: 0 in 0.771s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:20:21 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-19315cc1-ac87-4cba-85f0-ef8c6575150e tempest-VolumesSnapshotTestJSON-1135480884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1.5899041b-1471-4df5-aaea-40ccbf453649 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:20:21 devstack sudo[100649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1.5899041b-1471-4df5-aaea-40ccbf453649 Apr 29 15:20:21 devstack sudo[100649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:20:21 devstack sudo[100643]: pam_unix(sudo:session): session closed for user root Apr 29 15:20:21 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7c5b89fd-d61a-4d2b-9157-e109f5d4f5cf tempest-GroupSnapshotsV319Test-1474533239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-748b5653-f2fe-4d24-ad54-dbcc80385395" returned: 0 in 0.607s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:20:21 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-7c5b89fd-d61a-4d2b-9157-e109f5d4f5cf tempest-GroupSnapshotsV319Test-1474533239 None] <== create_volume: return (1472ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:20:21 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-7c5b89fd-d61a-4d2b-9157-e109f5d4f5cf tempest-GroupSnapshotsV319Test-1474533239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.475s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:20:21 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-7c5b89fd-d61a-4d2b-9157-e109f5d4f5cf tempest-GroupSnapshotsV319Test-1474533239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2de81da-9970-4df5-93c0-062253a24223) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-748b5653-f2fe-4d24-ad54-dbcc80385395', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:20:21 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-7c5b89fd-d61a-4d2b-9157-e109f5d4f5cf tempest-GroupSnapshotsV319Test-1474533239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c94d6801-9931-4abf-bf5f-c3a53dca98ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:20:21 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-7c5b89fd-d61a-4d2b-9157-e109f5d4f5cf tempest-GroupSnapshotsV319Test-1474533239 None] Volume volume-748b5653-f2fe-4d24-ad54-dbcc80385395 (748b5653-f2fe-4d24-ad54-dbcc80385395): created successfully Apr 29 15:20:21 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-7c5b89fd-d61a-4d2b-9157-e109f5d4f5cf tempest-GroupSnapshotsV319Test-1474533239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c94d6801-9931-4abf-bf5f-c3a53dca98ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:20:21 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-7c5b89fd-d61a-4d2b-9157-e109f5d4f5cf tempest-GroupSnapshotsV319Test-1474533239 None] Flow 'volume_create_manager' (6cb01d18-6120-4405-94cd-9d2969feb35d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:20:21 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-7c5b89fd-d61a-4d2b-9157-e109f5d4f5cf tempest-GroupSnapshotsV319Test-1474533239 None] Created volume successfully. Apr 29 15:20:22 devstack sudo[100649]: pam_unix(sudo:session): session closed for user root Apr 29 15:20:22 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-19315cc1-ac87-4cba-85f0-ef8c6575150e tempest-VolumesSnapshotTestJSON-1135480884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1.5899041b-1471-4df5-aaea-40ccbf453649" returned: 0 in 0.699s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:20:22 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-19315cc1-ac87-4cba-85f0-ef8c6575150e tempest-VolumesSnapshotTestJSON-1135480884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1.5899041b-1471-4df5-aaea-40ccbf453649 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:20:22 devstack sudo[100654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1.5899041b-1471-4df5-aaea-40ccbf453649 Apr 29 15:20:22 devstack sudo[100654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:20:22 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-55d9f09c-5815-4813-bff6-e655379b4499 tempest-GroupSnapshotsV319Test-1474533239 None] GroupSnapshot a02c0fa8-93bc-4ac1-9682-538f85a214cb: creating. Apr 29 15:20:22 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-55d9f09c-5815-4813-bff6-e655379b4499 tempest-GroupSnapshotsV319Test-1474533239 None] Group snapshot a02c0fa8-93bc-4ac1-9682-538f85a214cb: creating. {{(pid=84448) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 29 15:20:22 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-55d9f09c-5815-4813-bff6-e655379b4499 tempest-GroupSnapshotsV319Test-1474533239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:20:22 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-55d9f09c-5815-4813-bff6-e655379b4499 tempest-GroupSnapshotsV319Test-1474533239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:20:22 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-55d9f09c-5815-4813-bff6-e655379b4499 tempest-GroupSnapshotsV319Test-1474533239 None] Creating offline snapshot 45eb9e4a-aa86-4bf2-aa5e-7319d062f10e of volume 748b5653-f2fe-4d24-ad54-dbcc80385395 {{(pid=84448) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 15:20:22 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f9938f4-d791-44d3-892d-88c2401d4b53]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:20:22 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-55d9f09c-5815-4813-bff6-e655379b4499 tempest-GroupSnapshotsV319Test-1474533239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-748b5653-f2fe-4d24-ad54-dbcc80385395 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:20:22 devstack sudo[100656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-748b5653-f2fe-4d24-ad54-dbcc80385395 Apr 29 15:20:22 devstack sudo[100656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:20:23 devstack sudo[100654]: pam_unix(sudo:session): session closed for user root Apr 29 15:20:23 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-19315cc1-ac87-4cba-85f0-ef8c6575150e tempest-VolumesSnapshotTestJSON-1135480884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1.5899041b-1471-4df5-aaea-40ccbf453649" returned: 0 in 0.813s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:20:23 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-19315cc1-ac87-4cba-85f0-ef8c6575150e tempest-VolumesSnapshotTestJSON-1135480884 None] Lock "cinder-quobyte-5899041b-1471-4df5-aaea-40ccbf453649" released by "_delete_snapshot" :: held 3.145s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:20:23 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-19315cc1-ac87-4cba-85f0-ef8c6575150e tempest-VolumesSnapshotTestJSON-1135480884 None] Lock "cinder-quobyte-c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1" released by "delete_snapshot" :: held 3.178s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:20:23 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-19315cc1-ac87-4cba-85f0-ef8c6575150e tempest-VolumesSnapshotTestJSON-1135480884 None] Created reservations ['fedf98f4-409b-4a04-9f44-979f0058fe43', '25265594-efcf-40b0-a423-6ff84554be51', 'ccf1021b-97ad-4b82-95f7-c0bfe15d24e4', '1c655eee-c2bd-40ad-ae22-5c2ceae76235'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:20:23 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-19315cc1-ac87-4cba-85f0-ef8c6575150e tempest-VolumesSnapshotTestJSON-1135480884 None] Delete snapshot completed successfully. Apr 29 15:20:23 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-19315cc1-ac87-4cba-85f0-ef8c6575150e tempest-VolumesSnapshotTestJSON-1135480884 None] Lock "cinder-5899041b-1471-4df5-aaea-40ccbf453649-delete_snapshot" released by "delete_snapshot" :: held 3.346s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:20:23 devstack sudo[100656]: pam_unix(sudo:session): session closed for user root Apr 29 15:20:23 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-55d9f09c-5815-4813-bff6-e655379b4499 tempest-GroupSnapshotsV319Test-1474533239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-748b5653-f2fe-4d24-ad54-dbcc80385395" returned: 0 in 0.867s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:20:23 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-55d9f09c-5815-4813-bff6-e655379b4499 tempest-GroupSnapshotsV319Test-1474533239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-748b5653-f2fe-4d24-ad54-dbcc80385395,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-748b5653-f2fe-4d24-ad54-dbcc80385395.45eb9e4a-aa86-4bf2-aa5e-7319d062f10e 1G {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:20:23 devstack sudo[100662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-748b5653-f2fe-4d24-ad54-dbcc80385395,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-748b5653-f2fe-4d24-ad54-dbcc80385395.45eb9e4a-aa86-4bf2-aa5e-7319d062f10e 1G Apr 29 15:20:23 devstack sudo[100662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:20:24 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-9b4c9949-2cba-406a-8e68-6da35560ad72 tempest-VolumesSnapshotTestJSON-1135480884 None] Acquiring lock "cinder-c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:20:24 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-9b4c9949-2cba-406a-8e68-6da35560ad72 tempest-VolumesSnapshotTestJSON-1135480884 None] Lock "cinder-c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:20:24 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-9b4c9949-2cba-406a-8e68-6da35560ad72 tempest-VolumesSnapshotTestJSON-1135480884 None] Acquiring lock "cinder-quobyte-c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:20:24 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-9b4c9949-2cba-406a-8e68-6da35560ad72 tempest-VolumesSnapshotTestJSON-1135480884 None] Lock "cinder-quobyte-c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1" acquired by "delete_volume" :: waited 0.022s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:20:24 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[cabce09c-26ba-4659-98d0-1a469838689a]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:20:24 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-9b4c9949-2cba-406a-8e68-6da35560ad72 tempest-VolumesSnapshotTestJSON-1135480884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:20:24 devstack sudo[100662]: pam_unix(sudo:session): session closed for user root Apr 29 15:20:24 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-55d9f09c-5815-4813-bff6-e655379b4499 tempest-GroupSnapshotsV319Test-1474533239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-748b5653-f2fe-4d24-ad54-dbcc80385395,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-748b5653-f2fe-4d24-ad54-dbcc80385395.45eb9e4a-aa86-4bf2-aa5e-7319d062f10e 1G" returned: 0 in 1.029s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:20:24 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-55d9f09c-5815-4813-bff6-e655379b4499 tempest-GroupSnapshotsV319Test-1474533239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-748b5653-f2fe-4d24-ad54-dbcc80385395 -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-748b5653-f2fe-4d24-ad54-dbcc80385395.45eb9e4a-aa86-4bf2-aa5e-7319d062f10e {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:20:24 devstack sudo[100680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-748b5653-f2fe-4d24-ad54-dbcc80385395 -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-748b5653-f2fe-4d24-ad54-dbcc80385395.45eb9e4a-aa86-4bf2-aa5e-7319d062f10e Apr 29 15:20:24 devstack sudo[100680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:20:24 devstack sudo[100679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1 Apr 29 15:20:24 devstack sudo[100679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:20:25 devstack sudo[100680]: pam_unix(sudo:session): session closed for user root Apr 29 15:20:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-55d9f09c-5815-4813-bff6-e655379b4499 tempest-GroupSnapshotsV319Test-1474533239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-748b5653-f2fe-4d24-ad54-dbcc80385395 -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-748b5653-f2fe-4d24-ad54-dbcc80385395.45eb9e4a-aa86-4bf2-aa5e-7319d062f10e" returned: 0 in 0.754s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:20:25 devstack cinder-volume[84448]: WARNING cinder.volume.drivers.remotefs [None req-55d9f09c-5815-4813-bff6-e655379b4499 tempest-GroupSnapshotsV319Test-1474533239 None] /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-748b5653-f2fe-4d24-ad54-dbcc80385395.45eb9e4a-aa86-4bf2-aa5e-7319d062f10e is being set with open permissions: ugo+rw: NotImplementedError Apr 29 15:20:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-55d9f09c-5815-4813-bff6-e655379b4499 tempest-GroupSnapshotsV319Test-1474533239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-748b5653-f2fe-4d24-ad54-dbcc80385395.45eb9e4a-aa86-4bf2-aa5e-7319d062f10e {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:20:25 devstack sudo[100679]: pam_unix(sudo:session): session closed for user root Apr 29 15:20:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-9b4c9949-2cba-406a-8e68-6da35560ad72 tempest-VolumesSnapshotTestJSON-1135480884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1" returned: 0 in 0.802s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:20:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-9b4c9949-2cba-406a-8e68-6da35560ad72 tempest-VolumesSnapshotTestJSON-1135480884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:20:25 devstack sudo[100695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-748b5653-f2fe-4d24-ad54-dbcc80385395.45eb9e4a-aa86-4bf2-aa5e-7319d062f10e Apr 29 15:20:25 devstack sudo[100695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:20:25 devstack sudo[100696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1 Apr 29 15:20:25 devstack sudo[100696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:20:25 devstack sudo[100695]: pam_unix(sudo:session): session closed for user root Apr 29 15:20:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-55d9f09c-5815-4813-bff6-e655379b4499 tempest-GroupSnapshotsV319Test-1474533239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-748b5653-f2fe-4d24-ad54-dbcc80385395.45eb9e4a-aa86-4bf2-aa5e-7319d062f10e" returned: 0 in 0.630s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:20:25 devstack sudo[100696]: pam_unix(sudo:session): session closed for user root Apr 29 15:20:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-55d9f09c-5815-4813-bff6-e655379b4499 tempest-GroupSnapshotsV319Test-1474533239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-748b5653-f2fe-4d24-ad54-dbcc80385395.info {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:20:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-9b4c9949-2cba-406a-8e68-6da35560ad72 tempest-VolumesSnapshotTestJSON-1135480884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1" returned: 0 in 0.652s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:20:25 devstack sudo[100702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-748b5653-f2fe-4d24-ad54-dbcc80385395.info Apr 29 15:20:25 devstack sudo[100702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:20:25 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-9b4c9949-2cba-406a-8e68-6da35560ad72 tempest-VolumesSnapshotTestJSON-1135480884 None] Lock "cinder-quobyte-c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1" released by "delete_volume" :: held 1.557s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:20:26 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-9b4c9949-2cba-406a-8e68-6da35560ad72 tempest-VolumesSnapshotTestJSON-1135480884 None] Created reservations ['0e6d9987-9a67-4786-9b82-7f7e193ea617', '9f943025-e16d-4e9d-8ebe-be372ce1cd3f', '91e0d1f0-6b54-40e0-bd58-22d3fd6c890d', '0aa48693-d8fb-41f1-9814-952f54661731'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:20:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-9b4c9949-2cba-406a-8e68-6da35560ad72 tempest-VolumesSnapshotTestJSON-1135480884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:20:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-9b4c9949-2cba-406a-8e68-6da35560ad72 tempest-VolumesSnapshotTestJSON-1135480884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:20:26 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-9b4c9949-2cba-406a-8e68-6da35560ad72 tempest-VolumesSnapshotTestJSON-1135480884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:20:26 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-9b4c9949-2cba-406a-8e68-6da35560ad72 tempest-VolumesSnapshotTestJSON-1135480884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:20:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-9b4c9949-2cba-406a-8e68-6da35560ad72 tempest-VolumesSnapshotTestJSON-1135480884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:20:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-9b4c9949-2cba-406a-8e68-6da35560ad72 tempest-VolumesSnapshotTestJSON-1135480884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:20:26 devstack sudo[100704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:20:26 devstack sudo[100704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:20:26 devstack sudo[100702]: pam_unix(sudo:session): session closed for user root Apr 29 15:20:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-55d9f09c-5815-4813-bff6-e655379b4499 tempest-GroupSnapshotsV319Test-1474533239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-748b5653-f2fe-4d24-ad54-dbcc80385395.info" returned: 0 in 0.665s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:20:26 devstack cinder-volume[84448]: WARNING cinder.volume.drivers.remotefs [None req-55d9f09c-5815-4813-bff6-e655379b4499 tempest-GroupSnapshotsV319Test-1474533239 None] /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-748b5653-f2fe-4d24-ad54-dbcc80385395.info is being set with open permissions: ugo+rw: NotImplementedError Apr 29 15:20:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-55d9f09c-5815-4813-bff6-e655379b4499 tempest-GroupSnapshotsV319Test-1474533239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-748b5653-f2fe-4d24-ad54-dbcc80385395.info {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:20:26 devstack sudo[100708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-748b5653-f2fe-4d24-ad54-dbcc80385395.info Apr 29 15:20:26 devstack sudo[100708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:20:26 devstack sudo[100704]: pam_unix(sudo:session): session closed for user root Apr 29 15:20:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-9b4c9949-2cba-406a-8e68-6da35560ad72 tempest-VolumesSnapshotTestJSON-1135480884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.629s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:20:26 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-9b4c9949-2cba-406a-8e68-6da35560ad72 tempest-VolumesSnapshotTestJSON-1135480884 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:20:26 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-9b4c9949-2cba-406a-8e68-6da35560ad72 tempest-VolumesSnapshotTestJSON-1135480884 None] Deleted volume successfully. Apr 29 15:20:26 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-9b4c9949-2cba-406a-8e68-6da35560ad72 tempest-VolumesSnapshotTestJSON-1135480884 None] Lock "cinder-c7e4ab98-5062-44f0-a9fc-933ceb1ba8c1-delete_volume" released by "delete_volume" :: held 2.410s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:20:27 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-5754160e-da8e-4aab-9b17-b62ab951b60b tempest-VolumesSnapshotTestJSON-1135480884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:20:27 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-5754160e-da8e-4aab-9b17-b62ab951b60b tempest-VolumesSnapshotTestJSON-1135480884 None] Flow 'volume_create_manager' (afd4d28c-7cc8-4f11-9f24-5a84a226539e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:20:27 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-5754160e-da8e-4aab-9b17-b62ab951b60b tempest-VolumesSnapshotTestJSON-1135480884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2196ac32-6368-4cf3-8f4a-160415c5df50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:20:27 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-5754160e-da8e-4aab-9b17-b62ab951b60b tempest-VolumesSnapshotTestJSON-1135480884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2196ac32-6368-4cf3-8f4a-160415c5df50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:20:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-17948325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=994f8cda-5725-4643-ba19-28986a9e6e68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e482872055f43a59a50317dcf761896',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:20:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:20:27Z,use_quota=True,user_id='38745d6b3d0b4b658fbbef2ced9dc889',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:20:27 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-5754160e-da8e-4aab-9b17-b62ab951b60b tempest-VolumesSnapshotTestJSON-1135480884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df9c14ed-65ba-44ce-b3c7-845c9a8fb290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:20:27 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-5754160e-da8e-4aab-9b17-b62ab951b60b tempest-VolumesSnapshotTestJSON-1135480884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df9c14ed-65ba-44ce-b3c7-845c9a8fb290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:20:27 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-5754160e-da8e-4aab-9b17-b62ab951b60b tempest-VolumesSnapshotTestJSON-1135480884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (155fd735-5578-4fe7-9ba7-fbae93fce142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:20:27 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-5754160e-da8e-4aab-9b17-b62ab951b60b tempest-VolumesSnapshotTestJSON-1135480884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (155fd735-5578-4fe7-9ba7-fbae93fce142) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '994f8cda-5725-4643-ba19-28986a9e6e68', 'volume_name': 'volume-994f8cda-5725-4643-ba19-28986a9e6e68', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:20:27 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-5754160e-da8e-4aab-9b17-b62ab951b60b tempest-VolumesSnapshotTestJSON-1135480884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5f0cf12-3b32-4cf0-8f20-b304792dc4be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:20:27 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-5754160e-da8e-4aab-9b17-b62ab951b60b tempest-VolumesSnapshotTestJSON-1135480884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5f0cf12-3b32-4cf0-8f20-b304792dc4be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:20:27 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-5754160e-da8e-4aab-9b17-b62ab951b60b tempest-VolumesSnapshotTestJSON-1135480884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd3a9789-3b95-4d8e-8fec-4b2a29524e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:20:27 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-5754160e-da8e-4aab-9b17-b62ab951b60b tempest-VolumesSnapshotTestJSON-1135480884 None] Volume 994f8cda-5725-4643-ba19-28986a9e6e68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-994f8cda-5725-4643-ba19-28986a9e6e68', 'volume_size': 1} Apr 29 15:20:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-5754160e-da8e-4aab-9b17-b62ab951b60b tempest-VolumesSnapshotTestJSON-1135480884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:20:27 devstack sudo[100708]: pam_unix(sudo:session): session closed for user root Apr 29 15:20:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-55d9f09c-5815-4813-bff6-e655379b4499 tempest-GroupSnapshotsV319Test-1474533239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-748b5653-f2fe-4d24-ad54-dbcc80385395.info" returned: 0 in 0.689s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:20:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-55d9f09c-5815-4813-bff6-e655379b4499 tempest-GroupSnapshotsV319Test-1474533239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.728s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:20:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-5754160e-da8e-4aab-9b17-b62ab951b60b tempest-VolumesSnapshotTestJSON-1135480884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.107s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:20:27 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-5754160e-da8e-4aab-9b17-b62ab951b60b tempest-VolumesSnapshotTestJSON-1135480884 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:20:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-17948325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=994f8cda-5725-4643-ba19-28986a9e6e68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e482872055f43a59a50317dcf761896',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:20:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:20:27Z,use_quota=True,user_id='38745d6b3d0b4b658fbbef2ced9dc889',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:20:27 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-5754160e-da8e-4aab-9b17-b62ab951b60b tempest-VolumesSnapshotTestJSON-1135480884 None] Creating volume 994f8cda-5725-4643-ba19-28986a9e6e68 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:20:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-5754160e-da8e-4aab-9b17-b62ab951b60b tempest-VolumesSnapshotTestJSON-1135480884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:20:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-5754160e-da8e-4aab-9b17-b62ab951b60b tempest-VolumesSnapshotTestJSON-1135480884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:20:27 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-5754160e-da8e-4aab-9b17-b62ab951b60b tempest-VolumesSnapshotTestJSON-1135480884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:20:27 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-5754160e-da8e-4aab-9b17-b62ab951b60b tempest-VolumesSnapshotTestJSON-1135480884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:20:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-5754160e-da8e-4aab-9b17-b62ab951b60b tempest-VolumesSnapshotTestJSON-1135480884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:20:27 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-5754160e-da8e-4aab-9b17-b62ab951b60b tempest-VolumesSnapshotTestJSON-1135480884 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:20:27 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-5754160e-da8e-4aab-9b17-b62ab951b60b tempest-VolumesSnapshotTestJSON-1135480884 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:20:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-5754160e-da8e-4aab-9b17-b62ab951b60b tempest-VolumesSnapshotTestJSON-1135480884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-994f8cda-5725-4643-ba19-28986a9e6e68 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:20:27 devstack sudo[100711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-994f8cda-5725-4643-ba19-28986a9e6e68 1073741824 Apr 29 15:20:27 devstack sudo[100711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:20:27 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-55d9f09c-5815-4813-bff6-e655379b4499 tempest-GroupSnapshotsV319Test-1474533239 None] group_snapshot a02c0fa8-93bc-4ac1-9682-538f85a214cb: created successfully Apr 29 15:20:28 devstack sudo[100711]: pam_unix(sudo:session): session closed for user root Apr 29 15:20:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-5754160e-da8e-4aab-9b17-b62ab951b60b tempest-VolumesSnapshotTestJSON-1135480884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-994f8cda-5725-4643-ba19-28986a9e6e68 1073741824" returned: 0 in 0.834s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:20:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-5754160e-da8e-4aab-9b17-b62ab951b60b tempest-VolumesSnapshotTestJSON-1135480884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-994f8cda-5725-4643-ba19-28986a9e6e68 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:20:28 devstack sudo[100724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-994f8cda-5725-4643-ba19-28986a9e6e68 Apr 29 15:20:28 devstack sudo[100724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:20:28 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-9414036f-9e28-416e-b489-727b68698428 tempest-GroupSnapshotsV319Test-1474533239 None] group_snapshot a02c0fa8-93bc-4ac1-9682-538f85a214cb: deleting Apr 29 15:20:28 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-9414036f-9e28-416e-b489-727b68698428 tempest-GroupSnapshotsV319Test-1474533239 None] group_snapshot a02c0fa8-93bc-4ac1-9682-538f85a214cb: deleting {{(pid=84448) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 29 15:20:28 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-9414036f-9e28-416e-b489-727b68698428 tempest-GroupSnapshotsV319Test-1474533239 None] Acquiring lock "cinder-quobyte-748b5653-f2fe-4d24-ad54-dbcc80385395" by "delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:20:28 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-9414036f-9e28-416e-b489-727b68698428 tempest-GroupSnapshotsV319Test-1474533239 None] Lock "cinder-quobyte-748b5653-f2fe-4d24-ad54-dbcc80385395" acquired by "delete_snapshot" :: waited 0.028s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:20:28 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-9414036f-9e28-416e-b489-727b68698428 tempest-GroupSnapshotsV319Test-1474533239 None] Acquiring lock "cinder-quobyte-45eb9e4a-aa86-4bf2-aa5e-7319d062f10e" by "_delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:20:28 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-9414036f-9e28-416e-b489-727b68698428 tempest-GroupSnapshotsV319Test-1474533239 None] Lock "cinder-quobyte-45eb9e4a-aa86-4bf2-aa5e-7319d062f10e" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:20:28 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-9414036f-9e28-416e-b489-727b68698428 tempest-GroupSnapshotsV319Test-1474533239 None] Deleting offline snapshot 45eb9e4a-aa86-4bf2-aa5e-7319d062f10e of volume 748b5653-f2fe-4d24-ad54-dbcc80385395 {{(pid=84448) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 15:20:28 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-9414036f-9e28-416e-b489-727b68698428 tempest-GroupSnapshotsV319Test-1474533239 None] snapshot_file for this snap is: volume-748b5653-f2fe-4d24-ad54-dbcc80385395.45eb9e4a-aa86-4bf2-aa5e-7319d062f10e {{(pid=84448) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 15:20:28 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[3513e97f-8272-4011-be75-c9aa5f4d7faa]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:20:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-9414036f-9e28-416e-b489-727b68698428 tempest-GroupSnapshotsV319Test-1474533239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-748b5653-f2fe-4d24-ad54-dbcc80385395.45eb9e4a-aa86-4bf2-aa5e-7319d062f10e {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:20:28 devstack sudo[100726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-748b5653-f2fe-4d24-ad54-dbcc80385395.45eb9e4a-aa86-4bf2-aa5e-7319d062f10e Apr 29 15:20:28 devstack sudo[100726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:20:28 devstack sudo[100724]: pam_unix(sudo:session): session closed for user root Apr 29 15:20:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-5754160e-da8e-4aab-9b17-b62ab951b60b tempest-VolumesSnapshotTestJSON-1135480884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-994f8cda-5725-4643-ba19-28986a9e6e68" returned: 0 in 0.651s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:20:28 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-5754160e-da8e-4aab-9b17-b62ab951b60b tempest-VolumesSnapshotTestJSON-1135480884 None] <== create_volume: return (1525ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:20:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-5754160e-da8e-4aab-9b17-b62ab951b60b tempest-VolumesSnapshotTestJSON-1135480884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.528s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:20:28 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-5754160e-da8e-4aab-9b17-b62ab951b60b tempest-VolumesSnapshotTestJSON-1135480884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd3a9789-3b95-4d8e-8fec-4b2a29524e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-994f8cda-5725-4643-ba19-28986a9e6e68', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:20:28 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-5754160e-da8e-4aab-9b17-b62ab951b60b tempest-VolumesSnapshotTestJSON-1135480884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcb91a38-2af3-4757-bfff-ea935a1bbe0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:20:28 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-5754160e-da8e-4aab-9b17-b62ab951b60b tempest-VolumesSnapshotTestJSON-1135480884 None] Volume volume-994f8cda-5725-4643-ba19-28986a9e6e68 (994f8cda-5725-4643-ba19-28986a9e6e68): created successfully Apr 29 15:20:28 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-5754160e-da8e-4aab-9b17-b62ab951b60b tempest-VolumesSnapshotTestJSON-1135480884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcb91a38-2af3-4757-bfff-ea935a1bbe0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:20:28 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-5754160e-da8e-4aab-9b17-b62ab951b60b tempest-VolumesSnapshotTestJSON-1135480884 None] Flow 'volume_create_manager' (afd4d28c-7cc8-4f11-9f24-5a84a226539e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:20:28 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-5754160e-da8e-4aab-9b17-b62ab951b60b tempest-VolumesSnapshotTestJSON-1135480884 None] Created volume successfully. Apr 29 15:20:29 devstack sudo[100726]: pam_unix(sudo:session): session closed for user root Apr 29 15:20:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-9414036f-9e28-416e-b489-727b68698428 tempest-GroupSnapshotsV319Test-1474533239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-748b5653-f2fe-4d24-ad54-dbcc80385395.45eb9e4a-aa86-4bf2-aa5e-7319d062f10e" returned: 0 in 0.761s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:20:29 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-9414036f-9e28-416e-b489-727b68698428 tempest-GroupSnapshotsV319Test-1474533239 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-748b5653-f2fe-4d24-ad54-dbcc80385395(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84448) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 15:20:29 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[175da4d4-995e-43d0-b8fb-88735bbbc2e8]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:20:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-9414036f-9e28-416e-b489-727b68698428 tempest-GroupSnapshotsV319Test-1474533239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-748b5653-f2fe-4d24-ad54-dbcc80385395 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:20:29 devstack sudo[100768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-748b5653-f2fe-4d24-ad54-dbcc80385395 Apr 29 15:20:29 devstack sudo[100768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:20:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-a39ad3b0-d1fa-40bd-b649-42e7c182ce81 tempest-VolumesSnapshotTestJSON-1135480884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:20:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-a39ad3b0-d1fa-40bd-b649-42e7c182ce81 tempest-VolumesSnapshotTestJSON-1135480884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:20:29 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-a39ad3b0-d1fa-40bd-b649-42e7c182ce81 tempest-VolumesSnapshotTestJSON-1135480884 None] Creating offline snapshot b3994eff-5688-4c59-9c60-fccdcf90a825 of volume 994f8cda-5725-4643-ba19-28986a9e6e68 {{(pid=84448) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 15:20:29 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2750374-3351-445a-9785-205aec6217c0]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:20:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a39ad3b0-d1fa-40bd-b649-42e7c182ce81 tempest-VolumesSnapshotTestJSON-1135480884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-994f8cda-5725-4643-ba19-28986a9e6e68 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:20:29 devstack sudo[100795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-994f8cda-5725-4643-ba19-28986a9e6e68 Apr 29 15:20:29 devstack sudo[100795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:20:30 devstack cinder-volume[84448]: DEBUG oslo_service.periodic_task [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84448) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 15:20:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:20:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:20:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:20:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:20:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:20:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:20:30 devstack sudo[100852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:20:30 devstack sudo[100852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:20:30 devstack sudo[100768]: pam_unix(sudo:session): session closed for user root Apr 29 15:20:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-9414036f-9e28-416e-b489-727b68698428 tempest-GroupSnapshotsV319Test-1474533239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-748b5653-f2fe-4d24-ad54-dbcc80385395" returned: 0 in 1.416s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:20:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-9414036f-9e28-416e-b489-727b68698428 tempest-GroupSnapshotsV319Test-1474533239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-748b5653-f2fe-4d24-ad54-dbcc80385395.45eb9e4a-aa86-4bf2-aa5e-7319d062f10e {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:20:30 devstack sudo[100858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-748b5653-f2fe-4d24-ad54-dbcc80385395.45eb9e4a-aa86-4bf2-aa5e-7319d062f10e Apr 29 15:20:30 devstack sudo[100858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:20:30 devstack sudo[100795]: pam_unix(sudo:session): session closed for user root Apr 29 15:20:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a39ad3b0-d1fa-40bd-b649-42e7c182ce81 tempest-VolumesSnapshotTestJSON-1135480884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-994f8cda-5725-4643-ba19-28986a9e6e68" returned: 0 in 1.415s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:20:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a39ad3b0-d1fa-40bd-b649-42e7c182ce81 tempest-VolumesSnapshotTestJSON-1135480884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-994f8cda-5725-4643-ba19-28986a9e6e68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-994f8cda-5725-4643-ba19-28986a9e6e68.b3994eff-5688-4c59-9c60-fccdcf90a825 1G {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:20:30 devstack sudo[100867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-994f8cda-5725-4643-ba19-28986a9e6e68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-994f8cda-5725-4643-ba19-28986a9e6e68.b3994eff-5688-4c59-9c60-fccdcf90a825 1G Apr 29 15:20:30 devstack sudo[100867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:20:31 devstack sudo[100852]: pam_unix(sudo:session): session closed for user root Apr 29 15:20:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.892s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:20:31 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:20:31 devstack sudo[100858]: pam_unix(sudo:session): session closed for user root Apr 29 15:20:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-9414036f-9e28-416e-b489-727b68698428 tempest-GroupSnapshotsV319Test-1474533239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-748b5653-f2fe-4d24-ad54-dbcc80385395.45eb9e4a-aa86-4bf2-aa5e-7319d062f10e" returned: 0 in 1.094s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:20:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-9414036f-9e28-416e-b489-727b68698428 tempest-GroupSnapshotsV319Test-1474533239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-748b5653-f2fe-4d24-ad54-dbcc80385395.45eb9e4a-aa86-4bf2-aa5e-7319d062f10e {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:20:31 devstack sudo[100878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-748b5653-f2fe-4d24-ad54-dbcc80385395.45eb9e4a-aa86-4bf2-aa5e-7319d062f10e Apr 29 15:20:31 devstack sudo[100878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:20:32 devstack sudo[100867]: pam_unix(sudo:session): session closed for user root Apr 29 15:20:32 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a39ad3b0-d1fa-40bd-b649-42e7c182ce81 tempest-VolumesSnapshotTestJSON-1135480884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-994f8cda-5725-4643-ba19-28986a9e6e68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-994f8cda-5725-4643-ba19-28986a9e6e68.b3994eff-5688-4c59-9c60-fccdcf90a825 1G" returned: 0 in 1.178s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:20:32 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a39ad3b0-d1fa-40bd-b649-42e7c182ce81 tempest-VolumesSnapshotTestJSON-1135480884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-994f8cda-5725-4643-ba19-28986a9e6e68 -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-994f8cda-5725-4643-ba19-28986a9e6e68.b3994eff-5688-4c59-9c60-fccdcf90a825 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:20:32 devstack sudo[100884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-994f8cda-5725-4643-ba19-28986a9e6e68 -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-994f8cda-5725-4643-ba19-28986a9e6e68.b3994eff-5688-4c59-9c60-fccdcf90a825 Apr 29 15:20:32 devstack sudo[100884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:20:32 devstack sudo[100878]: pam_unix(sudo:session): session closed for user root Apr 29 15:20:32 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-9414036f-9e28-416e-b489-727b68698428 tempest-GroupSnapshotsV319Test-1474533239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-748b5653-f2fe-4d24-ad54-dbcc80385395.45eb9e4a-aa86-4bf2-aa5e-7319d062f10e" returned: 0 in 0.741s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:20:32 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-9414036f-9e28-416e-b489-727b68698428 tempest-GroupSnapshotsV319Test-1474533239 None] Lock "cinder-quobyte-45eb9e4a-aa86-4bf2-aa5e-7319d062f10e" released by "_delete_snapshot" :: held 4.171s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:20:32 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-9414036f-9e28-416e-b489-727b68698428 tempest-GroupSnapshotsV319Test-1474533239 None] Lock "cinder-quobyte-748b5653-f2fe-4d24-ad54-dbcc80385395" released by "delete_snapshot" :: held 4.232s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:20:32 devstack cinder-volume[84448]: WARNING cinder.quota [None req-9414036f-9e28-416e-b489-727b68698428 tempest-GroupSnapshotsV319Test-1474533239 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-748082214 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-748082214, it is now deprecated. Please use the default quota class for default quota. Apr 29 15:20:32 devstack cinder-volume[84448]: WARNING cinder.quota [None req-9414036f-9e28-416e-b489-727b68698428 tempest-GroupSnapshotsV319Test-1474533239 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-748082214 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-748082214, it is now deprecated. Please use the default quota class for default quota. Apr 29 15:20:32 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-9414036f-9e28-416e-b489-727b68698428 tempest-GroupSnapshotsV319Test-1474533239 None] Created reservations ['0dcd5f5f-fa94-44a3-941c-067c33813ba0', 'fc948d4b-4fee-4381-82c0-5d4b4228b349', '5ce8e6af-8f80-4095-a0fa-9768316ad93a', '972905cd-b497-46c9-a317-681a58e06876'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:20:32 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-9414036f-9e28-416e-b489-727b68698428 tempest-GroupSnapshotsV319Test-1474533239 None] group_snapshot a02c0fa8-93bc-4ac1-9682-538f85a214cb: deleted successfully Apr 29 15:20:33 devstack sudo[100884]: pam_unix(sudo:session): session closed for user root Apr 29 15:20:33 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a39ad3b0-d1fa-40bd-b649-42e7c182ce81 tempest-VolumesSnapshotTestJSON-1135480884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-994f8cda-5725-4643-ba19-28986a9e6e68 -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-994f8cda-5725-4643-ba19-28986a9e6e68.b3994eff-5688-4c59-9c60-fccdcf90a825" returned: 0 in 0.984s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:20:33 devstack cinder-volume[84448]: WARNING cinder.volume.drivers.remotefs [None req-a39ad3b0-d1fa-40bd-b649-42e7c182ce81 tempest-VolumesSnapshotTestJSON-1135480884 None] /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-994f8cda-5725-4643-ba19-28986a9e6e68.b3994eff-5688-4c59-9c60-fccdcf90a825 is being set with open permissions: ugo+rw Apr 29 15:20:33 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a39ad3b0-d1fa-40bd-b649-42e7c182ce81 tempest-VolumesSnapshotTestJSON-1135480884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-994f8cda-5725-4643-ba19-28986a9e6e68.b3994eff-5688-4c59-9c60-fccdcf90a825 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:20:33 devstack sudo[100901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-994f8cda-5725-4643-ba19-28986a9e6e68.b3994eff-5688-4c59-9c60-fccdcf90a825 Apr 29 15:20:33 devstack sudo[100901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:20:33 devstack sudo[100901]: pam_unix(sudo:session): session closed for user root Apr 29 15:20:33 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a39ad3b0-d1fa-40bd-b649-42e7c182ce81 tempest-VolumesSnapshotTestJSON-1135480884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-994f8cda-5725-4643-ba19-28986a9e6e68.b3994eff-5688-4c59-9c60-fccdcf90a825" returned: 0 in 0.754s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:20:33 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a39ad3b0-d1fa-40bd-b649-42e7c182ce81 tempest-VolumesSnapshotTestJSON-1135480884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-994f8cda-5725-4643-ba19-28986a9e6e68.info {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:20:33 devstack sudo[100925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-994f8cda-5725-4643-ba19-28986a9e6e68.info Apr 29 15:20:33 devstack sudo[100925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:20:34 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-94dedf49-d641-4215-bbfc-751271f2fae5 tempest-GroupSnapshotsV319Test-1474533239 None] Acquiring lock "cinder-quobyte-748b5653-f2fe-4d24-ad54-dbcc80385395" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:20:34 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-94dedf49-d641-4215-bbfc-751271f2fae5 tempest-GroupSnapshotsV319Test-1474533239 None] Lock "cinder-quobyte-748b5653-f2fe-4d24-ad54-dbcc80385395" acquired by "delete_volume" :: waited 0.042s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:20:34 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9ca2ef-32ad-4fde-9633-3129b55b7afe]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:20:34 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-94dedf49-d641-4215-bbfc-751271f2fae5 tempest-GroupSnapshotsV319Test-1474533239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-748b5653-f2fe-4d24-ad54-dbcc80385395 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:20:34 devstack sudo[100934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-748b5653-f2fe-4d24-ad54-dbcc80385395 Apr 29 15:20:34 devstack sudo[100934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:20:34 devstack sudo[100925]: pam_unix(sudo:session): session closed for user root Apr 29 15:20:34 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a39ad3b0-d1fa-40bd-b649-42e7c182ce81 tempest-VolumesSnapshotTestJSON-1135480884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-994f8cda-5725-4643-ba19-28986a9e6e68.info" returned: 0 in 1.038s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:20:34 devstack cinder-volume[84448]: WARNING cinder.volume.drivers.remotefs [None req-a39ad3b0-d1fa-40bd-b649-42e7c182ce81 tempest-VolumesSnapshotTestJSON-1135480884 None] /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-994f8cda-5725-4643-ba19-28986a9e6e68.info is being set with open permissions: ugo+rw Apr 29 15:20:34 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a39ad3b0-d1fa-40bd-b649-42e7c182ce81 tempest-VolumesSnapshotTestJSON-1135480884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-994f8cda-5725-4643-ba19-28986a9e6e68.info {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:20:34 devstack sudo[100938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-994f8cda-5725-4643-ba19-28986a9e6e68.info Apr 29 15:20:34 devstack sudo[100938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:20:35 devstack sudo[100934]: pam_unix(sudo:session): session closed for user root Apr 29 15:20:35 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-94dedf49-d641-4215-bbfc-751271f2fae5 tempest-GroupSnapshotsV319Test-1474533239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-748b5653-f2fe-4d24-ad54-dbcc80385395" returned: 0 in 1.018s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:20:35 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-94dedf49-d641-4215-bbfc-751271f2fae5 tempest-GroupSnapshotsV319Test-1474533239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-748b5653-f2fe-4d24-ad54-dbcc80385395 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:20:35 devstack sudo[100944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-748b5653-f2fe-4d24-ad54-dbcc80385395 Apr 29 15:20:35 devstack sudo[100944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:20:35 devstack sudo[100938]: pam_unix(sudo:session): session closed for user root Apr 29 15:20:35 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a39ad3b0-d1fa-40bd-b649-42e7c182ce81 tempest-VolumesSnapshotTestJSON-1135480884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-994f8cda-5725-4643-ba19-28986a9e6e68.info" returned: 0 in 0.887s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:20:35 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-a39ad3b0-d1fa-40bd-b649-42e7c182ce81 tempest-VolumesSnapshotTestJSON-1135480884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.478s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:20:35 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-a39ad3b0-d1fa-40bd-b649-42e7c182ce81 tempest-VolumesSnapshotTestJSON-1135480884 None] Create snapshot completed successfully Apr 29 15:20:36 devstack sudo[100944]: pam_unix(sudo:session): session closed for user root Apr 29 15:20:36 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-94dedf49-d641-4215-bbfc-751271f2fae5 tempest-GroupSnapshotsV319Test-1474533239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-748b5653-f2fe-4d24-ad54-dbcc80385395" returned: 0 in 0.776s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:20:36 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-94dedf49-d641-4215-bbfc-751271f2fae5 tempest-GroupSnapshotsV319Test-1474533239 None] Lock "cinder-quobyte-748b5653-f2fe-4d24-ad54-dbcc80385395" released by "delete_volume" :: held 1.901s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:20:36 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-94dedf49-d641-4215-bbfc-751271f2fae5 tempest-GroupSnapshotsV319Test-1474533239 None] Created reservations ['f4107a66-f0d3-4e5f-95c1-2ab07c60693e'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:20:36 devstack cinder-volume[84448]: WARNING cinder.quota [None req-94dedf49-d641-4215-bbfc-751271f2fae5 tempest-GroupSnapshotsV319Test-1474533239 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-748082214 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-748082214, it is now deprecated. Please use the default quota class for default quota. Apr 29 15:20:36 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-94dedf49-d641-4215-bbfc-751271f2fae5 tempest-GroupSnapshotsV319Test-1474533239 None] Created reservations ['274f1ecb-19b9-4915-9f74-cbb8fe330fd2', '0431a53c-f04e-41bc-9fed-7670db879445', 'ef5c09cc-4cd7-4c8b-a1ab-3c13f3a22b53', '3fb4d68d-b34e-4a5e-b6ca-f839a2c8e044'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:20:36 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-94dedf49-d641-4215-bbfc-751271f2fae5 tempest-GroupSnapshotsV319Test-1474533239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:20:36 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-94dedf49-d641-4215-bbfc-751271f2fae5 tempest-GroupSnapshotsV319Test-1474533239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:20:36 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-94dedf49-d641-4215-bbfc-751271f2fae5 tempest-GroupSnapshotsV319Test-1474533239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:20:36 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-94dedf49-d641-4215-bbfc-751271f2fae5 tempest-GroupSnapshotsV319Test-1474533239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:20:36 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-94dedf49-d641-4215-bbfc-751271f2fae5 tempest-GroupSnapshotsV319Test-1474533239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:20:36 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-94dedf49-d641-4215-bbfc-751271f2fae5 tempest-GroupSnapshotsV319Test-1474533239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:20:36 devstack sudo[100950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:20:36 devstack sudo[100950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:20:37 devstack sudo[100950]: pam_unix(sudo:session): session closed for user root Apr 29 15:20:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-94dedf49-d641-4215-bbfc-751271f2fae5 tempest-GroupSnapshotsV319Test-1474533239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.781s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:20:37 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-94dedf49-d641-4215-bbfc-751271f2fae5 tempest-GroupSnapshotsV319Test-1474533239 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:20:37 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-94dedf49-d641-4215-bbfc-751271f2fae5 tempest-GroupSnapshotsV319Test-1474533239 None] Delete group completed successfully. Apr 29 15:20:37 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1fea7c0-8111-4f02-a514-1764eb45bae1 tempest-VolumesSnapshotTestJSON-1135480884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:20:37 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-d1fea7c0-8111-4f02-a514-1764eb45bae1 tempest-VolumesSnapshotTestJSON-1135480884 None] Flow 'volume_create_manager' (88c8cf87-777d-486b-be0b-e89b65a7a844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:20:37 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-d1fea7c0-8111-4f02-a514-1764eb45bae1 tempest-VolumesSnapshotTestJSON-1135480884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (256bd904-d3cc-4011-92b9-a9bf1ee52ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:20:37 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-d1fea7c0-8111-4f02-a514-1764eb45bae1 tempest-VolumesSnapshotTestJSON-1135480884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (256bd904-d3cc-4011-92b9-a9bf1ee52ba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:20:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1278166209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5218202-7a94-41e7-bcb7-d221074d9f5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e482872055f43a59a50317dcf761896',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:20:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b3994eff-5688-4c59-9c60-fccdcf90a825,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:20:37Z,use_quota=True,user_id='38745d6b3d0b4b658fbbef2ced9dc889',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:20:37 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-d1fea7c0-8111-4f02-a514-1764eb45bae1 tempest-VolumesSnapshotTestJSON-1135480884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (792f6cb6-e93b-4508-a165-20e62a5a5864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:20:37 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-d1fea7c0-8111-4f02-a514-1764eb45bae1 tempest-VolumesSnapshotTestJSON-1135480884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (792f6cb6-e93b-4508-a165-20e62a5a5864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:20:37 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-d1fea7c0-8111-4f02-a514-1764eb45bae1 tempest-VolumesSnapshotTestJSON-1135480884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48a94f30-9ff9-4067-bba7-92945af07ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:20:37 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-d1fea7c0-8111-4f02-a514-1764eb45bae1 tempest-VolumesSnapshotTestJSON-1135480884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48a94f30-9ff9-4067-bba7-92945af07ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b5218202-7a94-41e7-bcb7-d221074d9f5b', 'volume_name': 'volume-b5218202-7a94-41e7-bcb7-d221074d9f5b', 'volume_size': 1, 'snapshot_id': 'b3994eff-5688-4c59-9c60-fccdcf90a825'}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:20:37 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-d1fea7c0-8111-4f02-a514-1764eb45bae1 tempest-VolumesSnapshotTestJSON-1135480884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f0c7287-3168-4ec1-8635-f4979d89d218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:20:37 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-d1fea7c0-8111-4f02-a514-1764eb45bae1 tempest-VolumesSnapshotTestJSON-1135480884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f0c7287-3168-4ec1-8635-f4979d89d218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:20:37 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-d1fea7c0-8111-4f02-a514-1764eb45bae1 tempest-VolumesSnapshotTestJSON-1135480884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (582dd743-da86-47db-8020-69f9645e2e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:20:37 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-d1fea7c0-8111-4f02-a514-1764eb45bae1 tempest-VolumesSnapshotTestJSON-1135480884 None] Volume b5218202-7a94-41e7-bcb7-d221074d9f5b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b5218202-7a94-41e7-bcb7-d221074d9f5b', 'volume_size': 1, 'snapshot_id': 'b3994eff-5688-4c59-9c60-fccdcf90a825'} Apr 29 15:20:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-d1fea7c0-8111-4f02-a514-1764eb45bae1 tempest-VolumesSnapshotTestJSON-1135480884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:20:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-d1fea7c0-8111-4f02-a514-1764eb45bae1 tempest-VolumesSnapshotTestJSON-1135480884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:20:37 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-d1fea7c0-8111-4f02-a514-1764eb45bae1 tempest-VolumesSnapshotTestJSON-1135480884 None] Acquiring lock "cinder-quobyte-b3994eff-5688-4c59-9c60-fccdcf90a825-b5218202-7a94-41e7-bcb7-d221074d9f5b" by "_create_volume_from_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:20:37 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-d1fea7c0-8111-4f02-a514-1764eb45bae1 tempest-VolumesSnapshotTestJSON-1135480884 None] Lock "cinder-quobyte-b3994eff-5688-4c59-9c60-fccdcf90a825-b5218202-7a94-41e7-bcb7-d221074d9f5b" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:20:37 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-d1fea7c0-8111-4f02-a514-1764eb45bae1 tempest-VolumesSnapshotTestJSON-1135480884 None] Creating volume b5218202-7a94-41e7-bcb7-d221074d9f5b from snapshot b3994eff-5688-4c59-9c60-fccdcf90a825 {{(pid=84448) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 15:20:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-d1fea7c0-8111-4f02-a514-1764eb45bae1 tempest-VolumesSnapshotTestJSON-1135480884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:20:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-d1fea7c0-8111-4f02-a514-1764eb45bae1 tempest-VolumesSnapshotTestJSON-1135480884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:20:37 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-d1fea7c0-8111-4f02-a514-1764eb45bae1 tempest-VolumesSnapshotTestJSON-1135480884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:20:37 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-d1fea7c0-8111-4f02-a514-1764eb45bae1 tempest-VolumesSnapshotTestJSON-1135480884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:20:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-d1fea7c0-8111-4f02-a514-1764eb45bae1 tempest-VolumesSnapshotTestJSON-1135480884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:20:37 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-d1fea7c0-8111-4f02-a514-1764eb45bae1 tempest-VolumesSnapshotTestJSON-1135480884 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:20:37 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-d1fea7c0-8111-4f02-a514-1764eb45bae1 tempest-VolumesSnapshotTestJSON-1135480884 None] Acquiring lock "cinder-quobyte-b5218202-7a94-41e7-bcb7-d221074d9f5b" by "_copy_volume_from_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:20:37 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-d1fea7c0-8111-4f02-a514-1764eb45bae1 tempest-VolumesSnapshotTestJSON-1135480884 None] Lock "cinder-quobyte-b5218202-7a94-41e7-bcb7-d221074d9f5b" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:20:37 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-d1fea7c0-8111-4f02-a514-1764eb45bae1 tempest-VolumesSnapshotTestJSON-1135480884 None] snapshot: b3994eff-5688-4c59-9c60-fccdcf90a825, volume: b5218202-7a94-41e7-bcb7-d221074d9f5b, {{(pid=84448) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 15:20:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-d1fea7c0-8111-4f02-a514-1764eb45bae1 tempest-VolumesSnapshotTestJSON-1135480884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:20:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-d1fea7c0-8111-4f02-a514-1764eb45bae1 tempest-VolumesSnapshotTestJSON-1135480884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:20:37 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-d1fea7c0-8111-4f02-a514-1764eb45bae1 tempest-VolumesSnapshotTestJSON-1135480884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:20:37 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-d1fea7c0-8111-4f02-a514-1764eb45bae1 tempest-VolumesSnapshotTestJSON-1135480884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:20:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-d1fea7c0-8111-4f02-a514-1764eb45bae1 tempest-VolumesSnapshotTestJSON-1135480884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:20:37 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4eaeab6-ada8-4500-a37b-dd5c7fc906e7]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:20:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-d1fea7c0-8111-4f02-a514-1764eb45bae1 tempest-VolumesSnapshotTestJSON-1135480884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-994f8cda-5725-4643-ba19-28986a9e6e68.b3994eff-5688-4c59-9c60-fccdcf90a825 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:20:37 devstack sudo[100953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-994f8cda-5725-4643-ba19-28986a9e6e68.b3994eff-5688-4c59-9c60-fccdcf90a825 Apr 29 15:20:37 devstack sudo[100953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:20:38 devstack sudo[100953]: pam_unix(sudo:session): session closed for user root Apr 29 15:20:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-d1fea7c0-8111-4f02-a514-1764eb45bae1 tempest-VolumesSnapshotTestJSON-1135480884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-994f8cda-5725-4643-ba19-28986a9e6e68.b3994eff-5688-4c59-9c60-fccdcf90a825" returned: 0 in 0.827s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:20:38 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-d1fea7c0-8111-4f02-a514-1764eb45bae1 tempest-VolumesSnapshotTestJSON-1135480884 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-994f8cda-5725-4643-ba19-28986a9e6e68(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84448) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 15:20:38 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-d1fea7c0-8111-4f02-a514-1764eb45bae1 tempest-VolumesSnapshotTestJSON-1135480884 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-994f8cda-5725-4643-ba19-28986a9e6e68 {{(pid=84448) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 15:20:38 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-d1fea7c0-8111-4f02-a514-1764eb45bae1 tempest-VolumesSnapshotTestJSON-1135480884 None] Creating direct copy from snapshot {{(pid=84448) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 15:20:38 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[fadcae85-6167-45fd-a0f9-aca2acd7a6de]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:20:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-d1fea7c0-8111-4f02-a514-1764eb45bae1 tempest-VolumesSnapshotTestJSON-1135480884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-994f8cda-5725-4643-ba19-28986a9e6e68 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:20:38 devstack sudo[100959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-994f8cda-5725-4643-ba19-28986a9e6e68 Apr 29 15:20:38 devstack sudo[100959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:20:39 devstack sudo[100959]: pam_unix(sudo:session): session closed for user root Apr 29 15:20:39 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-d1fea7c0-8111-4f02-a514-1764eb45bae1 tempest-VolumesSnapshotTestJSON-1135480884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-994f8cda-5725-4643-ba19-28986a9e6e68" returned: 0 in 0.889s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:20:39 devstack cinder-volume[84448]: DEBUG cinder.utils [None req-d1fea7c0-8111-4f02-a514-1764eb45bae1 tempest-VolumesSnapshotTestJSON-1135480884 None] Path /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-b5218202-7a94-41e7-bcb7-d221074d9f5b not found in is_blk_device check {{(pid=84448) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 15:20:39 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-d1fea7c0-8111-4f02-a514-1764eb45bae1 tempest-VolumesSnapshotTestJSON-1135480884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-994f8cda-5725-4643-ba19-28986a9e6e68 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-b5218202-7a94-41e7-bcb7-d221074d9f5b {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:20:39 devstack sudo[100965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-994f8cda-5725-4643-ba19-28986a9e6e68 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-b5218202-7a94-41e7-bcb7-d221074d9f5b Apr 29 15:20:39 devstack sudo[100965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:20:44 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-cbb21351-bc72-4ad2-9712-3ffb488bc0f5 tempest-GroupsTest-820491831 None] Group tempest-Group1-1416516355: creating Apr 29 15:20:45 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-cbb21351-bc72-4ad2-9712-3ffb488bc0f5 tempest-GroupsTest-820491831 None] Group tempest-Group1-1416516355: created successfully Apr 29 15:20:45 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-cbb21351-bc72-4ad2-9712-3ffb488bc0f5 tempest-GroupsTest-820491831 None] Create group completed successfully. Apr 29 15:20:45 devstack sudo[100965]: pam_unix(sudo:session): session closed for user root Apr 29 15:20:45 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-d1fea7c0-8111-4f02-a514-1764eb45bae1 tempest-VolumesSnapshotTestJSON-1135480884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-994f8cda-5725-4643-ba19-28986a9e6e68 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-b5218202-7a94-41e7-bcb7-d221074d9f5b" returned: 0 in 6.207s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:20:45 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f9bb42-54b6-4500-a487-9f693d3271a5]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:20:45 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-d1fea7c0-8111-4f02-a514-1764eb45bae1 tempest-VolumesSnapshotTestJSON-1135480884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-994f8cda-5725-4643-ba19-28986a9e6e68 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:20:45 devstack sudo[101007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-994f8cda-5725-4643-ba19-28986a9e6e68 Apr 29 15:20:45 devstack sudo[101007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:20:46 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-d71e481d-7193-4fc5-ae19-ccb048de696b tempest-GroupsTest-820491831 None] Group tempest-Group2-583910551: creating Apr 29 15:20:46 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-d71e481d-7193-4fc5-ae19-ccb048de696b tempest-GroupsTest-820491831 None] Group tempest-Group2-583910551: created successfully Apr 29 15:20:46 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-d71e481d-7193-4fc5-ae19-ccb048de696b tempest-GroupsTest-820491831 None] Create group completed successfully. Apr 29 15:20:46 devstack sudo[101007]: pam_unix(sudo:session): session closed for user root Apr 29 15:20:46 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-d1fea7c0-8111-4f02-a514-1764eb45bae1 tempest-VolumesSnapshotTestJSON-1135480884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-994f8cda-5725-4643-ba19-28986a9e6e68" returned: 0 in 0.892s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:20:46 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [None req-d1fea7c0-8111-4f02-a514-1764eb45bae1 tempest-VolumesSnapshotTestJSON-1135480884 None] Image conversion details: src /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-994f8cda-5725-4643-ba19-28986a9e6e68, size 1024.00 MB, duration 6.21 sec, destination /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-b5218202-7a94-41e7-bcb7-d221074d9f5b {{(pid=84448) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 15:20:46 devstack cinder-volume[84448]: INFO cinder.image.image_utils [None req-d1fea7c0-8111-4f02-a514-1764eb45bae1 tempest-VolumesSnapshotTestJSON-1135480884 None] Converted 1024.00 MB image at 164.96 MB/s Apr 29 15:20:46 devstack cinder-volume[84448]: WARNING cinder.volume.drivers.remotefs [None req-d1fea7c0-8111-4f02-a514-1764eb45bae1 tempest-VolumesSnapshotTestJSON-1135480884 None] /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-b5218202-7a94-41e7-bcb7-d221074d9f5b is being set with open permissions: ugo+rw Apr 29 15:20:46 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-d1fea7c0-8111-4f02-a514-1764eb45bae1 tempest-VolumesSnapshotTestJSON-1135480884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-b5218202-7a94-41e7-bcb7-d221074d9f5b {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:20:46 devstack sudo[101012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-b5218202-7a94-41e7-bcb7-d221074d9f5b Apr 29 15:20:46 devstack sudo[101012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:20:47 devstack sudo[101012]: pam_unix(sudo:session): session closed for user root Apr 29 15:20:47 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-d1fea7c0-8111-4f02-a514-1764eb45bae1 tempest-VolumesSnapshotTestJSON-1135480884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-b5218202-7a94-41e7-bcb7-d221074d9f5b" returned: 0 in 0.594s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:20:47 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-d1fea7c0-8111-4f02-a514-1764eb45bae1 tempest-VolumesSnapshotTestJSON-1135480884 None] Lock "cinder-quobyte-b5218202-7a94-41e7-bcb7-d221074d9f5b" released by "_copy_volume_from_snapshot" :: held 9.519s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:20:47 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-d1fea7c0-8111-4f02-a514-1764eb45bae1 tempest-VolumesSnapshotTestJSON-1135480884 None] Lock "cinder-quobyte-b3994eff-5688-4c59-9c60-fccdcf90a825-b5218202-7a94-41e7-bcb7-d221074d9f5b" released by "_create_volume_from_snapshot" :: held 9.564s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:20:47 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-d1fea7c0-8111-4f02-a514-1764eb45bae1 tempest-VolumesSnapshotTestJSON-1135480884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.584s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:20:47 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-d1fea7c0-8111-4f02-a514-1764eb45bae1 tempest-VolumesSnapshotTestJSON-1135480884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (582dd743-da86-47db-8020-69f9645e2e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5218202-7a94-41e7-bcb7-d221074d9f5b', 'volume_size': 1, 'snapshot_id': 'b3994eff-5688-4c59-9c60-fccdcf90a825'}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:20:47 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-d1fea7c0-8111-4f02-a514-1764eb45bae1 tempest-VolumesSnapshotTestJSON-1135480884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e2098ab-a770-4555-b04a-c3cd0808c714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:20:47 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-d1fea7c0-8111-4f02-a514-1764eb45bae1 tempest-VolumesSnapshotTestJSON-1135480884 None] Volume volume-b5218202-7a94-41e7-bcb7-d221074d9f5b (b5218202-7a94-41e7-bcb7-d221074d9f5b): created successfully Apr 29 15:20:47 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-d1fea7c0-8111-4f02-a514-1764eb45bae1 tempest-VolumesSnapshotTestJSON-1135480884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e2098ab-a770-4555-b04a-c3cd0808c714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:20:47 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-d1fea7c0-8111-4f02-a514-1764eb45bae1 tempest-VolumesSnapshotTestJSON-1135480884 None] Flow 'volume_create_manager' (88c8cf87-777d-486b-be0b-e89b65a7a844) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:20:47 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-d1fea7c0-8111-4f02-a514-1764eb45bae1 tempest-VolumesSnapshotTestJSON-1135480884 None] Created volume successfully. Apr 29 15:20:47 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-a64f7153-08ff-4f53-820f-d069c096cb1e tempest-GroupsTest-820491831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:20:47 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-a64f7153-08ff-4f53-820f-d069c096cb1e tempest-GroupsTest-820491831 None] Flow 'volume_create_manager' (6154aa0d-4d92-4c28-857a-8907c08d3e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:20:47 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-a64f7153-08ff-4f53-820f-d069c096cb1e tempest-GroupsTest-820491831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23a6affc-03cc-42fb-aa7b-67898b2beb62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:20:47 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-a64f7153-08ff-4f53-820f-d069c096cb1e tempest-GroupsTest-820491831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23a6affc-03cc-42fb-aa7b-67898b2beb62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:20:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-821007582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c1e8c291-7ca1-497c-a14c-5ee39caa6b4a,host='devstack@QuobyteHD#QuobyteHD',id=896fa9cb-a18a-4e2e-bbdc-10759688444a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90e903a33d5e4b1cb939dc9d05ca2c9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:20:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:20:48Z,use_quota=True,user_id='1fd0aa2a5a7b49108ca4e0b349bcb442',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1712c286-eeab-4ed0-a1d6-cf4b6d6e10d5),volume_type_id=1712c286-eeab-4ed0-a1d6-cf4b6d6e10d5)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:20:47 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-a64f7153-08ff-4f53-820f-d069c096cb1e tempest-GroupsTest-820491831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0f08fbb-fdb1-4e9b-86e7-69d867c1f271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:20:47 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-a64f7153-08ff-4f53-820f-d069c096cb1e tempest-GroupsTest-820491831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0f08fbb-fdb1-4e9b-86e7-69d867c1f271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:20:47 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-a64f7153-08ff-4f53-820f-d069c096cb1e tempest-GroupsTest-820491831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b33af7f-83eb-42ef-99ea-d6c9c7a3882b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:20:47 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-a64f7153-08ff-4f53-820f-d069c096cb1e tempest-GroupsTest-820491831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b33af7f-83eb-42ef-99ea-d6c9c7a3882b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '896fa9cb-a18a-4e2e-bbdc-10759688444a', 'volume_name': 'volume-896fa9cb-a18a-4e2e-bbdc-10759688444a', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:20:47 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-a64f7153-08ff-4f53-820f-d069c096cb1e tempest-GroupsTest-820491831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f9f8648-c872-4431-ae00-b6c77d3bbae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:20:47 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-a64f7153-08ff-4f53-820f-d069c096cb1e tempest-GroupsTest-820491831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f9f8648-c872-4431-ae00-b6c77d3bbae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:20:47 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-a64f7153-08ff-4f53-820f-d069c096cb1e tempest-GroupsTest-820491831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da5d5bf4-2dfb-41d0-808e-d43cc81b40f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:20:47 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-a64f7153-08ff-4f53-820f-d069c096cb1e tempest-GroupsTest-820491831 None] Volume 896fa9cb-a18a-4e2e-bbdc-10759688444a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-896fa9cb-a18a-4e2e-bbdc-10759688444a', 'volume_size': 1} Apr 29 15:20:47 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-a64f7153-08ff-4f53-820f-d069c096cb1e tempest-GroupsTest-820491831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:20:47 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-a64f7153-08ff-4f53-820f-d069c096cb1e tempest-GroupsTest-820491831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:20:47 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-a64f7153-08ff-4f53-820f-d069c096cb1e tempest-GroupsTest-820491831 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c1e8c291-7ca1-497c-a14c-5ee39caa6b4a,created_at=2026-04-29T13:20:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-821007582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c1e8c291-7ca1-497c-a14c-5ee39caa6b4a,host='devstack@QuobyteHD#QuobyteHD',id=896fa9cb-a18a-4e2e-bbdc-10759688444a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90e903a33d5e4b1cb939dc9d05ca2c9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:20:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:20:48Z,use_quota=True,user_id='1fd0aa2a5a7b49108ca4e0b349bcb442',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1712c286-eeab-4ed0-a1d6-cf4b6d6e10d5),volume_type_id=1712c286-eeab-4ed0-a1d6-cf4b6d6e10d5)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:20:47 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-a64f7153-08ff-4f53-820f-d069c096cb1e tempest-GroupsTest-820491831 None] Creating volume 896fa9cb-a18a-4e2e-bbdc-10759688444a {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:20:47 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-a64f7153-08ff-4f53-820f-d069c096cb1e tempest-GroupsTest-820491831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:20:47 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-a64f7153-08ff-4f53-820f-d069c096cb1e tempest-GroupsTest-820491831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:20:47 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-a64f7153-08ff-4f53-820f-d069c096cb1e tempest-GroupsTest-820491831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:20:47 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-a64f7153-08ff-4f53-820f-d069c096cb1e tempest-GroupsTest-820491831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:20:47 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-a64f7153-08ff-4f53-820f-d069c096cb1e tempest-GroupsTest-820491831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:20:47 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-a64f7153-08ff-4f53-820f-d069c096cb1e tempest-GroupsTest-820491831 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:20:47 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-a64f7153-08ff-4f53-820f-d069c096cb1e tempest-GroupsTest-820491831 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:20:47 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a64f7153-08ff-4f53-820f-d069c096cb1e tempest-GroupsTest-820491831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-896fa9cb-a18a-4e2e-bbdc-10759688444a 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:20:47 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-196f8316-2ffd-4286-b1b0-a6c50fdd3be5 tempest-VolumesSnapshotTestJSON-1135480884 None] Acquiring lock "cinder-b5218202-7a94-41e7-bcb7-d221074d9f5b-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:20:47 devstack sudo[101015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-896fa9cb-a18a-4e2e-bbdc-10759688444a 1073741824 Apr 29 15:20:47 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-196f8316-2ffd-4286-b1b0-a6c50fdd3be5 tempest-VolumesSnapshotTestJSON-1135480884 None] Lock "cinder-b5218202-7a94-41e7-bcb7-d221074d9f5b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:20:47 devstack sudo[101015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:20:47 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-196f8316-2ffd-4286-b1b0-a6c50fdd3be5 tempest-VolumesSnapshotTestJSON-1135480884 None] Acquiring lock "cinder-quobyte-b5218202-7a94-41e7-bcb7-d221074d9f5b" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:20:47 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-196f8316-2ffd-4286-b1b0-a6c50fdd3be5 tempest-VolumesSnapshotTestJSON-1135480884 None] Lock "cinder-quobyte-b5218202-7a94-41e7-bcb7-d221074d9f5b" acquired by "delete_volume" :: waited 0.017s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:20:47 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ade8396-6844-4803-97c0-0b13b21f7c95]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:20:47 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-196f8316-2ffd-4286-b1b0-a6c50fdd3be5 tempest-VolumesSnapshotTestJSON-1135480884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-b5218202-7a94-41e7-bcb7-d221074d9f5b {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:20:48 devstack sudo[101017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-b5218202-7a94-41e7-bcb7-d221074d9f5b Apr 29 15:20:48 devstack sudo[101017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:20:48 devstack sudo[101015]: pam_unix(sudo:session): session closed for user root Apr 29 15:20:48 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a64f7153-08ff-4f53-820f-d069c096cb1e tempest-GroupsTest-820491831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-896fa9cb-a18a-4e2e-bbdc-10759688444a 1073741824" returned: 0 in 0.783s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:20:48 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a64f7153-08ff-4f53-820f-d069c096cb1e tempest-GroupsTest-820491831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-896fa9cb-a18a-4e2e-bbdc-10759688444a {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:20:48 devstack sudo[101017]: pam_unix(sudo:session): session closed for user root Apr 29 15:20:48 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-196f8316-2ffd-4286-b1b0-a6c50fdd3be5 tempest-VolumesSnapshotTestJSON-1135480884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-b5218202-7a94-41e7-bcb7-d221074d9f5b" returned: 0 in 0.721s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:20:48 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-196f8316-2ffd-4286-b1b0-a6c50fdd3be5 tempest-VolumesSnapshotTestJSON-1135480884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-b5218202-7a94-41e7-bcb7-d221074d9f5b {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:20:48 devstack sudo[101025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-896fa9cb-a18a-4e2e-bbdc-10759688444a Apr 29 15:20:48 devstack sudo[101025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:20:48 devstack sudo[101026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-b5218202-7a94-41e7-bcb7-d221074d9f5b Apr 29 15:20:48 devstack sudo[101026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:20:49 devstack sudo[101025]: pam_unix(sudo:session): session closed for user root Apr 29 15:20:49 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a64f7153-08ff-4f53-820f-d069c096cb1e tempest-GroupsTest-820491831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-896fa9cb-a18a-4e2e-bbdc-10759688444a" returned: 0 in 0.597s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:20:49 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-a64f7153-08ff-4f53-820f-d069c096cb1e tempest-GroupsTest-820491831 None] <== create_volume: return (1428ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:20:49 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-a64f7153-08ff-4f53-820f-d069c096cb1e tempest-GroupsTest-820491831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.431s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:20:49 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-a64f7153-08ff-4f53-820f-d069c096cb1e tempest-GroupsTest-820491831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da5d5bf4-2dfb-41d0-808e-d43cc81b40f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-896fa9cb-a18a-4e2e-bbdc-10759688444a', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:20:49 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-a64f7153-08ff-4f53-820f-d069c096cb1e tempest-GroupsTest-820491831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3de2a32-acf1-42ab-8b89-f296b1f29d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:20:49 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-a64f7153-08ff-4f53-820f-d069c096cb1e tempest-GroupsTest-820491831 None] Volume volume-896fa9cb-a18a-4e2e-bbdc-10759688444a (896fa9cb-a18a-4e2e-bbdc-10759688444a): created successfully Apr 29 15:20:49 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-a64f7153-08ff-4f53-820f-d069c096cb1e tempest-GroupsTest-820491831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3de2a32-acf1-42ab-8b89-f296b1f29d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:20:49 devstack sudo[101026]: pam_unix(sudo:session): session closed for user root Apr 29 15:20:49 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-a64f7153-08ff-4f53-820f-d069c096cb1e tempest-GroupsTest-820491831 None] Flow 'volume_create_manager' (6154aa0d-4d92-4c28-857a-8907c08d3e94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:20:49 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-196f8316-2ffd-4286-b1b0-a6c50fdd3be5 tempest-VolumesSnapshotTestJSON-1135480884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-b5218202-7a94-41e7-bcb7-d221074d9f5b" returned: 0 in 0.637s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:20:49 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-196f8316-2ffd-4286-b1b0-a6c50fdd3be5 tempest-VolumesSnapshotTestJSON-1135480884 None] Lock "cinder-quobyte-b5218202-7a94-41e7-bcb7-d221074d9f5b" released by "delete_volume" :: held 1.405s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:20:49 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-a64f7153-08ff-4f53-820f-d069c096cb1e tempest-GroupsTest-820491831 None] Created volume successfully. Apr 29 15:20:49 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-196f8316-2ffd-4286-b1b0-a6c50fdd3be5 tempest-VolumesSnapshotTestJSON-1135480884 None] Created reservations ['2d8f3d1c-9c8f-4faf-8ad1-73db928c12cb', '2abf6ba8-5d5a-435d-9fb7-fc204f04bde0', 'c129fcc4-5b81-46fa-bf3f-23a9e62428db', 'ede8e76e-91d7-448e-bd26-48d6b6278c90'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:20:49 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-196f8316-2ffd-4286-b1b0-a6c50fdd3be5 tempest-VolumesSnapshotTestJSON-1135480884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:20:49 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-196f8316-2ffd-4286-b1b0-a6c50fdd3be5 tempest-VolumesSnapshotTestJSON-1135480884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:20:49 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-196f8316-2ffd-4286-b1b0-a6c50fdd3be5 tempest-VolumesSnapshotTestJSON-1135480884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:20:49 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-196f8316-2ffd-4286-b1b0-a6c50fdd3be5 tempest-VolumesSnapshotTestJSON-1135480884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:20:49 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-196f8316-2ffd-4286-b1b0-a6c50fdd3be5 tempest-VolumesSnapshotTestJSON-1135480884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:20:49 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-196f8316-2ffd-4286-b1b0-a6c50fdd3be5 tempest-VolumesSnapshotTestJSON-1135480884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:20:49 devstack sudo[101031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:20:49 devstack sudo[101031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:20:49 devstack sudo[101031]: pam_unix(sudo:session): session closed for user root Apr 29 15:20:49 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-196f8316-2ffd-4286-b1b0-a6c50fdd3be5 tempest-VolumesSnapshotTestJSON-1135480884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.602s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:20:49 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-196f8316-2ffd-4286-b1b0-a6c50fdd3be5 tempest-VolumesSnapshotTestJSON-1135480884 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:20:49 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-196f8316-2ffd-4286-b1b0-a6c50fdd3be5 tempest-VolumesSnapshotTestJSON-1135480884 None] Deleted volume successfully. Apr 29 15:20:49 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-196f8316-2ffd-4286-b1b0-a6c50fdd3be5 tempest-VolumesSnapshotTestJSON-1135480884 None] Lock "cinder-b5218202-7a94-41e7-bcb7-d221074d9f5b-delete_volume" released by "delete_volume" :: held 2.198s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:20:50 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-dc2fa502-95ba-4028-9eb9-4cca6d1c579d tempest-VolumesSnapshotTestJSON-1135480884 None] Acquiring lock "cinder-b3994eff-5688-4c59-9c60-fccdcf90a825-delete_snapshot" by "delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:20:50 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-dc2fa502-95ba-4028-9eb9-4cca6d1c579d tempest-VolumesSnapshotTestJSON-1135480884 None] Lock "cinder-b3994eff-5688-4c59-9c60-fccdcf90a825-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:20:50 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-dc2fa502-95ba-4028-9eb9-4cca6d1c579d tempest-VolumesSnapshotTestJSON-1135480884 None] Acquiring lock "cinder-quobyte-994f8cda-5725-4643-ba19-28986a9e6e68" by "delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:20:50 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-dc2fa502-95ba-4028-9eb9-4cca6d1c579d tempest-VolumesSnapshotTestJSON-1135480884 None] Lock "cinder-quobyte-994f8cda-5725-4643-ba19-28986a9e6e68" acquired by "delete_snapshot" :: waited 0.017s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:20:50 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-dc2fa502-95ba-4028-9eb9-4cca6d1c579d tempest-VolumesSnapshotTestJSON-1135480884 None] Acquiring lock "cinder-quobyte-b3994eff-5688-4c59-9c60-fccdcf90a825" by "_delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:20:50 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-dc2fa502-95ba-4028-9eb9-4cca6d1c579d tempest-VolumesSnapshotTestJSON-1135480884 None] Lock "cinder-quobyte-b3994eff-5688-4c59-9c60-fccdcf90a825" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:20:50 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-dc2fa502-95ba-4028-9eb9-4cca6d1c579d tempest-VolumesSnapshotTestJSON-1135480884 None] Deleting offline snapshot b3994eff-5688-4c59-9c60-fccdcf90a825 of volume 994f8cda-5725-4643-ba19-28986a9e6e68 {{(pid=84448) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 15:20:50 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-dc2fa502-95ba-4028-9eb9-4cca6d1c579d tempest-VolumesSnapshotTestJSON-1135480884 None] snapshot_file for this snap is: volume-994f8cda-5725-4643-ba19-28986a9e6e68.b3994eff-5688-4c59-9c60-fccdcf90a825 {{(pid=84448) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 15:20:50 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[e163f5c3-d90c-4b6a-bf3c-84b49eb52001]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:20:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-dc2fa502-95ba-4028-9eb9-4cca6d1c579d tempest-VolumesSnapshotTestJSON-1135480884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-994f8cda-5725-4643-ba19-28986a9e6e68.b3994eff-5688-4c59-9c60-fccdcf90a825 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:20:50 devstack sudo[101034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-994f8cda-5725-4643-ba19-28986a9e6e68.b3994eff-5688-4c59-9c60-fccdcf90a825 Apr 29 15:20:50 devstack sudo[101034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:20:50 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-4fe1750e-e37c-4a6e-946f-bb9ebcb4a57a tempest-GroupsTest-820491831 None] Acquiring lock "cinder-quobyte-896fa9cb-a18a-4e2e-bbdc-10759688444a" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:20:50 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-4fe1750e-e37c-4a6e-946f-bb9ebcb4a57a tempest-GroupsTest-820491831 None] Lock "cinder-quobyte-896fa9cb-a18a-4e2e-bbdc-10759688444a" acquired by "delete_volume" :: waited 0.020s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:20:50 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9be8b3-c73e-4ad3-bfb7-a3870748a03f]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:20:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-4fe1750e-e37c-4a6e-946f-bb9ebcb4a57a tempest-GroupsTest-820491831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-896fa9cb-a18a-4e2e-bbdc-10759688444a {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:20:50 devstack sudo[101036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-896fa9cb-a18a-4e2e-bbdc-10759688444a Apr 29 15:20:50 devstack sudo[101036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:20:50 devstack sudo[101034]: pam_unix(sudo:session): session closed for user root Apr 29 15:20:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-dc2fa502-95ba-4028-9eb9-4cca6d1c579d tempest-VolumesSnapshotTestJSON-1135480884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-994f8cda-5725-4643-ba19-28986a9e6e68.b3994eff-5688-4c59-9c60-fccdcf90a825" returned: 0 in 0.801s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:20:50 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-dc2fa502-95ba-4028-9eb9-4cca6d1c579d tempest-VolumesSnapshotTestJSON-1135480884 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-994f8cda-5725-4643-ba19-28986a9e6e68(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84448) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 15:20:50 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[45910abf-9bdc-41e5-af85-3223740e5d20]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:20:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-dc2fa502-95ba-4028-9eb9-4cca6d1c579d tempest-VolumesSnapshotTestJSON-1135480884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-994f8cda-5725-4643-ba19-28986a9e6e68 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:20:51 devstack sudo[101042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-994f8cda-5725-4643-ba19-28986a9e6e68 Apr 29 15:20:51 devstack sudo[101042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:20:51 devstack sudo[101036]: pam_unix(sudo:session): session closed for user root Apr 29 15:20:51 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-4fe1750e-e37c-4a6e-946f-bb9ebcb4a57a tempest-GroupsTest-820491831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-896fa9cb-a18a-4e2e-bbdc-10759688444a" returned: 0 in 0.791s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:20:51 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-4fe1750e-e37c-4a6e-946f-bb9ebcb4a57a tempest-GroupsTest-820491831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-896fa9cb-a18a-4e2e-bbdc-10759688444a {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:20:51 devstack sudo[101047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-896fa9cb-a18a-4e2e-bbdc-10759688444a Apr 29 15:20:51 devstack sudo[101047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:20:51 devstack sudo[101042]: pam_unix(sudo:session): session closed for user root Apr 29 15:20:51 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-dc2fa502-95ba-4028-9eb9-4cca6d1c579d tempest-VolumesSnapshotTestJSON-1135480884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-994f8cda-5725-4643-ba19-28986a9e6e68" returned: 0 in 0.790s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:20:51 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-dc2fa502-95ba-4028-9eb9-4cca6d1c579d tempest-VolumesSnapshotTestJSON-1135480884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-994f8cda-5725-4643-ba19-28986a9e6e68.b3994eff-5688-4c59-9c60-fccdcf90a825 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:20:51 devstack sudo[101053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-994f8cda-5725-4643-ba19-28986a9e6e68.b3994eff-5688-4c59-9c60-fccdcf90a825 Apr 29 15:20:51 devstack sudo[101053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:20:51 devstack sudo[101047]: pam_unix(sudo:session): session closed for user root Apr 29 15:20:51 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-4fe1750e-e37c-4a6e-946f-bb9ebcb4a57a tempest-GroupsTest-820491831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-896fa9cb-a18a-4e2e-bbdc-10759688444a" returned: 0 in 0.643s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:20:51 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-4fe1750e-e37c-4a6e-946f-bb9ebcb4a57a tempest-GroupsTest-820491831 None] Lock "cinder-quobyte-896fa9cb-a18a-4e2e-bbdc-10759688444a" released by "delete_volume" :: held 1.509s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:20:51 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-4fe1750e-e37c-4a6e-946f-bb9ebcb4a57a tempest-GroupsTest-820491831 None] Created reservations ['7a473a46-35bb-43c6-a37e-ccf69f42bcde'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:20:51 devstack cinder-volume[84448]: WARNING cinder.quota [None req-4fe1750e-e37c-4a6e-946f-bb9ebcb4a57a tempest-GroupsTest-820491831 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-528448241 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-528448241, it is now deprecated. Please use the default quota class for default quota. Apr 29 15:20:51 devstack cinder-volume[84448]: WARNING cinder.quota [None req-4fe1750e-e37c-4a6e-946f-bb9ebcb4a57a tempest-GroupsTest-820491831 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-528448241 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-528448241, it is now deprecated. Please use the default quota class for default quota. Apr 29 15:20:51 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-4fe1750e-e37c-4a6e-946f-bb9ebcb4a57a tempest-GroupsTest-820491831 None] Created reservations ['83db62f1-7fb0-4d03-94c1-c30c2a76914e', '0dbaee4b-a9f7-432c-b1be-e65f7a1f0ecc', '670b076e-b4df-4f25-a32e-9aac27b0fb27', 'd51d663c-b592-4bfa-b586-77bbb3402947'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:20:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-4fe1750e-e37c-4a6e-946f-bb9ebcb4a57a tempest-GroupsTest-820491831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:20:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-4fe1750e-e37c-4a6e-946f-bb9ebcb4a57a tempest-GroupsTest-820491831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:20:52 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-4fe1750e-e37c-4a6e-946f-bb9ebcb4a57a tempest-GroupsTest-820491831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:20:52 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-4fe1750e-e37c-4a6e-946f-bb9ebcb4a57a tempest-GroupsTest-820491831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:20:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-4fe1750e-e37c-4a6e-946f-bb9ebcb4a57a tempest-GroupsTest-820491831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:20:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-4fe1750e-e37c-4a6e-946f-bb9ebcb4a57a tempest-GroupsTest-820491831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:20:52 devstack sudo[101055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:20:52 devstack sudo[101055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:20:52 devstack sudo[101053]: pam_unix(sudo:session): session closed for user root Apr 29 15:20:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-dc2fa502-95ba-4028-9eb9-4cca6d1c579d tempest-VolumesSnapshotTestJSON-1135480884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-994f8cda-5725-4643-ba19-28986a9e6e68.b3994eff-5688-4c59-9c60-fccdcf90a825" returned: 0 in 0.756s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:20:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-dc2fa502-95ba-4028-9eb9-4cca6d1c579d tempest-VolumesSnapshotTestJSON-1135480884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-994f8cda-5725-4643-ba19-28986a9e6e68.b3994eff-5688-4c59-9c60-fccdcf90a825 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:20:52 devstack sudo[101061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-994f8cda-5725-4643-ba19-28986a9e6e68.b3994eff-5688-4c59-9c60-fccdcf90a825 Apr 29 15:20:52 devstack sudo[101061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:20:52 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-846833f9-dc67-4fee-9669-67f11ebe18f0 tempest-GroupsTest-820491831 None] Created reservations ['d5257885-e863-44eb-aef8-8f8b4f0d5b67'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:20:52 devstack sudo[101055]: pam_unix(sudo:session): session closed for user root Apr 29 15:20:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-4fe1750e-e37c-4a6e-946f-bb9ebcb4a57a tempest-GroupsTest-820491831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.685s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:20:52 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-4fe1750e-e37c-4a6e-946f-bb9ebcb4a57a tempest-GroupsTest-820491831 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:20:52 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-4fe1750e-e37c-4a6e-946f-bb9ebcb4a57a tempest-GroupsTest-820491831 None] Delete group completed successfully. Apr 29 15:20:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-846833f9-dc67-4fee-9669-67f11ebe18f0 tempest-GroupsTest-820491831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:20:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-846833f9-dc67-4fee-9669-67f11ebe18f0 tempest-GroupsTest-820491831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:20:52 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-846833f9-dc67-4fee-9669-67f11ebe18f0 tempest-GroupsTest-820491831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:20:52 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-846833f9-dc67-4fee-9669-67f11ebe18f0 tempest-GroupsTest-820491831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:20:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-846833f9-dc67-4fee-9669-67f11ebe18f0 tempest-GroupsTest-820491831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:20:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-846833f9-dc67-4fee-9669-67f11ebe18f0 tempest-GroupsTest-820491831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:20:52 devstack sudo[101064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:20:52 devstack sudo[101064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:20:53 devstack sudo[101061]: pam_unix(sudo:session): session closed for user root Apr 29 15:20:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-dc2fa502-95ba-4028-9eb9-4cca6d1c579d tempest-VolumesSnapshotTestJSON-1135480884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-994f8cda-5725-4643-ba19-28986a9e6e68.b3994eff-5688-4c59-9c60-fccdcf90a825" returned: 0 in 0.602s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:20:53 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-dc2fa502-95ba-4028-9eb9-4cca6d1c579d tempest-VolumesSnapshotTestJSON-1135480884 None] Lock "cinder-quobyte-b3994eff-5688-4c59-9c60-fccdcf90a825" released by "_delete_snapshot" :: held 3.068s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:20:53 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-dc2fa502-95ba-4028-9eb9-4cca6d1c579d tempest-VolumesSnapshotTestJSON-1135480884 None] Lock "cinder-quobyte-994f8cda-5725-4643-ba19-28986a9e6e68" released by "delete_snapshot" :: held 3.095s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:20:53 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-dc2fa502-95ba-4028-9eb9-4cca6d1c579d tempest-VolumesSnapshotTestJSON-1135480884 None] Created reservations ['e8c64886-3808-4637-bb8b-839e7e070bf5', 'b1d34960-b861-4a9a-be3f-f43e15c97f9e', 'f2d483ab-2ccc-4bc9-99d1-5e48571dd370', '3f87bf04-1a6e-4f2c-9c92-c99a1cdaba84'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:20:53 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-dc2fa502-95ba-4028-9eb9-4cca6d1c579d tempest-VolumesSnapshotTestJSON-1135480884 None] Delete snapshot completed successfully. Apr 29 15:20:53 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-dc2fa502-95ba-4028-9eb9-4cca6d1c579d tempest-VolumesSnapshotTestJSON-1135480884 None] Lock "cinder-b3994eff-5688-4c59-9c60-fccdcf90a825-delete_snapshot" released by "delete_snapshot" :: held 3.228s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:20:53 devstack sudo[101064]: pam_unix(sudo:session): session closed for user root Apr 29 15:20:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-846833f9-dc67-4fee-9669-67f11ebe18f0 tempest-GroupsTest-820491831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.621s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:20:53 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-846833f9-dc67-4fee-9669-67f11ebe18f0 tempest-GroupsTest-820491831 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:20:53 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-846833f9-dc67-4fee-9669-67f11ebe18f0 tempest-GroupsTest-820491831 None] Delete group completed successfully. Apr 29 15:20:54 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-ba690948-8082-48a5-9ade-f3be780ef326 tempest-GroupsTest-820491831 None] Group tempest-GroupsTest-Group-755322264: creating Apr 29 15:20:54 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-b7520343-ea32-4856-afe3-7b61bb292e5c tempest-VolumesSnapshotTestJSON-1135480884 None] Acquiring lock "cinder-994f8cda-5725-4643-ba19-28986a9e6e68-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:20:54 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-ba690948-8082-48a5-9ade-f3be780ef326 tempest-GroupsTest-820491831 None] Group tempest-GroupsTest-Group-755322264: created successfully Apr 29 15:20:54 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-b7520343-ea32-4856-afe3-7b61bb292e5c tempest-VolumesSnapshotTestJSON-1135480884 None] Lock "cinder-994f8cda-5725-4643-ba19-28986a9e6e68-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:20:54 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-ba690948-8082-48a5-9ade-f3be780ef326 tempest-GroupsTest-820491831 None] Create group completed successfully. Apr 29 15:20:54 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-b7520343-ea32-4856-afe3-7b61bb292e5c tempest-VolumesSnapshotTestJSON-1135480884 None] Acquiring lock "cinder-quobyte-994f8cda-5725-4643-ba19-28986a9e6e68" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:20:54 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-b7520343-ea32-4856-afe3-7b61bb292e5c tempest-VolumesSnapshotTestJSON-1135480884 None] Lock "cinder-quobyte-994f8cda-5725-4643-ba19-28986a9e6e68" acquired by "delete_volume" :: waited 0.014s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:20:54 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[a41b10cc-06a2-40c3-99bc-47e2ac5a13ec]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:20:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-b7520343-ea32-4856-afe3-7b61bb292e5c tempest-VolumesSnapshotTestJSON-1135480884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-994f8cda-5725-4643-ba19-28986a9e6e68 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:20:54 devstack sudo[101070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-994f8cda-5725-4643-ba19-28986a9e6e68 Apr 29 15:20:54 devstack sudo[101070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:20:55 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7c9385e-0cbf-40a4-a471-59ac4735ddfb tempest-AttachVolumeTestJSON-1394496241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:20:55 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e7c9385e-0cbf-40a4-a471-59ac4735ddfb tempest-AttachVolumeTestJSON-1394496241 None] Flow 'volume_create_manager' (8e480fc4-2bcd-4a6a-8041-156c847944fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:20:55 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e7c9385e-0cbf-40a4-a471-59ac4735ddfb tempest-AttachVolumeTestJSON-1394496241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bd17d8c-5f25-43c1-90e7-ad32f7861d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:20:55 devstack sudo[101070]: pam_unix(sudo:session): session closed for user root Apr 29 15:20:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-b7520343-ea32-4856-afe3-7b61bb292e5c tempest-VolumesSnapshotTestJSON-1135480884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-994f8cda-5725-4643-ba19-28986a9e6e68" returned: 0 in 0.730s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:20:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-b7520343-ea32-4856-afe3-7b61bb292e5c tempest-VolumesSnapshotTestJSON-1135480884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-994f8cda-5725-4643-ba19-28986a9e6e68 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:20:55 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e7c9385e-0cbf-40a4-a471-59ac4735ddfb tempest-AttachVolumeTestJSON-1394496241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bd17d8c-5f25-43c1-90e7-ad32f7861d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:20:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-447841236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6082c3e6-83e0-4151-91a9-00eec55778d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33c47d81199440e5bdd459bf2f392652',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:20:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:20:55Z,use_quota=True,user_id='2fc15cf20cbc4e259b61500747485de0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:20:55 devstack sudo[101076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-994f8cda-5725-4643-ba19-28986a9e6e68 Apr 29 15:20:55 devstack sudo[101076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:20:55 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e7c9385e-0cbf-40a4-a471-59ac4735ddfb tempest-AttachVolumeTestJSON-1394496241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3737dfc4-31c0-4f87-84e8-c31bc424bac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:20:55 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e7c9385e-0cbf-40a4-a471-59ac4735ddfb tempest-AttachVolumeTestJSON-1394496241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3737dfc4-31c0-4f87-84e8-c31bc424bac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:20:55 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e7c9385e-0cbf-40a4-a471-59ac4735ddfb tempest-AttachVolumeTestJSON-1394496241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (744ca4db-cdb7-4bab-b2d2-94fba7361ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:20:55 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e7c9385e-0cbf-40a4-a471-59ac4735ddfb tempest-AttachVolumeTestJSON-1394496241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (744ca4db-cdb7-4bab-b2d2-94fba7361ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6082c3e6-83e0-4151-91a9-00eec55778d6', 'volume_name': 'volume-6082c3e6-83e0-4151-91a9-00eec55778d6', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:20:55 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e7c9385e-0cbf-40a4-a471-59ac4735ddfb tempest-AttachVolumeTestJSON-1394496241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6845f92b-512b-424b-8bba-cf4630db2e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:20:55 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e7c9385e-0cbf-40a4-a471-59ac4735ddfb tempest-AttachVolumeTestJSON-1394496241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6845f92b-512b-424b-8bba-cf4630db2e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:20:55 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e7c9385e-0cbf-40a4-a471-59ac4735ddfb tempest-AttachVolumeTestJSON-1394496241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bdb2134-4ada-441d-8ce2-31eec6c52210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:20:55 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-e7c9385e-0cbf-40a4-a471-59ac4735ddfb tempest-AttachVolumeTestJSON-1394496241 None] Volume 6082c3e6-83e0-4151-91a9-00eec55778d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6082c3e6-83e0-4151-91a9-00eec55778d6', 'volume_size': 1} Apr 29 15:20:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-e7c9385e-0cbf-40a4-a471-59ac4735ddfb tempest-AttachVolumeTestJSON-1394496241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:20:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-e7c9385e-0cbf-40a4-a471-59ac4735ddfb tempest-AttachVolumeTestJSON-1394496241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:20:55 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-e7c9385e-0cbf-40a4-a471-59ac4735ddfb tempest-AttachVolumeTestJSON-1394496241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:20:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-447841236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6082c3e6-83e0-4151-91a9-00eec55778d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33c47d81199440e5bdd459bf2f392652',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:20:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:20:55Z,use_quota=True,user_id='2fc15cf20cbc4e259b61500747485de0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:20:55 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-e7c9385e-0cbf-40a4-a471-59ac4735ddfb tempest-AttachVolumeTestJSON-1394496241 None] Creating volume 6082c3e6-83e0-4151-91a9-00eec55778d6 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:20:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-e7c9385e-0cbf-40a4-a471-59ac4735ddfb tempest-AttachVolumeTestJSON-1394496241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:20:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-e7c9385e-0cbf-40a4-a471-59ac4735ddfb tempest-AttachVolumeTestJSON-1394496241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:20:55 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-e7c9385e-0cbf-40a4-a471-59ac4735ddfb tempest-AttachVolumeTestJSON-1394496241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:20:55 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-e7c9385e-0cbf-40a4-a471-59ac4735ddfb tempest-AttachVolumeTestJSON-1394496241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:20:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-e7c9385e-0cbf-40a4-a471-59ac4735ddfb tempest-AttachVolumeTestJSON-1394496241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:20:55 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-e7c9385e-0cbf-40a4-a471-59ac4735ddfb tempest-AttachVolumeTestJSON-1394496241 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:20:55 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-e7c9385e-0cbf-40a4-a471-59ac4735ddfb tempest-AttachVolumeTestJSON-1394496241 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:20:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-e7c9385e-0cbf-40a4-a471-59ac4735ddfb tempest-AttachVolumeTestJSON-1394496241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-6082c3e6-83e0-4151-91a9-00eec55778d6 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:20:55 devstack sudo[101078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-6082c3e6-83e0-4151-91a9-00eec55778d6 1073741824 Apr 29 15:20:55 devstack sudo[101078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:20:55 devstack sudo[101076]: pam_unix(sudo:session): session closed for user root Apr 29 15:20:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-b7520343-ea32-4856-afe3-7b61bb292e5c tempest-VolumesSnapshotTestJSON-1135480884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-994f8cda-5725-4643-ba19-28986a9e6e68" returned: 0 in 0.643s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:20:55 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-b7520343-ea32-4856-afe3-7b61bb292e5c tempest-VolumesSnapshotTestJSON-1135480884 None] Lock "cinder-quobyte-994f8cda-5725-4643-ba19-28986a9e6e68" released by "delete_volume" :: held 1.444s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:20:55 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-35746892-83af-4d57-affd-8a6f2632f074 tempest-GroupsTest-820491831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:20:55 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-35746892-83af-4d57-affd-8a6f2632f074 tempest-GroupsTest-820491831 None] Flow 'volume_create_manager' (7134c610-ff89-43e2-bd0d-30b13747c9d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:20:55 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-35746892-83af-4d57-affd-8a6f2632f074 tempest-GroupsTest-820491831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74f48ce2-2b4b-4700-b610-111d523aaff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:20:55 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-35746892-83af-4d57-affd-8a6f2632f074 tempest-GroupsTest-820491831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74f48ce2-2b4b-4700-b610-111d523aaff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:20:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-838209111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a75081ba-2e36-402b-babb-68f7ecf181b8,host='devstack@QuobyteHD#QuobyteHD',id=8397a16d-40ee-49c8-9095-abc0662202e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90e903a33d5e4b1cb939dc9d05ca2c9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:20:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:20:56Z,use_quota=True,user_id='1fd0aa2a5a7b49108ca4e0b349bcb442',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c03b150a-533b-4053-9edb-c1a39608e08c),volume_type_id=c03b150a-533b-4053-9edb-c1a39608e08c)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:20:55 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-35746892-83af-4d57-affd-8a6f2632f074 tempest-GroupsTest-820491831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c7b3064-315b-4bbd-8063-81da3f4353e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:20:55 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-35746892-83af-4d57-affd-8a6f2632f074 tempest-GroupsTest-820491831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c7b3064-315b-4bbd-8063-81da3f4353e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:20:55 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-35746892-83af-4d57-affd-8a6f2632f074 tempest-GroupsTest-820491831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fe7c4f0-1b02-4e9f-8ed8-e11273060b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:20:55 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-35746892-83af-4d57-affd-8a6f2632f074 tempest-GroupsTest-820491831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fe7c4f0-1b02-4e9f-8ed8-e11273060b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8397a16d-40ee-49c8-9095-abc0662202e1', 'volume_name': 'volume-8397a16d-40ee-49c8-9095-abc0662202e1', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:20:55 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-35746892-83af-4d57-affd-8a6f2632f074 tempest-GroupsTest-820491831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07e16804-af11-4c06-90f9-549529409feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:20:55 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-35746892-83af-4d57-affd-8a6f2632f074 tempest-GroupsTest-820491831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07e16804-af11-4c06-90f9-549529409feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:20:55 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-35746892-83af-4d57-affd-8a6f2632f074 tempest-GroupsTest-820491831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6d0403a-de93-4c95-8f9f-2a4596f331fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:20:55 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-35746892-83af-4d57-affd-8a6f2632f074 tempest-GroupsTest-820491831 None] Volume 8397a16d-40ee-49c8-9095-abc0662202e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8397a16d-40ee-49c8-9095-abc0662202e1', 'volume_size': 1} Apr 29 15:20:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-35746892-83af-4d57-affd-8a6f2632f074 tempest-GroupsTest-820491831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:20:56 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-b7520343-ea32-4856-afe3-7b61bb292e5c tempest-VolumesSnapshotTestJSON-1135480884 None] Created reservations ['4968de6b-daf0-4db2-a044-0380bae8356c', '5294fb2b-4d20-45a6-b784-e44164312cc1', '6c2533c0-099c-4453-93d0-fa486075ecdf', 'f3e56ee4-36c1-48df-9c41-db0ac1e68f55'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:20:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-b7520343-ea32-4856-afe3-7b61bb292e5c tempest-VolumesSnapshotTestJSON-1135480884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:20:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-b7520343-ea32-4856-afe3-7b61bb292e5c tempest-VolumesSnapshotTestJSON-1135480884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:20:56 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-b7520343-ea32-4856-afe3-7b61bb292e5c tempest-VolumesSnapshotTestJSON-1135480884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:20:56 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-b7520343-ea32-4856-afe3-7b61bb292e5c tempest-VolumesSnapshotTestJSON-1135480884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:20:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-b7520343-ea32-4856-afe3-7b61bb292e5c tempest-VolumesSnapshotTestJSON-1135480884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:20:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-b7520343-ea32-4856-afe3-7b61bb292e5c tempest-VolumesSnapshotTestJSON-1135480884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:20:56 devstack sudo[101085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:20:56 devstack sudo[101085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:20:56 devstack sudo[101078]: pam_unix(sudo:session): session closed for user root Apr 29 15:20:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-e7c9385e-0cbf-40a4-a471-59ac4735ddfb tempest-AttachVolumeTestJSON-1394496241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-6082c3e6-83e0-4151-91a9-00eec55778d6 1073741824" returned: 0 in 0.856s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:20:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-e7c9385e-0cbf-40a4-a471-59ac4735ddfb tempest-AttachVolumeTestJSON-1394496241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-6082c3e6-83e0-4151-91a9-00eec55778d6 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:20:56 devstack sudo[101087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-6082c3e6-83e0-4151-91a9-00eec55778d6 Apr 29 15:20:56 devstack sudo[101087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:20:56 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-747dcc52-9df9-4425-afb5-9c4dfc96bb11 tempest-VolumesSnapshotTestJSON-1135480884 None] Acquiring lock "cinder-a8cd99a3-e297-4595-bda9-861fb8b99371-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:20:56 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-747dcc52-9df9-4425-afb5-9c4dfc96bb11 tempest-VolumesSnapshotTestJSON-1135480884 None] Lock "cinder-a8cd99a3-e297-4595-bda9-861fb8b99371-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:20:56 devstack sudo[101085]: pam_unix(sudo:session): session closed for user root Apr 29 15:20:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-b7520343-ea32-4856-afe3-7b61bb292e5c tempest-VolumesSnapshotTestJSON-1135480884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.632s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:20:56 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-b7520343-ea32-4856-afe3-7b61bb292e5c tempest-VolumesSnapshotTestJSON-1135480884 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:20:56 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-b7520343-ea32-4856-afe3-7b61bb292e5c tempest-VolumesSnapshotTestJSON-1135480884 None] Deleted volume successfully. Apr 29 15:20:56 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-747dcc52-9df9-4425-afb5-9c4dfc96bb11 tempest-VolumesSnapshotTestJSON-1135480884 None] Acquiring lock "cinder-quobyte-a8cd99a3-e297-4595-bda9-861fb8b99371" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:20:56 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-747dcc52-9df9-4425-afb5-9c4dfc96bb11 tempest-VolumesSnapshotTestJSON-1135480884 None] Lock "cinder-quobyte-a8cd99a3-e297-4595-bda9-861fb8b99371" acquired by "delete_volume" :: waited 0.019s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:20:56 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-b7520343-ea32-4856-afe3-7b61bb292e5c tempest-VolumesSnapshotTestJSON-1135480884 None] Lock "cinder-994f8cda-5725-4643-ba19-28986a9e6e68-delete_volume" released by "delete_volume" :: held 2.402s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:20:56 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e2f5eda-efc7-4572-9e5c-13f3c7defa05]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:20:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-747dcc52-9df9-4425-afb5-9c4dfc96bb11 tempest-VolumesSnapshotTestJSON-1135480884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a8cd99a3-e297-4595-bda9-861fb8b99371 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:20:56 devstack sudo[101087]: pam_unix(sudo:session): session closed for user root Apr 29 15:20:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-e7c9385e-0cbf-40a4-a471-59ac4735ddfb tempest-AttachVolumeTestJSON-1394496241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-6082c3e6-83e0-4151-91a9-00eec55778d6" returned: 0 in 0.650s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:20:56 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-e7c9385e-0cbf-40a4-a471-59ac4735ddfb tempest-AttachVolumeTestJSON-1394496241 None] <== create_volume: return (1545ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:20:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-e7c9385e-0cbf-40a4-a471-59ac4735ddfb tempest-AttachVolumeTestJSON-1394496241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.548s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:20:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-35746892-83af-4d57-affd-8a6f2632f074 tempest-GroupsTest-820491831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.808s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:20:56 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-35746892-83af-4d57-affd-8a6f2632f074 tempest-GroupsTest-820491831 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a75081ba-2e36-402b-babb-68f7ecf181b8,created_at=2026-04-29T13:20:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-838209111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a75081ba-2e36-402b-babb-68f7ecf181b8,host='devstack@QuobyteHD#QuobyteHD',id=8397a16d-40ee-49c8-9095-abc0662202e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90e903a33d5e4b1cb939dc9d05ca2c9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:20:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:20:56Z,use_quota=True,user_id='1fd0aa2a5a7b49108ca4e0b349bcb442',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c03b150a-533b-4053-9edb-c1a39608e08c),volume_type_id=c03b150a-533b-4053-9edb-c1a39608e08c)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:20:56 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-35746892-83af-4d57-affd-8a6f2632f074 tempest-GroupsTest-820491831 None] Creating volume 8397a16d-40ee-49c8-9095-abc0662202e1 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:20:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-35746892-83af-4d57-affd-8a6f2632f074 tempest-GroupsTest-820491831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:20:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-35746892-83af-4d57-affd-8a6f2632f074 tempest-GroupsTest-820491831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:20:56 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-35746892-83af-4d57-affd-8a6f2632f074 tempest-GroupsTest-820491831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:20:56 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-35746892-83af-4d57-affd-8a6f2632f074 tempest-GroupsTest-820491831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:20:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-35746892-83af-4d57-affd-8a6f2632f074 tempest-GroupsTest-820491831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:20:56 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-35746892-83af-4d57-affd-8a6f2632f074 tempest-GroupsTest-820491831 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:20:56 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-35746892-83af-4d57-affd-8a6f2632f074 tempest-GroupsTest-820491831 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:20:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-35746892-83af-4d57-affd-8a6f2632f074 tempest-GroupsTest-820491831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-8397a16d-40ee-49c8-9095-abc0662202e1 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:20:56 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e7c9385e-0cbf-40a4-a471-59ac4735ddfb tempest-AttachVolumeTestJSON-1394496241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bdb2134-4ada-441d-8ce2-31eec6c52210) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6082c3e6-83e0-4151-91a9-00eec55778d6', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:20:56 devstack sudo[101092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-8397a16d-40ee-49c8-9095-abc0662202e1 1073741824 Apr 29 15:20:56 devstack sudo[101092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:20:56 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e7c9385e-0cbf-40a4-a471-59ac4735ddfb tempest-AttachVolumeTestJSON-1394496241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1486ff0f-cc7e-4400-8879-32f09ae96a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:20:56 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-e7c9385e-0cbf-40a4-a471-59ac4735ddfb tempest-AttachVolumeTestJSON-1394496241 None] Volume volume-6082c3e6-83e0-4151-91a9-00eec55778d6 (6082c3e6-83e0-4151-91a9-00eec55778d6): created successfully Apr 29 15:20:56 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e7c9385e-0cbf-40a4-a471-59ac4735ddfb tempest-AttachVolumeTestJSON-1394496241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1486ff0f-cc7e-4400-8879-32f09ae96a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:20:56 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e7c9385e-0cbf-40a4-a471-59ac4735ddfb tempest-AttachVolumeTestJSON-1394496241 None] Flow 'volume_create_manager' (8e480fc4-2bcd-4a6a-8041-156c847944fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:20:56 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-e7c9385e-0cbf-40a4-a471-59ac4735ddfb tempest-AttachVolumeTestJSON-1394496241 None] Created volume successfully. Apr 29 15:20:56 devstack sudo[101091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a8cd99a3-e297-4595-bda9-861fb8b99371 Apr 29 15:20:56 devstack sudo[101091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:20:57 devstack sudo[101091]: pam_unix(sudo:session): session closed for user root Apr 29 15:20:57 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-747dcc52-9df9-4425-afb5-9c4dfc96bb11 tempest-VolumesSnapshotTestJSON-1135480884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a8cd99a3-e297-4595-bda9-861fb8b99371" returned: 0 in 0.765s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:20:57 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-747dcc52-9df9-4425-afb5-9c4dfc96bb11 tempest-VolumesSnapshotTestJSON-1135480884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a8cd99a3-e297-4595-bda9-861fb8b99371 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:20:57 devstack sudo[101101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a8cd99a3-e297-4595-bda9-861fb8b99371 Apr 29 15:20:57 devstack sudo[101101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:20:57 devstack sudo[101092]: pam_unix(sudo:session): session closed for user root Apr 29 15:20:57 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-35746892-83af-4d57-affd-8a6f2632f074 tempest-GroupsTest-820491831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-8397a16d-40ee-49c8-9095-abc0662202e1 1073741824" returned: 0 in 0.848s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:20:57 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-35746892-83af-4d57-affd-8a6f2632f074 tempest-GroupsTest-820491831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-8397a16d-40ee-49c8-9095-abc0662202e1 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:20:57 devstack sudo[101103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-8397a16d-40ee-49c8-9095-abc0662202e1 Apr 29 15:20:57 devstack sudo[101103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:20:58 devstack sudo[101101]: pam_unix(sudo:session): session closed for user root Apr 29 15:20:58 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-747dcc52-9df9-4425-afb5-9c4dfc96bb11 tempest-VolumesSnapshotTestJSON-1135480884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a8cd99a3-e297-4595-bda9-861fb8b99371" returned: 0 in 0.633s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:20:58 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-747dcc52-9df9-4425-afb5-9c4dfc96bb11 tempest-VolumesSnapshotTestJSON-1135480884 None] Lock "cinder-quobyte-a8cd99a3-e297-4595-bda9-861fb8b99371" released by "delete_volume" :: held 1.456s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:20:58 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-747dcc52-9df9-4425-afb5-9c4dfc96bb11 tempest-VolumesSnapshotTestJSON-1135480884 None] Created reservations ['f4ad722d-be68-4fad-8d7e-2cf2d7823a1c', 'e7b46331-ffde-4c1d-9667-15674c27adf1', '67580dcb-be75-4282-b731-ab9f0366bd7e', 'f52193bb-6ddb-4070-9042-339a8d0ccc02'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:20:58 devstack sudo[101103]: pam_unix(sudo:session): session closed for user root Apr 29 15:20:58 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-35746892-83af-4d57-affd-8a6f2632f074 tempest-GroupsTest-820491831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-8397a16d-40ee-49c8-9095-abc0662202e1" returned: 0 in 0.595s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:20:58 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-35746892-83af-4d57-affd-8a6f2632f074 tempest-GroupsTest-820491831 None] <== create_volume: return (1489ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:20:58 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-35746892-83af-4d57-affd-8a6f2632f074 tempest-GroupsTest-820491831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.492s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:20:58 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-747dcc52-9df9-4425-afb5-9c4dfc96bb11 tempest-VolumesSnapshotTestJSON-1135480884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:20:58 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-747dcc52-9df9-4425-afb5-9c4dfc96bb11 tempest-VolumesSnapshotTestJSON-1135480884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:20:58 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-747dcc52-9df9-4425-afb5-9c4dfc96bb11 tempest-VolumesSnapshotTestJSON-1135480884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:20:58 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-747dcc52-9df9-4425-afb5-9c4dfc96bb11 tempest-VolumesSnapshotTestJSON-1135480884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:20:58 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-747dcc52-9df9-4425-afb5-9c4dfc96bb11 tempest-VolumesSnapshotTestJSON-1135480884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:20:58 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-747dcc52-9df9-4425-afb5-9c4dfc96bb11 tempest-VolumesSnapshotTestJSON-1135480884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:20:58 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-35746892-83af-4d57-affd-8a6f2632f074 tempest-GroupsTest-820491831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6d0403a-de93-4c95-8f9f-2a4596f331fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8397a16d-40ee-49c8-9095-abc0662202e1', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:20:58 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-35746892-83af-4d57-affd-8a6f2632f074 tempest-GroupsTest-820491831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9acc08a-b22d-4f38-9400-48162cbcdd52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:20:58 devstack sudo[101107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:20:58 devstack sudo[101107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:20:58 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-35746892-83af-4d57-affd-8a6f2632f074 tempest-GroupsTest-820491831 None] Volume volume-8397a16d-40ee-49c8-9095-abc0662202e1 (8397a16d-40ee-49c8-9095-abc0662202e1): created successfully Apr 29 15:20:58 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-35746892-83af-4d57-affd-8a6f2632f074 tempest-GroupsTest-820491831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9acc08a-b22d-4f38-9400-48162cbcdd52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:20:58 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-35746892-83af-4d57-affd-8a6f2632f074 tempest-GroupsTest-820491831 None] Flow 'volume_create_manager' (7134c610-ff89-43e2-bd0d-30b13747c9d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:20:58 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-35746892-83af-4d57-affd-8a6f2632f074 tempest-GroupsTest-820491831 None] Created volume successfully. Apr 29 15:20:58 devstack sudo[101107]: pam_unix(sudo:session): session closed for user root Apr 29 15:20:58 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-747dcc52-9df9-4425-afb5-9c4dfc96bb11 tempest-VolumesSnapshotTestJSON-1135480884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.599s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:20:58 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-747dcc52-9df9-4425-afb5-9c4dfc96bb11 tempest-VolumesSnapshotTestJSON-1135480884 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:20:58 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-747dcc52-9df9-4425-afb5-9c4dfc96bb11 tempest-VolumesSnapshotTestJSON-1135480884 None] Deleted volume successfully. Apr 29 15:20:58 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:SELECT=123,cinder:UPDATE=141,cinder:INSERT=28,cinder:DELETE=8 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:20:58 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-747dcc52-9df9-4425-afb5-9c4dfc96bb11 tempest-VolumesSnapshotTestJSON-1135480884 None] Lock "cinder-a8cd99a3-e297-4595-bda9-861fb8b99371-delete_volume" released by "delete_volume" :: held 2.286s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:20:59 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:UPDATE=118,cinder:DELETE=7,cinder:SELECT=120,cinder:INSERT=33 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:20:59 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-57b5df01-1b67-4e83-bde7-d94abe1a1e65 tempest-GroupsTest-820491831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:20:59 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-57b5df01-1b67-4e83-bde7-d94abe1a1e65 tempest-GroupsTest-820491831 None] Flow 'volume_create_manager' (4be4d614-4561-427f-984b-ba0abe878a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:20:59 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-57b5df01-1b67-4e83-bde7-d94abe1a1e65 tempest-GroupsTest-820491831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (419e142d-1178-4135-81ec-2feba22b6932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:20:59 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-57b5df01-1b67-4e83-bde7-d94abe1a1e65 tempest-GroupsTest-820491831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (419e142d-1178-4135-81ec-2feba22b6932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:20:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-674113630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a75081ba-2e36-402b-babb-68f7ecf181b8,host='devstack@QuobyteHD#QuobyteHD',id=3e3b5b39-639a-443e-a00a-b284c309ed00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90e903a33d5e4b1cb939dc9d05ca2c9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:21:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:21:00Z,use_quota=True,user_id='1fd0aa2a5a7b49108ca4e0b349bcb442',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c03b150a-533b-4053-9edb-c1a39608e08c),volume_type_id=c03b150a-533b-4053-9edb-c1a39608e08c)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:20:59 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-57b5df01-1b67-4e83-bde7-d94abe1a1e65 tempest-GroupsTest-820491831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16ee56a8-4f4c-442f-8bfb-3059ad33ab5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:20:59 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-57b5df01-1b67-4e83-bde7-d94abe1a1e65 tempest-GroupsTest-820491831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16ee56a8-4f4c-442f-8bfb-3059ad33ab5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:20:59 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-57b5df01-1b67-4e83-bde7-d94abe1a1e65 tempest-GroupsTest-820491831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f21bacc-938a-4b9c-9fef-7127bec11084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:20:59 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-57b5df01-1b67-4e83-bde7-d94abe1a1e65 tempest-GroupsTest-820491831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f21bacc-938a-4b9c-9fef-7127bec11084) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e3b5b39-639a-443e-a00a-b284c309ed00', 'volume_name': 'volume-3e3b5b39-639a-443e-a00a-b284c309ed00', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:20:59 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-57b5df01-1b67-4e83-bde7-d94abe1a1e65 tempest-GroupsTest-820491831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ed99767-0222-4570-b14b-f98c8b7d0383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:20:59 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-57b5df01-1b67-4e83-bde7-d94abe1a1e65 tempest-GroupsTest-820491831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ed99767-0222-4570-b14b-f98c8b7d0383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:20:59 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-57b5df01-1b67-4e83-bde7-d94abe1a1e65 tempest-GroupsTest-820491831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb2a5584-7342-4d75-95ec-a5a91162f840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:20:59 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-57b5df01-1b67-4e83-bde7-d94abe1a1e65 tempest-GroupsTest-820491831 None] Volume 3e3b5b39-639a-443e-a00a-b284c309ed00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e3b5b39-639a-443e-a00a-b284c309ed00', 'volume_size': 1} Apr 29 15:20:59 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-57b5df01-1b67-4e83-bde7-d94abe1a1e65 tempest-GroupsTest-820491831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:20:59 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-57b5df01-1b67-4e83-bde7-d94abe1a1e65 tempest-GroupsTest-820491831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:20:59 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-57b5df01-1b67-4e83-bde7-d94abe1a1e65 tempest-GroupsTest-820491831 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a75081ba-2e36-402b-babb-68f7ecf181b8,created_at=2026-04-29T13:20:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-674113630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a75081ba-2e36-402b-babb-68f7ecf181b8,host='devstack@QuobyteHD#QuobyteHD',id=3e3b5b39-639a-443e-a00a-b284c309ed00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90e903a33d5e4b1cb939dc9d05ca2c9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:21:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:21:00Z,use_quota=True,user_id='1fd0aa2a5a7b49108ca4e0b349bcb442',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c03b150a-533b-4053-9edb-c1a39608e08c),volume_type_id=c03b150a-533b-4053-9edb-c1a39608e08c)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:20:59 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-57b5df01-1b67-4e83-bde7-d94abe1a1e65 tempest-GroupsTest-820491831 None] Creating volume 3e3b5b39-639a-443e-a00a-b284c309ed00 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:20:59 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-57b5df01-1b67-4e83-bde7-d94abe1a1e65 tempest-GroupsTest-820491831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:20:59 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-57b5df01-1b67-4e83-bde7-d94abe1a1e65 tempest-GroupsTest-820491831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:20:59 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-57b5df01-1b67-4e83-bde7-d94abe1a1e65 tempest-GroupsTest-820491831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:20:59 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-57b5df01-1b67-4e83-bde7-d94abe1a1e65 tempest-GroupsTest-820491831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:20:59 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-57b5df01-1b67-4e83-bde7-d94abe1a1e65 tempest-GroupsTest-820491831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:20:59 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-57b5df01-1b67-4e83-bde7-d94abe1a1e65 tempest-GroupsTest-820491831 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:20:59 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-57b5df01-1b67-4e83-bde7-d94abe1a1e65 tempest-GroupsTest-820491831 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:20:59 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-57b5df01-1b67-4e83-bde7-d94abe1a1e65 tempest-GroupsTest-820491831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3e3b5b39-639a-443e-a00a-b284c309ed00 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:20:59 devstack sudo[101110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3e3b5b39-639a-443e-a00a-b284c309ed00 1073741824 Apr 29 15:20:59 devstack sudo[101110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:21:00 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-6d5f983f-acc8-4f3b-9795-39e303e82e48 req-ca6c065c-c1e8-4955-af2a-895d0b7739cc tempest-AttachVolumeTestJSON-1394496241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:21:00 devstack sudo[101110]: pam_unix(sudo:session): session closed for user root Apr 29 15:21:00 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-57b5df01-1b67-4e83-bde7-d94abe1a1e65 tempest-GroupsTest-820491831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3e3b5b39-639a-443e-a00a-b284c309ed00 1073741824" returned: 0 in 0.894s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:21:00 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-57b5df01-1b67-4e83-bde7-d94abe1a1e65 tempest-GroupsTest-820491831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3e3b5b39-639a-443e-a00a-b284c309ed00 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:21:00 devstack sudo[101124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3e3b5b39-639a-443e-a00a-b284c309ed00 Apr 29 15:21:00 devstack sudo[101124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:21:01 devstack sudo[101124]: pam_unix(sudo:session): session closed for user root Apr 29 15:21:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-57b5df01-1b67-4e83-bde7-d94abe1a1e65 tempest-GroupsTest-820491831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3e3b5b39-639a-443e-a00a-b284c309ed00" returned: 0 in 0.656s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:21:01 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-57b5df01-1b67-4e83-bde7-d94abe1a1e65 tempest-GroupsTest-820491831 None] <== create_volume: return (1596ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:21:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-57b5df01-1b67-4e83-bde7-d94abe1a1e65 tempest-GroupsTest-820491831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.599s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:21:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-6d5f983f-acc8-4f3b-9795-39e303e82e48 req-ca6c065c-c1e8-4955-af2a-895d0b7739cc tempest-AttachVolumeTestJSON-1394496241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.936s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:21:01 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-57b5df01-1b67-4e83-bde7-d94abe1a1e65 tempest-GroupsTest-820491831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb2a5584-7342-4d75-95ec-a5a91162f840) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e3b5b39-639a-443e-a00a-b284c309ed00', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:21:01 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-57b5df01-1b67-4e83-bde7-d94abe1a1e65 tempest-GroupsTest-820491831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71250c28-2c22-4e3c-a76a-515ba57b3845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:21:01 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[016854f0-ef8b-457a-b9cc-09ca60851033]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:21:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-6d5f983f-acc8-4f3b-9795-39e303e82e48 req-ca6c065c-c1e8-4955-af2a-895d0b7739cc tempest-AttachVolumeTestJSON-1394496241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-6082c3e6-83e0-4151-91a9-00eec55778d6 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:21:01 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-57b5df01-1b67-4e83-bde7-d94abe1a1e65 tempest-GroupsTest-820491831 None] Volume volume-3e3b5b39-639a-443e-a00a-b284c309ed00 (3e3b5b39-639a-443e-a00a-b284c309ed00): created successfully Apr 29 15:21:01 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-57b5df01-1b67-4e83-bde7-d94abe1a1e65 tempest-GroupsTest-820491831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71250c28-2c22-4e3c-a76a-515ba57b3845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:21:01 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-57b5df01-1b67-4e83-bde7-d94abe1a1e65 tempest-GroupsTest-820491831 None] Flow 'volume_create_manager' (4be4d614-4561-427f-984b-ba0abe878a20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:21:01 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-57b5df01-1b67-4e83-bde7-d94abe1a1e65 tempest-GroupsTest-820491831 None] Created volume successfully. Apr 29 15:21:01 devstack sudo[101127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-6082c3e6-83e0-4151-91a9-00eec55778d6 Apr 29 15:21:01 devstack sudo[101127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:21:02 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-3a4e8228-fc9c-4d68-a64a-101d4737484d tempest-GroupsTest-820491831 None] Update group completed successfully. Apr 29 15:21:02 devstack sudo[101127]: pam_unix(sudo:session): session closed for user root Apr 29 15:21:02 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-6d5f983f-acc8-4f3b-9795-39e303e82e48 req-ca6c065c-c1e8-4955-af2a-895d0b7739cc tempest-AttachVolumeTestJSON-1394496241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-6082c3e6-83e0-4151-91a9-00eec55778d6" returned: 0 in 0.801s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:21:02 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-6d5f983f-acc8-4f3b-9795-39e303e82e48 req-ca6c065c-c1e8-4955-af2a-895d0b7739cc tempest-AttachVolumeTestJSON-1394496241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.834s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:21:02 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-6d5f983f-acc8-4f3b-9795-39e303e82e48 req-ca6c065c-c1e8-4955-af2a-895d0b7739cc tempest-AttachVolumeTestJSON-1394496241 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a', 'name': 'volume-6082c3e6-83e0-4151-91a9-00eec55778d6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd7329e13-91b3-4179-8037-eb61172da01c', 'enforce_multipath': True} {{(pid=84448) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 15:21:02 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-6d5f983f-acc8-4f3b-9795-39e303e82e48 req-ca6c065c-c1e8-4955-af2a-895d0b7739cc tempest-AttachVolumeTestJSON-1394496241 None] attachment_update completed successfully. Apr 29 15:21:02 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-53034cc6-3876-4491-8879-97059e87c735 tempest-GroupsTest-820491831 None] Update group completed successfully. Apr 29 15:21:03 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-86d9b303-3920-469d-a7cf-c6c35c63cdc4 tempest-GroupsTest-820491831 None] Acquiring lock "cinder-quobyte-3e3b5b39-639a-443e-a00a-b284c309ed00" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:21:03 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-86d9b303-3920-469d-a7cf-c6c35c63cdc4 tempest-GroupsTest-820491831 None] Lock "cinder-quobyte-3e3b5b39-639a-443e-a00a-b284c309ed00" acquired by "delete_volume" :: waited 0.019s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:21:03 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef69ae4-165f-49e3-b46d-1937cc746401]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:21:03 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-86d9b303-3920-469d-a7cf-c6c35c63cdc4 tempest-GroupsTest-820491831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3e3b5b39-639a-443e-a00a-b284c309ed00 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:21:04 devstack sudo[101515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3e3b5b39-639a-443e-a00a-b284c309ed00 Apr 29 15:21:04 devstack sudo[101515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:21:04 devstack sudo[101515]: pam_unix(sudo:session): session closed for user root Apr 29 15:21:04 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-86d9b303-3920-469d-a7cf-c6c35c63cdc4 tempest-GroupsTest-820491831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3e3b5b39-639a-443e-a00a-b284c309ed00" returned: 0 in 0.768s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:21:04 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-86d9b303-3920-469d-a7cf-c6c35c63cdc4 tempest-GroupsTest-820491831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3e3b5b39-639a-443e-a00a-b284c309ed00 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:21:04 devstack sudo[101520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3e3b5b39-639a-443e-a00a-b284c309ed00 Apr 29 15:21:04 devstack sudo[101520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:21:05 devstack sudo[101520]: pam_unix(sudo:session): session closed for user root Apr 29 15:21:05 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-86d9b303-3920-469d-a7cf-c6c35c63cdc4 tempest-GroupsTest-820491831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3e3b5b39-639a-443e-a00a-b284c309ed00" returned: 0 in 0.630s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:21:05 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-86d9b303-3920-469d-a7cf-c6c35c63cdc4 tempest-GroupsTest-820491831 None] Lock "cinder-quobyte-3e3b5b39-639a-443e-a00a-b284c309ed00" released by "delete_volume" :: held 1.450s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:21:05 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-86d9b303-3920-469d-a7cf-c6c35c63cdc4 tempest-GroupsTest-820491831 None] Acquiring lock "cinder-quobyte-8397a16d-40ee-49c8-9095-abc0662202e1" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:21:05 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-86d9b303-3920-469d-a7cf-c6c35c63cdc4 tempest-GroupsTest-820491831 None] Lock "cinder-quobyte-8397a16d-40ee-49c8-9095-abc0662202e1" acquired by "delete_volume" :: waited 0.021s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:21:05 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[b09424ee-4f6c-4abe-97a8-6a0eabc5105f]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:21:05 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-86d9b303-3920-469d-a7cf-c6c35c63cdc4 tempest-GroupsTest-820491831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-8397a16d-40ee-49c8-9095-abc0662202e1 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:21:05 devstack sudo[101523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-8397a16d-40ee-49c8-9095-abc0662202e1 Apr 29 15:21:05 devstack sudo[101523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:21:06 devstack sudo[101523]: pam_unix(sudo:session): session closed for user root Apr 29 15:21:06 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-86d9b303-3920-469d-a7cf-c6c35c63cdc4 tempest-GroupsTest-820491831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-8397a16d-40ee-49c8-9095-abc0662202e1" returned: 0 in 0.834s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:21:06 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-86d9b303-3920-469d-a7cf-c6c35c63cdc4 tempest-GroupsTest-820491831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-8397a16d-40ee-49c8-9095-abc0662202e1 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:21:06 devstack sudo[101529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-8397a16d-40ee-49c8-9095-abc0662202e1 Apr 29 15:21:06 devstack sudo[101529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:21:06 devstack sudo[101529]: pam_unix(sudo:session): session closed for user root Apr 29 15:21:06 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-86d9b303-3920-469d-a7cf-c6c35c63cdc4 tempest-GroupsTest-820491831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-8397a16d-40ee-49c8-9095-abc0662202e1" returned: 0 in 0.654s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:21:06 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-86d9b303-3920-469d-a7cf-c6c35c63cdc4 tempest-GroupsTest-820491831 None] Lock "cinder-quobyte-8397a16d-40ee-49c8-9095-abc0662202e1" released by "delete_volume" :: held 1.534s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:21:06 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-86d9b303-3920-469d-a7cf-c6c35c63cdc4 tempest-GroupsTest-820491831 None] Created reservations ['d34c1abf-575c-4ef2-9360-b3408551a1ed'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:21:06 devstack cinder-volume[84448]: WARNING cinder.quota [None req-86d9b303-3920-469d-a7cf-c6c35c63cdc4 tempest-GroupsTest-820491831 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-301015127 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-301015127, it is now deprecated. Please use the default quota class for default quota. Apr 29 15:21:06 devstack cinder-volume[84448]: WARNING cinder.quota [None req-86d9b303-3920-469d-a7cf-c6c35c63cdc4 tempest-GroupsTest-820491831 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-301015127 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-301015127, it is now deprecated. Please use the default quota class for default quota. Apr 29 15:21:07 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-86d9b303-3920-469d-a7cf-c6c35c63cdc4 tempest-GroupsTest-820491831 None] Created reservations ['be465af1-1817-46e7-a70b-0f2d521d0420', '3539c338-fcfc-4097-8d9f-363303f91b7c', 'f3431f26-ff54-4807-9ba6-e60c3d778656', '08a4e7ce-2240-4b50-83d4-f1e06c8351f7'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:21:07 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-491e4d9a-fc49-4057-b873-1dc61902f9e9 tempest-AttachVolumeTestJSON-1394496241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:21:07 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-491e4d9a-fc49-4057-b873-1dc61902f9e9 tempest-AttachVolumeTestJSON-1394496241 None] Flow 'volume_create_manager' (b06915e8-8da0-41a5-9cf7-7def938fe11f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:21:07 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-491e4d9a-fc49-4057-b873-1dc61902f9e9 tempest-AttachVolumeTestJSON-1394496241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb57d9ff-8878-41a8-98ba-bd59b6bc5313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:21:07 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-491e4d9a-fc49-4057-b873-1dc61902f9e9 tempest-AttachVolumeTestJSON-1394496241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb57d9ff-8878-41a8-98ba-bd59b6bc5313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:21:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2064564651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d15a381b-081c-4f08-9782-b95843cc2e2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33c47d81199440e5bdd459bf2f392652',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:21:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:21:07Z,use_quota=True,user_id='2fc15cf20cbc4e259b61500747485de0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:21:07 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-491e4d9a-fc49-4057-b873-1dc61902f9e9 tempest-AttachVolumeTestJSON-1394496241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (035a3989-6be1-42b5-995c-a9a543649d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:21:07 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-491e4d9a-fc49-4057-b873-1dc61902f9e9 tempest-AttachVolumeTestJSON-1394496241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (035a3989-6be1-42b5-995c-a9a543649d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:21:07 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-491e4d9a-fc49-4057-b873-1dc61902f9e9 tempest-AttachVolumeTestJSON-1394496241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26c6330e-26c5-4673-af97-3d66e9769ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:21:07 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-491e4d9a-fc49-4057-b873-1dc61902f9e9 tempest-AttachVolumeTestJSON-1394496241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26c6330e-26c5-4673-af97-3d66e9769ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd15a381b-081c-4f08-9782-b95843cc2e2a', 'volume_name': 'volume-d15a381b-081c-4f08-9782-b95843cc2e2a', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:21:07 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-491e4d9a-fc49-4057-b873-1dc61902f9e9 tempest-AttachVolumeTestJSON-1394496241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a5c1383-f3c6-4bc7-abe6-a89758ff105c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:21:07 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-491e4d9a-fc49-4057-b873-1dc61902f9e9 tempest-AttachVolumeTestJSON-1394496241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a5c1383-f3c6-4bc7-abe6-a89758ff105c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:21:07 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-491e4d9a-fc49-4057-b873-1dc61902f9e9 tempest-AttachVolumeTestJSON-1394496241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3b57bd5-884e-4d40-9c5f-2a9e773b1425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:21:07 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-491e4d9a-fc49-4057-b873-1dc61902f9e9 tempest-AttachVolumeTestJSON-1394496241 None] Volume d15a381b-081c-4f08-9782-b95843cc2e2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d15a381b-081c-4f08-9782-b95843cc2e2a', 'volume_size': 1} Apr 29 15:21:07 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-491e4d9a-fc49-4057-b873-1dc61902f9e9 tempest-AttachVolumeTestJSON-1394496241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:21:07 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-491e4d9a-fc49-4057-b873-1dc61902f9e9 tempest-AttachVolumeTestJSON-1394496241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:21:07 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-491e4d9a-fc49-4057-b873-1dc61902f9e9 tempest-AttachVolumeTestJSON-1394496241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:21:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2064564651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d15a381b-081c-4f08-9782-b95843cc2e2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33c47d81199440e5bdd459bf2f392652',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:21:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:21:07Z,use_quota=True,user_id='2fc15cf20cbc4e259b61500747485de0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:21:07 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-491e4d9a-fc49-4057-b873-1dc61902f9e9 tempest-AttachVolumeTestJSON-1394496241 None] Creating volume d15a381b-081c-4f08-9782-b95843cc2e2a {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:21:07 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-491e4d9a-fc49-4057-b873-1dc61902f9e9 tempest-AttachVolumeTestJSON-1394496241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:21:07 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-491e4d9a-fc49-4057-b873-1dc61902f9e9 tempest-AttachVolumeTestJSON-1394496241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:21:07 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-491e4d9a-fc49-4057-b873-1dc61902f9e9 tempest-AttachVolumeTestJSON-1394496241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:21:07 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-491e4d9a-fc49-4057-b873-1dc61902f9e9 tempest-AttachVolumeTestJSON-1394496241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:21:07 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-491e4d9a-fc49-4057-b873-1dc61902f9e9 tempest-AttachVolumeTestJSON-1394496241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:21:07 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-491e4d9a-fc49-4057-b873-1dc61902f9e9 tempest-AttachVolumeTestJSON-1394496241 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:21:07 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-491e4d9a-fc49-4057-b873-1dc61902f9e9 tempest-AttachVolumeTestJSON-1394496241 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:21:07 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-491e4d9a-fc49-4057-b873-1dc61902f9e9 tempest-AttachVolumeTestJSON-1394496241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d15a381b-081c-4f08-9782-b95843cc2e2a 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:21:07 devstack sudo[101532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d15a381b-081c-4f08-9782-b95843cc2e2a 1073741824 Apr 29 15:21:07 devstack sudo[101532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:21:07 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-86d9b303-3920-469d-a7cf-c6c35c63cdc4 tempest-GroupsTest-820491831 None] Created reservations ['e36f22d9-9c17-41b7-89f9-031d8ff243e8', '7a4fb169-2f6f-4640-aaca-3c4a64725a31', '85a58a78-3990-4e4b-8f39-df8e9b6352f9', '4909c12c-3371-4087-bf8f-3187caa7980d'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:21:07 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-86d9b303-3920-469d-a7cf-c6c35c63cdc4 tempest-GroupsTest-820491831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:21:07 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-86d9b303-3920-469d-a7cf-c6c35c63cdc4 tempest-GroupsTest-820491831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:21:07 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-86d9b303-3920-469d-a7cf-c6c35c63cdc4 tempest-GroupsTest-820491831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:21:07 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-86d9b303-3920-469d-a7cf-c6c35c63cdc4 tempest-GroupsTest-820491831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:21:07 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-86d9b303-3920-469d-a7cf-c6c35c63cdc4 tempest-GroupsTest-820491831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:21:07 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-86d9b303-3920-469d-a7cf-c6c35c63cdc4 tempest-GroupsTest-820491831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:21:07 devstack sudo[101534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:21:07 devstack sudo[101534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:21:08 devstack sudo[101532]: pam_unix(sudo:session): session closed for user root Apr 29 15:21:08 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-491e4d9a-fc49-4057-b873-1dc61902f9e9 tempest-AttachVolumeTestJSON-1394496241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d15a381b-081c-4f08-9782-b95843cc2e2a 1073741824" returned: 0 in 0.816s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:21:08 devstack sudo[101534]: pam_unix(sudo:session): session closed for user root Apr 29 15:21:08 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-86d9b303-3920-469d-a7cf-c6c35c63cdc4 tempest-GroupsTest-820491831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.676s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:21:08 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-86d9b303-3920-469d-a7cf-c6c35c63cdc4 tempest-GroupsTest-820491831 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:21:08 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-86d9b303-3920-469d-a7cf-c6c35c63cdc4 tempest-GroupsTest-820491831 None] Delete group completed successfully. Apr 29 15:21:08 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-491e4d9a-fc49-4057-b873-1dc61902f9e9 tempest-AttachVolumeTestJSON-1394496241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d15a381b-081c-4f08-9782-b95843cc2e2a {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:21:08 devstack sudo[101541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d15a381b-081c-4f08-9782-b95843cc2e2a Apr 29 15:21:08 devstack sudo[101541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:21:08 devstack sudo[101541]: pam_unix(sudo:session): session closed for user root Apr 29 15:21:08 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-491e4d9a-fc49-4057-b873-1dc61902f9e9 tempest-AttachVolumeTestJSON-1394496241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d15a381b-081c-4f08-9782-b95843cc2e2a" returned: 0 in 0.703s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:21:08 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-491e4d9a-fc49-4057-b873-1dc61902f9e9 tempest-AttachVolumeTestJSON-1394496241 None] <== create_volume: return (1570ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:21:08 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-491e4d9a-fc49-4057-b873-1dc61902f9e9 tempest-AttachVolumeTestJSON-1394496241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.573s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:21:08 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-491e4d9a-fc49-4057-b873-1dc61902f9e9 tempest-AttachVolumeTestJSON-1394496241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3b57bd5-884e-4d40-9c5f-2a9e773b1425) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d15a381b-081c-4f08-9782-b95843cc2e2a', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:21:08 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-491e4d9a-fc49-4057-b873-1dc61902f9e9 tempest-AttachVolumeTestJSON-1394496241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53e72991-b081-4987-85fa-2ec1bc1dd319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:21:08 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-491e4d9a-fc49-4057-b873-1dc61902f9e9 tempest-AttachVolumeTestJSON-1394496241 None] Volume volume-d15a381b-081c-4f08-9782-b95843cc2e2a (d15a381b-081c-4f08-9782-b95843cc2e2a): created successfully Apr 29 15:21:08 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-491e4d9a-fc49-4057-b873-1dc61902f9e9 tempest-AttachVolumeTestJSON-1394496241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53e72991-b081-4987-85fa-2ec1bc1dd319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:21:08 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-491e4d9a-fc49-4057-b873-1dc61902f9e9 tempest-AttachVolumeTestJSON-1394496241 None] Flow 'volume_create_manager' (b06915e8-8da0-41a5-9cf7-7def938fe11f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:21:08 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-491e4d9a-fc49-4057-b873-1dc61902f9e9 tempest-AttachVolumeTestJSON-1394496241 None] Created volume successfully. Apr 29 15:21:12 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-5c15935b-7e1a-40d6-9a19-13aa426cf36f req-2907d03e-df10-4c28-a784-50714b8ca670 tempest-AttachVolumeTestJSON-1394496241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:21:12 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-5c15935b-7e1a-40d6-9a19-13aa426cf36f req-2907d03e-df10-4c28-a784-50714b8ca670 tempest-AttachVolumeTestJSON-1394496241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:21:12 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b56b0b-7d7a-429b-ab0b-4db6f1df4d73]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:21:12 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-5c15935b-7e1a-40d6-9a19-13aa426cf36f req-2907d03e-df10-4c28-a784-50714b8ca670 tempest-AttachVolumeTestJSON-1394496241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d15a381b-081c-4f08-9782-b95843cc2e2a {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:21:12 devstack sudo[101552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d15a381b-081c-4f08-9782-b95843cc2e2a Apr 29 15:21:12 devstack sudo[101552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:21:13 devstack sudo[101552]: pam_unix(sudo:session): session closed for user root Apr 29 15:21:13 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-5c15935b-7e1a-40d6-9a19-13aa426cf36f req-2907d03e-df10-4c28-a784-50714b8ca670 tempest-AttachVolumeTestJSON-1394496241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d15a381b-081c-4f08-9782-b95843cc2e2a" returned: 0 in 0.891s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:21:13 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-5c15935b-7e1a-40d6-9a19-13aa426cf36f req-2907d03e-df10-4c28-a784-50714b8ca670 tempest-AttachVolumeTestJSON-1394496241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.920s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:21:13 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-5c15935b-7e1a-40d6-9a19-13aa426cf36f req-2907d03e-df10-4c28-a784-50714b8ca670 tempest-AttachVolumeTestJSON-1394496241 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a', 'name': 'volume-d15a381b-081c-4f08-9782-b95843cc2e2a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '99d33541-a90b-4495-83d0-54003bdb6307', 'enforce_multipath': True} {{(pid=84448) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 15:21:13 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-5c15935b-7e1a-40d6-9a19-13aa426cf36f req-2907d03e-df10-4c28-a784-50714b8ca670 tempest-AttachVolumeTestJSON-1394496241 None] attachment_update completed successfully. Apr 29 15:21:13 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-128dd473-44de-4f07-b0d6-6ce8fdf16a85 tempest-GroupsV314Test-984512547 None] Group tempest-GroupsV314Test-Group-842024738: creating Apr 29 15:21:13 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-128dd473-44de-4f07-b0d6-6ce8fdf16a85 tempest-GroupsV314Test-984512547 None] Group tempest-GroupsV314Test-Group-842024738: created successfully Apr 29 15:21:13 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-128dd473-44de-4f07-b0d6-6ce8fdf16a85 tempest-GroupsV314Test-984512547 None] Create group completed successfully. Apr 29 15:21:15 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a5a56d8-9e8b-4c72-85e7-87daa99aa455 tempest-GroupsV314Test-984512547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:21:15 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-9a5a56d8-9e8b-4c72-85e7-87daa99aa455 tempest-GroupsV314Test-984512547 None] Flow 'volume_create_manager' (04473c3f-7fb8-4367-8924-390e619fa23e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:21:15 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-9a5a56d8-9e8b-4c72-85e7-87daa99aa455 tempest-GroupsV314Test-984512547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12d5d35d-a2fd-44ba-95ca-48d6b211c22d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:21:15 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-9a5a56d8-9e8b-4c72-85e7-87daa99aa455 tempest-GroupsV314Test-984512547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12d5d35d-a2fd-44ba-95ca-48d6b211c22d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:21:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-863494275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6cfffdde-8772-4076-9363-2e2af032f6a4,host='devstack@QuobyteHD#QuobyteHD',id=9660f1f9-1d12-46e7-ac14-655c9138a60b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f84a337675c94be7959846836fe5557a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:21:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:21:15Z,use_quota=True,user_id='5e3bba6df3804ac38cec11c79d6d5dd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3f04677-bab3-4a53-8e4d-fb0129c5e0c2),volume_type_id=b3f04677-bab3-4a53-8e4d-fb0129c5e0c2)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:21:15 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-9a5a56d8-9e8b-4c72-85e7-87daa99aa455 tempest-GroupsV314Test-984512547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66b1cd93-2e1b-4cbc-aabd-4cc1919f4b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:21:15 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-9a5a56d8-9e8b-4c72-85e7-87daa99aa455 tempest-GroupsV314Test-984512547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66b1cd93-2e1b-4cbc-aabd-4cc1919f4b4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:21:15 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-9a5a56d8-9e8b-4c72-85e7-87daa99aa455 tempest-GroupsV314Test-984512547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (310334b0-f065-49c4-bf11-b8dd3490bb15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:21:15 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-9a5a56d8-9e8b-4c72-85e7-87daa99aa455 tempest-GroupsV314Test-984512547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (310334b0-f065-49c4-bf11-b8dd3490bb15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9660f1f9-1d12-46e7-ac14-655c9138a60b', 'volume_name': 'volume-9660f1f9-1d12-46e7-ac14-655c9138a60b', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:21:15 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-9a5a56d8-9e8b-4c72-85e7-87daa99aa455 tempest-GroupsV314Test-984512547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d31209d0-61a3-477f-9da4-f5d3d4fc16e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:21:15 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-9a5a56d8-9e8b-4c72-85e7-87daa99aa455 tempest-GroupsV314Test-984512547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d31209d0-61a3-477f-9da4-f5d3d4fc16e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:21:15 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-9a5a56d8-9e8b-4c72-85e7-87daa99aa455 tempest-GroupsV314Test-984512547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a149f93-8057-4420-aff0-ac479f7eb237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:21:15 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-9a5a56d8-9e8b-4c72-85e7-87daa99aa455 tempest-GroupsV314Test-984512547 None] Volume 9660f1f9-1d12-46e7-ac14-655c9138a60b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9660f1f9-1d12-46e7-ac14-655c9138a60b', 'volume_size': 1} Apr 29 15:21:15 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-9a5a56d8-9e8b-4c72-85e7-87daa99aa455 tempest-GroupsV314Test-984512547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:21:15 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-9a5a56d8-9e8b-4c72-85e7-87daa99aa455 tempest-GroupsV314Test-984512547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:21:15 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-9a5a56d8-9e8b-4c72-85e7-87daa99aa455 tempest-GroupsV314Test-984512547 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6cfffdde-8772-4076-9363-2e2af032f6a4,created_at=2026-04-29T13:21:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-863494275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6cfffdde-8772-4076-9363-2e2af032f6a4,host='devstack@QuobyteHD#QuobyteHD',id=9660f1f9-1d12-46e7-ac14-655c9138a60b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f84a337675c94be7959846836fe5557a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:21:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:21:15Z,use_quota=True,user_id='5e3bba6df3804ac38cec11c79d6d5dd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3f04677-bab3-4a53-8e4d-fb0129c5e0c2),volume_type_id=b3f04677-bab3-4a53-8e4d-fb0129c5e0c2)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:21:15 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-9a5a56d8-9e8b-4c72-85e7-87daa99aa455 tempest-GroupsV314Test-984512547 None] Creating volume 9660f1f9-1d12-46e7-ac14-655c9138a60b {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:21:15 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-9a5a56d8-9e8b-4c72-85e7-87daa99aa455 tempest-GroupsV314Test-984512547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:21:15 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-9a5a56d8-9e8b-4c72-85e7-87daa99aa455 tempest-GroupsV314Test-984512547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:21:15 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-9a5a56d8-9e8b-4c72-85e7-87daa99aa455 tempest-GroupsV314Test-984512547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:21:15 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-9a5a56d8-9e8b-4c72-85e7-87daa99aa455 tempest-GroupsV314Test-984512547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:21:15 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-9a5a56d8-9e8b-4c72-85e7-87daa99aa455 tempest-GroupsV314Test-984512547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:21:15 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-9a5a56d8-9e8b-4c72-85e7-87daa99aa455 tempest-GroupsV314Test-984512547 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:21:15 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-9a5a56d8-9e8b-4c72-85e7-87daa99aa455 tempest-GroupsV314Test-984512547 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:21:15 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-9a5a56d8-9e8b-4c72-85e7-87daa99aa455 tempest-GroupsV314Test-984512547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9660f1f9-1d12-46e7-ac14-655c9138a60b 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:21:15 devstack sudo[101559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9660f1f9-1d12-46e7-ac14-655c9138a60b 1073741824 Apr 29 15:21:15 devstack sudo[101559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:21:16 devstack sudo[101559]: pam_unix(sudo:session): session closed for user root Apr 29 15:21:16 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-9a5a56d8-9e8b-4c72-85e7-87daa99aa455 tempest-GroupsV314Test-984512547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9660f1f9-1d12-46e7-ac14-655c9138a60b 1073741824" returned: 0 in 0.964s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:21:16 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-9a5a56d8-9e8b-4c72-85e7-87daa99aa455 tempest-GroupsV314Test-984512547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9660f1f9-1d12-46e7-ac14-655c9138a60b {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:21:16 devstack sudo[101566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9660f1f9-1d12-46e7-ac14-655c9138a60b Apr 29 15:21:16 devstack sudo[101566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:21:17 devstack sudo[101566]: pam_unix(sudo:session): session closed for user root Apr 29 15:21:17 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-9a5a56d8-9e8b-4c72-85e7-87daa99aa455 tempest-GroupsV314Test-984512547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9660f1f9-1d12-46e7-ac14-655c9138a60b" returned: 0 in 0.625s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:21:17 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-9a5a56d8-9e8b-4c72-85e7-87daa99aa455 tempest-GroupsV314Test-984512547 None] <== create_volume: return (1635ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:21:17 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-9a5a56d8-9e8b-4c72-85e7-87daa99aa455 tempest-GroupsV314Test-984512547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.637s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:21:17 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-9a5a56d8-9e8b-4c72-85e7-87daa99aa455 tempest-GroupsV314Test-984512547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a149f93-8057-4420-aff0-ac479f7eb237) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9660f1f9-1d12-46e7-ac14-655c9138a60b', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:21:17 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-9a5a56d8-9e8b-4c72-85e7-87daa99aa455 tempest-GroupsV314Test-984512547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91d03d75-9c47-4e79-b8af-519782cf0975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:21:17 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-9a5a56d8-9e8b-4c72-85e7-87daa99aa455 tempest-GroupsV314Test-984512547 None] Volume volume-9660f1f9-1d12-46e7-ac14-655c9138a60b (9660f1f9-1d12-46e7-ac14-655c9138a60b): created successfully Apr 29 15:21:17 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-9a5a56d8-9e8b-4c72-85e7-87daa99aa455 tempest-GroupsV314Test-984512547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91d03d75-9c47-4e79-b8af-519782cf0975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:21:17 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-9a5a56d8-9e8b-4c72-85e7-87daa99aa455 tempest-GroupsV314Test-984512547 None] Flow 'volume_create_manager' (04473c3f-7fb8-4367-8924-390e619fa23e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:21:17 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-9a5a56d8-9e8b-4c72-85e7-87daa99aa455 tempest-GroupsV314Test-984512547 None] Created volume successfully. Apr 29 15:21:18 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-dd87bdc7-2946-4a0d-a769-4fb83fa57cd6 tempest-GroupsV314Test-984512547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:21:18 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-dd87bdc7-2946-4a0d-a769-4fb83fa57cd6 tempest-GroupsV314Test-984512547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:21:18 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-dd87bdc7-2946-4a0d-a769-4fb83fa57cd6 tempest-GroupsV314Test-984512547 None] Cloning volume 9660f1f9-1d12-46e7-ac14-655c9138a60b to volume aa4e3d0f-8116-4bad-8e06-cfb7ef985494 Apr 29 15:21:18 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-dd87bdc7-2946-4a0d-a769-4fb83fa57cd6 tempest-GroupsV314Test-984512547 None] Creating offline snapshot 71f577e7-6ab4-40b1-8edb-c26f1192d2cb of volume 9660f1f9-1d12-46e7-ac14-655c9138a60b {{(pid=84448) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 15:21:18 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee3af179-f130-4d4a-9b7d-e781fc2fda71]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:21:18 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-dd87bdc7-2946-4a0d-a769-4fb83fa57cd6 tempest-GroupsV314Test-984512547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9660f1f9-1d12-46e7-ac14-655c9138a60b {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:21:19 devstack sudo[101571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9660f1f9-1d12-46e7-ac14-655c9138a60b Apr 29 15:21:19 devstack sudo[101571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:21:19 devstack sudo[101571]: pam_unix(sudo:session): session closed for user root Apr 29 15:21:19 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-dd87bdc7-2946-4a0d-a769-4fb83fa57cd6 tempest-GroupsV314Test-984512547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9660f1f9-1d12-46e7-ac14-655c9138a60b" returned: 0 in 0.763s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:21:19 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-dd87bdc7-2946-4a0d-a769-4fb83fa57cd6 tempest-GroupsV314Test-984512547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9660f1f9-1d12-46e7-ac14-655c9138a60b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9660f1f9-1d12-46e7-ac14-655c9138a60b.71f577e7-6ab4-40b1-8edb-c26f1192d2cb 1G {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:21:19 devstack sudo[101576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9660f1f9-1d12-46e7-ac14-655c9138a60b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9660f1f9-1d12-46e7-ac14-655c9138a60b.71f577e7-6ab4-40b1-8edb-c26f1192d2cb 1G Apr 29 15:21:19 devstack sudo[101576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:21:20 devstack sudo[101576]: pam_unix(sudo:session): session closed for user root Apr 29 15:21:20 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-dd87bdc7-2946-4a0d-a769-4fb83fa57cd6 tempest-GroupsV314Test-984512547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9660f1f9-1d12-46e7-ac14-655c9138a60b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9660f1f9-1d12-46e7-ac14-655c9138a60b.71f577e7-6ab4-40b1-8edb-c26f1192d2cb 1G" returned: 0 in 0.883s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:21:20 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-dd87bdc7-2946-4a0d-a769-4fb83fa57cd6 tempest-GroupsV314Test-984512547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9660f1f9-1d12-46e7-ac14-655c9138a60b -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9660f1f9-1d12-46e7-ac14-655c9138a60b.71f577e7-6ab4-40b1-8edb-c26f1192d2cb {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:21:20 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-7a45b908-add8-46ac-8893-6615337a3263 req-6ced7081-12e5-4f8e-a37e-8e29fc64382a tempest-AttachVolumeTestJSON-1394496241 None] Terminate volume connection completed successfully. Apr 29 15:21:20 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-7a45b908-add8-46ac-8893-6615337a3263 req-6ced7081-12e5-4f8e-a37e-8e29fc64382a tempest-AttachVolumeTestJSON-1394496241 None] Deleting attachment d7329e13-91b3-4179-8037-eb61172da01c. {{(pid=84448) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 15:21:20 devstack sudo[101585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9660f1f9-1d12-46e7-ac14-655c9138a60b -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9660f1f9-1d12-46e7-ac14-655c9138a60b.71f577e7-6ab4-40b1-8edb-c26f1192d2cb Apr 29 15:21:20 devstack sudo[101585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:21:21 devstack sudo[101585]: pam_unix(sudo:session): session closed for user root Apr 29 15:21:21 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-dd87bdc7-2946-4a0d-a769-4fb83fa57cd6 tempest-GroupsV314Test-984512547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9660f1f9-1d12-46e7-ac14-655c9138a60b -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9660f1f9-1d12-46e7-ac14-655c9138a60b.71f577e7-6ab4-40b1-8edb-c26f1192d2cb" returned: 0 in 0.824s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:21:21 devstack cinder-volume[84448]: WARNING cinder.volume.drivers.remotefs [None req-dd87bdc7-2946-4a0d-a769-4fb83fa57cd6 tempest-GroupsV314Test-984512547 None] /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9660f1f9-1d12-46e7-ac14-655c9138a60b.71f577e7-6ab4-40b1-8edb-c26f1192d2cb is being set with open permissions: ugo+rw: NotImplementedError Apr 29 15:21:21 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-dd87bdc7-2946-4a0d-a769-4fb83fa57cd6 tempest-GroupsV314Test-984512547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9660f1f9-1d12-46e7-ac14-655c9138a60b.71f577e7-6ab4-40b1-8edb-c26f1192d2cb {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:21:21 devstack sudo[101590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9660f1f9-1d12-46e7-ac14-655c9138a60b.71f577e7-6ab4-40b1-8edb-c26f1192d2cb Apr 29 15:21:21 devstack sudo[101590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:21:22 devstack sudo[101590]: pam_unix(sudo:session): session closed for user root Apr 29 15:21:22 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-dd87bdc7-2946-4a0d-a769-4fb83fa57cd6 tempest-GroupsV314Test-984512547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9660f1f9-1d12-46e7-ac14-655c9138a60b.71f577e7-6ab4-40b1-8edb-c26f1192d2cb" returned: 0 in 0.785s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:21:22 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-dd87bdc7-2946-4a0d-a769-4fb83fa57cd6 tempest-GroupsV314Test-984512547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9660f1f9-1d12-46e7-ac14-655c9138a60b.info {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:21:22 devstack sudo[101593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9660f1f9-1d12-46e7-ac14-655c9138a60b.info Apr 29 15:21:22 devstack sudo[101593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:21:22 devstack sudo[101593]: pam_unix(sudo:session): session closed for user root Apr 29 15:21:22 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-dd87bdc7-2946-4a0d-a769-4fb83fa57cd6 tempest-GroupsV314Test-984512547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9660f1f9-1d12-46e7-ac14-655c9138a60b.info" returned: 0 in 0.754s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:21:22 devstack cinder-volume[84448]: WARNING cinder.volume.drivers.remotefs [None req-dd87bdc7-2946-4a0d-a769-4fb83fa57cd6 tempest-GroupsV314Test-984512547 None] /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9660f1f9-1d12-46e7-ac14-655c9138a60b.info is being set with open permissions: ugo+rw: NotImplementedError Apr 29 15:21:22 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-dd87bdc7-2946-4a0d-a769-4fb83fa57cd6 tempest-GroupsV314Test-984512547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9660f1f9-1d12-46e7-ac14-655c9138a60b.info {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:21:22 devstack sudo[101620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9660f1f9-1d12-46e7-ac14-655c9138a60b.info Apr 29 15:21:22 devstack sudo[101620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:21:23 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-a31eb217-6e9f-4a61-8123-8232b523105d req-2cb07046-4a11-48ed-b0dd-8b84268fa314 tempest-AttachVolumeTestJSON-1394496241 None] Terminate volume connection completed successfully. Apr 29 15:21:23 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-a31eb217-6e9f-4a61-8123-8232b523105d req-2cb07046-4a11-48ed-b0dd-8b84268fa314 tempest-AttachVolumeTestJSON-1394496241 None] Deleting attachment 99d33541-a90b-4495-83d0-54003bdb6307. {{(pid=84448) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 15:21:23 devstack sudo[101620]: pam_unix(sudo:session): session closed for user root Apr 29 15:21:23 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-dd87bdc7-2946-4a0d-a769-4fb83fa57cd6 tempest-GroupsV314Test-984512547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9660f1f9-1d12-46e7-ac14-655c9138a60b.info" returned: 0 in 0.698s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:21:23 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-dd87bdc7-2946-4a0d-a769-4fb83fa57cd6 tempest-GroupsV314Test-984512547 None] Acquiring lock "cinder-quobyte-aa4e3d0f-8116-4bad-8e06-cfb7ef985494" by "_copy_volume_from_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:21:23 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-dd87bdc7-2946-4a0d-a769-4fb83fa57cd6 tempest-GroupsV314Test-984512547 None] Lock "cinder-quobyte-aa4e3d0f-8116-4bad-8e06-cfb7ef985494" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:21:23 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-dd87bdc7-2946-4a0d-a769-4fb83fa57cd6 tempest-GroupsV314Test-984512547 None] snapshot: 71f577e7-6ab4-40b1-8edb-c26f1192d2cb, volume: aa4e3d0f-8116-4bad-8e06-cfb7ef985494, {{(pid=84448) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 15:21:23 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-dd87bdc7-2946-4a0d-a769-4fb83fa57cd6 tempest-GroupsV314Test-984512547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:21:23 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-dd87bdc7-2946-4a0d-a769-4fb83fa57cd6 tempest-GroupsV314Test-984512547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:21:23 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-dd87bdc7-2946-4a0d-a769-4fb83fa57cd6 tempest-GroupsV314Test-984512547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:21:23 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-dd87bdc7-2946-4a0d-a769-4fb83fa57cd6 tempest-GroupsV314Test-984512547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:21:23 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-dd87bdc7-2946-4a0d-a769-4fb83fa57cd6 tempest-GroupsV314Test-984512547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:21:23 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[09921343-3f02-4654-9402-b6f1dc789b6b]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:21:23 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-dd87bdc7-2946-4a0d-a769-4fb83fa57cd6 tempest-GroupsV314Test-984512547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9660f1f9-1d12-46e7-ac14-655c9138a60b.71f577e7-6ab4-40b1-8edb-c26f1192d2cb {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:21:23 devstack sudo[101626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9660f1f9-1d12-46e7-ac14-655c9138a60b.71f577e7-6ab4-40b1-8edb-c26f1192d2cb Apr 29 15:21:23 devstack sudo[101626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:21:24 devstack sudo[101626]: pam_unix(sudo:session): session closed for user root Apr 29 15:21:24 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-dd87bdc7-2946-4a0d-a769-4fb83fa57cd6 tempest-GroupsV314Test-984512547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9660f1f9-1d12-46e7-ac14-655c9138a60b.71f577e7-6ab4-40b1-8edb-c26f1192d2cb" returned: 0 in 0.849s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:21:24 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-dd87bdc7-2946-4a0d-a769-4fb83fa57cd6 tempest-GroupsV314Test-984512547 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9660f1f9-1d12-46e7-ac14-655c9138a60b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84448) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 15:21:24 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-dd87bdc7-2946-4a0d-a769-4fb83fa57cd6 tempest-GroupsV314Test-984512547 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9660f1f9-1d12-46e7-ac14-655c9138a60b {{(pid=84448) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 15:21:24 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-dd87bdc7-2946-4a0d-a769-4fb83fa57cd6 tempest-GroupsV314Test-984512547 None] Creating direct copy from snapshot {{(pid=84448) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 15:21:24 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd07e9a8-f5c2-480f-be53-270d3f3ff034]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:21:24 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-dd87bdc7-2946-4a0d-a769-4fb83fa57cd6 tempest-GroupsV314Test-984512547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9660f1f9-1d12-46e7-ac14-655c9138a60b {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:21:24 devstack sudo[101631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9660f1f9-1d12-46e7-ac14-655c9138a60b Apr 29 15:21:24 devstack sudo[101631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:21:25 devstack sudo[101631]: pam_unix(sudo:session): session closed for user root Apr 29 15:21:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-dd87bdc7-2946-4a0d-a769-4fb83fa57cd6 tempest-GroupsV314Test-984512547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9660f1f9-1d12-46e7-ac14-655c9138a60b" returned: 0 in 0.858s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:21:25 devstack cinder-volume[84448]: DEBUG cinder.utils [None req-dd87bdc7-2946-4a0d-a769-4fb83fa57cd6 tempest-GroupsV314Test-984512547 None] Path /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-aa4e3d0f-8116-4bad-8e06-cfb7ef985494 not found in is_blk_device check {{(pid=84448) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 15:21:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-dd87bdc7-2946-4a0d-a769-4fb83fa57cd6 tempest-GroupsV314Test-984512547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9660f1f9-1d12-46e7-ac14-655c9138a60b /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-aa4e3d0f-8116-4bad-8e06-cfb7ef985494 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:21:25 devstack sudo[101636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9660f1f9-1d12-46e7-ac14-655c9138a60b /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-aa4e3d0f-8116-4bad-8e06-cfb7ef985494 Apr 29 15:21:25 devstack sudo[101636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:21:25 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed42ede3-6332-4fbc-a244-01a70512db2c tempest-TestServerVolumeAttachmentScenario-2002744384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:21:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-ed42ede3-6332-4fbc-a244-01a70512db2c tempest-TestServerVolumeAttachmentScenario-2002744384 None] Flow 'volume_create_manager' (7ea0cfe8-5807-4bc5-91a1-2bc05759a68b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:21:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-ed42ede3-6332-4fbc-a244-01a70512db2c tempest-TestServerVolumeAttachmentScenario-2002744384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96d0d14f-dbee-4ef8-a4a6-2ca3447660ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:21:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-ed42ede3-6332-4fbc-a244-01a70512db2c tempest-TestServerVolumeAttachmentScenario-2002744384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96d0d14f-dbee-4ef8-a4a6-2ca3447660ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:21:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1544864057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eababd4-4fa1-4e86-9977-af4c24b43953,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f5797faac4643dbaaf4af0de7fa2ea2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:21:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:21:26Z,use_quota=True,user_id='7992561cc065401496daefac0f0bd9b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:21:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-ed42ede3-6332-4fbc-a244-01a70512db2c tempest-TestServerVolumeAttachmentScenario-2002744384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a613f1f5-a394-4eaa-84b4-61c23d03bf28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:21:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-ed42ede3-6332-4fbc-a244-01a70512db2c tempest-TestServerVolumeAttachmentScenario-2002744384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a613f1f5-a394-4eaa-84b4-61c23d03bf28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:21:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-ed42ede3-6332-4fbc-a244-01a70512db2c tempest-TestServerVolumeAttachmentScenario-2002744384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5554837c-fcb9-423e-8617-029acd8065aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:21:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-ed42ede3-6332-4fbc-a244-01a70512db2c tempest-TestServerVolumeAttachmentScenario-2002744384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5554837c-fcb9-423e-8617-029acd8065aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2eababd4-4fa1-4e86-9977-af4c24b43953', 'volume_name': 'volume-2eababd4-4fa1-4e86-9977-af4c24b43953', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:21:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-ed42ede3-6332-4fbc-a244-01a70512db2c tempest-TestServerVolumeAttachmentScenario-2002744384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72958229-69eb-4fe2-abd7-e51869ead5b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:21:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-ed42ede3-6332-4fbc-a244-01a70512db2c tempest-TestServerVolumeAttachmentScenario-2002744384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72958229-69eb-4fe2-abd7-e51869ead5b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:21:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-ed42ede3-6332-4fbc-a244-01a70512db2c tempest-TestServerVolumeAttachmentScenario-2002744384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8ee35c3-eb85-4ff2-b953-7d0f8ed42462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:21:25 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-ed42ede3-6332-4fbc-a244-01a70512db2c tempest-TestServerVolumeAttachmentScenario-2002744384 None] Volume 2eababd4-4fa1-4e86-9977-af4c24b43953: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2eababd4-4fa1-4e86-9977-af4c24b43953', 'volume_size': 1} Apr 29 15:21:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-ed42ede3-6332-4fbc-a244-01a70512db2c tempest-TestServerVolumeAttachmentScenario-2002744384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:21:26 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbdea564-0382-4395-83d5-30d308c17257 tempest-TestServerVolumeAttachmentScenario-2002744384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:21:26 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-fbdea564-0382-4395-83d5-30d308c17257 tempest-TestServerVolumeAttachmentScenario-2002744384 None] Flow 'volume_create_manager' (d544bfb6-6a6f-4cd5-ae5d-852168666634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:21:26 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-fbdea564-0382-4395-83d5-30d308c17257 tempest-TestServerVolumeAttachmentScenario-2002744384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b2dc893-8811-471a-b3f5-d6e5bcab586d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:21:26 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-fbdea564-0382-4395-83d5-30d308c17257 tempest-TestServerVolumeAttachmentScenario-2002744384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b2dc893-8811-471a-b3f5-d6e5bcab586d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:21:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-594461304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=853deb88-67bd-4dfc-80e0-302a44d30fbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f5797faac4643dbaaf4af0de7fa2ea2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:21:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:21:26Z,use_quota=True,user_id='7992561cc065401496daefac0f0bd9b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:21:26 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-fbdea564-0382-4395-83d5-30d308c17257 tempest-TestServerVolumeAttachmentScenario-2002744384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe571312-1237-4830-8bdf-87fb6f8f691d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:21:26 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-fbdea564-0382-4395-83d5-30d308c17257 tempest-TestServerVolumeAttachmentScenario-2002744384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe571312-1237-4830-8bdf-87fb6f8f691d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:21:26 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-fbdea564-0382-4395-83d5-30d308c17257 tempest-TestServerVolumeAttachmentScenario-2002744384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dd90672-471e-423f-a49d-108162a83c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:21:26 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-fbdea564-0382-4395-83d5-30d308c17257 tempest-TestServerVolumeAttachmentScenario-2002744384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dd90672-471e-423f-a49d-108162a83c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '853deb88-67bd-4dfc-80e0-302a44d30fbf', 'volume_name': 'volume-853deb88-67bd-4dfc-80e0-302a44d30fbf', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:21:26 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-fbdea564-0382-4395-83d5-30d308c17257 tempest-TestServerVolumeAttachmentScenario-2002744384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96b11b88-910e-4599-93e2-da9eb02f4594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:21:26 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-fbdea564-0382-4395-83d5-30d308c17257 tempest-TestServerVolumeAttachmentScenario-2002744384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96b11b88-910e-4599-93e2-da9eb02f4594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:21:26 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-fbdea564-0382-4395-83d5-30d308c17257 tempest-TestServerVolumeAttachmentScenario-2002744384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (687773e9-ccf1-4773-a0e1-ff1cb109de5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:21:26 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-fbdea564-0382-4395-83d5-30d308c17257 tempest-TestServerVolumeAttachmentScenario-2002744384 None] Volume 853deb88-67bd-4dfc-80e0-302a44d30fbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-853deb88-67bd-4dfc-80e0-302a44d30fbf', 'volume_size': 1} Apr 29 15:21:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-fbdea564-0382-4395-83d5-30d308c17257 tempest-TestServerVolumeAttachmentScenario-2002744384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:21:30 devstack cinder-volume[84448]: DEBUG oslo_service.periodic_task [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84448) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 15:21:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:21:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:21:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:21:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:21:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:21:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:21:30 devstack sudo[101738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:21:30 devstack sudo[101738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:21:31 devstack sudo[101738]: pam_unix(sudo:session): session closed for user root Apr 29 15:21:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 1.459s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:21:31 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:21:32 devstack sudo[101636]: pam_unix(sudo:session): session closed for user root Apr 29 15:21:32 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-dd87bdc7-2946-4a0d-a769-4fb83fa57cd6 tempest-GroupsV314Test-984512547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9660f1f9-1d12-46e7-ac14-655c9138a60b /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-aa4e3d0f-8116-4bad-8e06-cfb7ef985494" returned: 0 in 6.926s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:21:32 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d0d7b1-0df2-442c-b745-1edd418faf7d]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:21:32 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-dd87bdc7-2946-4a0d-a769-4fb83fa57cd6 tempest-GroupsV314Test-984512547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9660f1f9-1d12-46e7-ac14-655c9138a60b {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:21:32 devstack sudo[101749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9660f1f9-1d12-46e7-ac14-655c9138a60b Apr 29 15:21:32 devstack sudo[101749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:21:33 devstack sudo[101749]: pam_unix(sudo:session): session closed for user root Apr 29 15:21:33 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-dd87bdc7-2946-4a0d-a769-4fb83fa57cd6 tempest-GroupsV314Test-984512547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9660f1f9-1d12-46e7-ac14-655c9138a60b" returned: 0 in 0.967s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:21:33 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [None req-dd87bdc7-2946-4a0d-a769-4fb83fa57cd6 tempest-GroupsV314Test-984512547 None] Image conversion details: src /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9660f1f9-1d12-46e7-ac14-655c9138a60b, size 1024.00 MB, duration 6.93 sec, destination /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-aa4e3d0f-8116-4bad-8e06-cfb7ef985494 {{(pid=84448) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 15:21:33 devstack cinder-volume[84448]: INFO cinder.image.image_utils [None req-dd87bdc7-2946-4a0d-a769-4fb83fa57cd6 tempest-GroupsV314Test-984512547 None] Converted 1024.00 MB image at 147.82 MB/s Apr 29 15:21:33 devstack cinder-volume[84448]: WARNING cinder.volume.drivers.remotefs [None req-dd87bdc7-2946-4a0d-a769-4fb83fa57cd6 tempest-GroupsV314Test-984512547 None] /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-aa4e3d0f-8116-4bad-8e06-cfb7ef985494 is being set with open permissions: ugo+rw: NotImplementedError Apr 29 15:21:33 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-dd87bdc7-2946-4a0d-a769-4fb83fa57cd6 tempest-GroupsV314Test-984512547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-aa4e3d0f-8116-4bad-8e06-cfb7ef985494 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:21:33 devstack sudo[101755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-aa4e3d0f-8116-4bad-8e06-cfb7ef985494 Apr 29 15:21:33 devstack sudo[101755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:21:34 devstack sudo[101755]: pam_unix(sudo:session): session closed for user root Apr 29 15:21:34 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-dd87bdc7-2946-4a0d-a769-4fb83fa57cd6 tempest-GroupsV314Test-984512547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-aa4e3d0f-8116-4bad-8e06-cfb7ef985494" returned: 0 in 0.681s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:21:34 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-dd87bdc7-2946-4a0d-a769-4fb83fa57cd6 tempest-GroupsV314Test-984512547 None] Lock "cinder-quobyte-aa4e3d0f-8116-4bad-8e06-cfb7ef985494" released by "_copy_volume_from_snapshot" :: held 10.404s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:21:34 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-dd87bdc7-2946-4a0d-a769-4fb83fa57cd6 tempest-GroupsV314Test-984512547 None] Acquiring lock "cinder-quobyte-71f577e7-6ab4-40b1-8edb-c26f1192d2cb" by "_delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:21:34 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-dd87bdc7-2946-4a0d-a769-4fb83fa57cd6 tempest-GroupsV314Test-984512547 None] Lock "cinder-quobyte-71f577e7-6ab4-40b1-8edb-c26f1192d2cb" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:21:34 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-dd87bdc7-2946-4a0d-a769-4fb83fa57cd6 tempest-GroupsV314Test-984512547 None] Deleting offline snapshot 71f577e7-6ab4-40b1-8edb-c26f1192d2cb of volume 9660f1f9-1d12-46e7-ac14-655c9138a60b {{(pid=84448) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 15:21:34 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-dd87bdc7-2946-4a0d-a769-4fb83fa57cd6 tempest-GroupsV314Test-984512547 None] snapshot_file for this snap is: volume-9660f1f9-1d12-46e7-ac14-655c9138a60b.71f577e7-6ab4-40b1-8edb-c26f1192d2cb {{(pid=84448) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 15:21:34 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[396ac488-4c01-4a5d-a37e-e06c15c1cde4]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:21:34 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-dd87bdc7-2946-4a0d-a769-4fb83fa57cd6 tempest-GroupsV314Test-984512547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9660f1f9-1d12-46e7-ac14-655c9138a60b.71f577e7-6ab4-40b1-8edb-c26f1192d2cb {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:21:34 devstack sudo[101775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9660f1f9-1d12-46e7-ac14-655c9138a60b.71f577e7-6ab4-40b1-8edb-c26f1192d2cb Apr 29 15:21:34 devstack sudo[101775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:21:34 devstack sudo[101775]: pam_unix(sudo:session): session closed for user root Apr 29 15:21:34 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-dd87bdc7-2946-4a0d-a769-4fb83fa57cd6 tempest-GroupsV314Test-984512547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9660f1f9-1d12-46e7-ac14-655c9138a60b.71f577e7-6ab4-40b1-8edb-c26f1192d2cb" returned: 0 in 0.802s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:21:34 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-dd87bdc7-2946-4a0d-a769-4fb83fa57cd6 tempest-GroupsV314Test-984512547 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9660f1f9-1d12-46e7-ac14-655c9138a60b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84448) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 15:21:34 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b240ea8-4ab1-42ea-9392-7a50cfaf6da6]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:21:34 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-dd87bdc7-2946-4a0d-a769-4fb83fa57cd6 tempest-GroupsV314Test-984512547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9660f1f9-1d12-46e7-ac14-655c9138a60b {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:21:35 devstack sudo[101788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9660f1f9-1d12-46e7-ac14-655c9138a60b Apr 29 15:21:35 devstack sudo[101788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:21:35 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-9fdd2754-56af-47b9-ad55-981029af8e28 tempest-AttachVolumeTestJSON-1394496241 None] Acquiring lock "cinder-d15a381b-081c-4f08-9782-b95843cc2e2a-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:21:35 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-9fdd2754-56af-47b9-ad55-981029af8e28 tempest-AttachVolumeTestJSON-1394496241 None] Lock "cinder-d15a381b-081c-4f08-9782-b95843cc2e2a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:21:35 devstack sudo[101788]: pam_unix(sudo:session): session closed for user root Apr 29 15:21:35 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-dd87bdc7-2946-4a0d-a769-4fb83fa57cd6 tempest-GroupsV314Test-984512547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9660f1f9-1d12-46e7-ac14-655c9138a60b" returned: 0 in 0.831s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:21:35 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-dd87bdc7-2946-4a0d-a769-4fb83fa57cd6 tempest-GroupsV314Test-984512547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9660f1f9-1d12-46e7-ac14-655c9138a60b.71f577e7-6ab4-40b1-8edb-c26f1192d2cb {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:21:35 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-9fdd2754-56af-47b9-ad55-981029af8e28 tempest-AttachVolumeTestJSON-1394496241 None] Acquiring lock "cinder-quobyte-d15a381b-081c-4f08-9782-b95843cc2e2a" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:21:35 devstack sudo[101795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9660f1f9-1d12-46e7-ac14-655c9138a60b.71f577e7-6ab4-40b1-8edb-c26f1192d2cb Apr 29 15:21:35 devstack sudo[101795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:21:35 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-9fdd2754-56af-47b9-ad55-981029af8e28 tempest-AttachVolumeTestJSON-1394496241 None] Lock "cinder-quobyte-d15a381b-081c-4f08-9782-b95843cc2e2a" acquired by "delete_volume" :: waited 0.024s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:21:35 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec36476d-b8bd-48a4-9dd9-3902c95138ac]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:21:35 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-9fdd2754-56af-47b9-ad55-981029af8e28 tempest-AttachVolumeTestJSON-1394496241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d15a381b-081c-4f08-9782-b95843cc2e2a {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:21:36 devstack sudo[101797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d15a381b-081c-4f08-9782-b95843cc2e2a Apr 29 15:21:36 devstack sudo[101797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:21:36 devstack sudo[101795]: pam_unix(sudo:session): session closed for user root Apr 29 15:21:36 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-dd87bdc7-2946-4a0d-a769-4fb83fa57cd6 tempest-GroupsV314Test-984512547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9660f1f9-1d12-46e7-ac14-655c9138a60b.71f577e7-6ab4-40b1-8edb-c26f1192d2cb" returned: 0 in 0.713s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:21:36 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-dd87bdc7-2946-4a0d-a769-4fb83fa57cd6 tempest-GroupsV314Test-984512547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9660f1f9-1d12-46e7-ac14-655c9138a60b.71f577e7-6ab4-40b1-8edb-c26f1192d2cb {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:21:36 devstack sudo[101802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9660f1f9-1d12-46e7-ac14-655c9138a60b.71f577e7-6ab4-40b1-8edb-c26f1192d2cb Apr 29 15:21:36 devstack sudo[101802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:21:36 devstack sudo[101797]: pam_unix(sudo:session): session closed for user root Apr 29 15:21:36 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-9fdd2754-56af-47b9-ad55-981029af8e28 tempest-AttachVolumeTestJSON-1394496241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d15a381b-081c-4f08-9782-b95843cc2e2a" returned: 0 in 0.794s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:21:36 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-9fdd2754-56af-47b9-ad55-981029af8e28 tempest-AttachVolumeTestJSON-1394496241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d15a381b-081c-4f08-9782-b95843cc2e2a {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:21:36 devstack sudo[101807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d15a381b-081c-4f08-9782-b95843cc2e2a Apr 29 15:21:36 devstack sudo[101807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:21:37 devstack sudo[101802]: pam_unix(sudo:session): session closed for user root Apr 29 15:21:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-dd87bdc7-2946-4a0d-a769-4fb83fa57cd6 tempest-GroupsV314Test-984512547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9660f1f9-1d12-46e7-ac14-655c9138a60b.71f577e7-6ab4-40b1-8edb-c26f1192d2cb" returned: 0 in 0.634s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:21:37 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-dd87bdc7-2946-4a0d-a769-4fb83fa57cd6 tempest-GroupsV314Test-984512547 None] Lock "cinder-quobyte-71f577e7-6ab4-40b1-8edb-c26f1192d2cb" released by "_delete_snapshot" :: held 3.093s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:21:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-dd87bdc7-2946-4a0d-a769-4fb83fa57cd6 tempest-GroupsV314Test-984512547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.489s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:21:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-ed42ede3-6332-4fbc-a244-01a70512db2c tempest-TestServerVolumeAttachmentScenario-2002744384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.241s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:21:37 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-ed42ede3-6332-4fbc-a244-01a70512db2c tempest-TestServerVolumeAttachmentScenario-2002744384 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:21:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1544864057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eababd4-4fa1-4e86-9977-af4c24b43953,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f5797faac4643dbaaf4af0de7fa2ea2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:21:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:21:26Z,use_quota=True,user_id='7992561cc065401496daefac0f0bd9b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:21:37 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-ed42ede3-6332-4fbc-a244-01a70512db2c tempest-TestServerVolumeAttachmentScenario-2002744384 None] Creating volume 2eababd4-4fa1-4e86-9977-af4c24b43953 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:21:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-ed42ede3-6332-4fbc-a244-01a70512db2c tempest-TestServerVolumeAttachmentScenario-2002744384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:21:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-ed42ede3-6332-4fbc-a244-01a70512db2c tempest-TestServerVolumeAttachmentScenario-2002744384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:21:37 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-ed42ede3-6332-4fbc-a244-01a70512db2c tempest-TestServerVolumeAttachmentScenario-2002744384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:21:37 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-ed42ede3-6332-4fbc-a244-01a70512db2c tempest-TestServerVolumeAttachmentScenario-2002744384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:21:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-ed42ede3-6332-4fbc-a244-01a70512db2c tempest-TestServerVolumeAttachmentScenario-2002744384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:21:37 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-ed42ede3-6332-4fbc-a244-01a70512db2c tempest-TestServerVolumeAttachmentScenario-2002744384 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:21:37 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-ed42ede3-6332-4fbc-a244-01a70512db2c tempest-TestServerVolumeAttachmentScenario-2002744384 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:21:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ed42ede3-6332-4fbc-a244-01a70512db2c tempest-TestServerVolumeAttachmentScenario-2002744384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2eababd4-4fa1-4e86-9977-af4c24b43953 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:21:37 devstack sudo[101811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2eababd4-4fa1-4e86-9977-af4c24b43953 1073741824 Apr 29 15:21:37 devstack sudo[101811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:21:37 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-dd87bdc7-2946-4a0d-a769-4fb83fa57cd6 tempest-GroupsV314Test-984512547 None] Create group from source-group-6cfffdde-8772-4076-9363-2e2af032f6a4 completed successfully. Apr 29 15:21:37 devstack sudo[101807]: pam_unix(sudo:session): session closed for user root Apr 29 15:21:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-9fdd2754-56af-47b9-ad55-981029af8e28 tempest-AttachVolumeTestJSON-1394496241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d15a381b-081c-4f08-9782-b95843cc2e2a" returned: 0 in 0.675s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:21:37 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-9fdd2754-56af-47b9-ad55-981029af8e28 tempest-AttachVolumeTestJSON-1394496241 None] Lock "cinder-quobyte-d15a381b-081c-4f08-9782-b95843cc2e2a" released by "delete_volume" :: held 1.519s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:21:37 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-9fdd2754-56af-47b9-ad55-981029af8e28 tempest-AttachVolumeTestJSON-1394496241 None] Created reservations ['a09274e8-68a4-4a4f-8671-daae0d15e16f', '019bb089-c6f3-48ac-9edb-9111c6849bb2', 'f0ef96c2-3017-482e-a8ea-9b63d868a338', '7bb2afd3-bea0-4925-b33b-9cc0ea6ece89'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:21:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-9fdd2754-56af-47b9-ad55-981029af8e28 tempest-AttachVolumeTestJSON-1394496241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:21:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-9fdd2754-56af-47b9-ad55-981029af8e28 tempest-AttachVolumeTestJSON-1394496241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:21:37 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-9fdd2754-56af-47b9-ad55-981029af8e28 tempest-AttachVolumeTestJSON-1394496241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:21:37 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-9fdd2754-56af-47b9-ad55-981029af8e28 tempest-AttachVolumeTestJSON-1394496241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:21:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-9fdd2754-56af-47b9-ad55-981029af8e28 tempest-AttachVolumeTestJSON-1394496241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:21:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-9fdd2754-56af-47b9-ad55-981029af8e28 tempest-AttachVolumeTestJSON-1394496241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:21:37 devstack sudo[101813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:21:37 devstack sudo[101813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:21:37 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-bb8e5bb6-2d99-455d-b836-dfa33c550261 tempest-AttachVolumeTestJSON-1394496241 None] Acquiring lock "cinder-6082c3e6-83e0-4151-91a9-00eec55778d6-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:21:38 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-bb8e5bb6-2d99-455d-b836-dfa33c550261 tempest-AttachVolumeTestJSON-1394496241 None] Lock "cinder-6082c3e6-83e0-4151-91a9-00eec55778d6-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:21:38 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-bb8e5bb6-2d99-455d-b836-dfa33c550261 tempest-AttachVolumeTestJSON-1394496241 None] Acquiring lock "cinder-quobyte-6082c3e6-83e0-4151-91a9-00eec55778d6" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:21:38 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-bb8e5bb6-2d99-455d-b836-dfa33c550261 tempest-AttachVolumeTestJSON-1394496241 None] Lock "cinder-quobyte-6082c3e6-83e0-4151-91a9-00eec55778d6" acquired by "delete_volume" :: waited 0.020s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:21:38 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb5adfd-976d-428a-b6d3-78196eaa778e]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:21:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-bb8e5bb6-2d99-455d-b836-dfa33c550261 tempest-AttachVolumeTestJSON-1394496241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-6082c3e6-83e0-4151-91a9-00eec55778d6 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:21:38 devstack sudo[101811]: pam_unix(sudo:session): session closed for user root Apr 29 15:21:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ed42ede3-6332-4fbc-a244-01a70512db2c tempest-TestServerVolumeAttachmentScenario-2002744384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2eababd4-4fa1-4e86-9977-af4c24b43953 1073741824" returned: 0 in 0.958s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:21:38 devstack sudo[101813]: pam_unix(sudo:session): session closed for user root Apr 29 15:21:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ed42ede3-6332-4fbc-a244-01a70512db2c tempest-TestServerVolumeAttachmentScenario-2002744384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2eababd4-4fa1-4e86-9977-af4c24b43953 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:21:38 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-d5613fec-6f27-43b5-8fff-d152b1c23cc2 tempest-GroupsV314Test-984512547 None] Acquiring lock "cinder-quobyte-aa4e3d0f-8116-4bad-8e06-cfb7ef985494" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:21:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-9fdd2754-56af-47b9-ad55-981029af8e28 tempest-AttachVolumeTestJSON-1394496241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.776s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:21:38 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-9fdd2754-56af-47b9-ad55-981029af8e28 tempest-AttachVolumeTestJSON-1394496241 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:21:38 devstack sudo[101820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2eababd4-4fa1-4e86-9977-af4c24b43953 Apr 29 15:21:38 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-9fdd2754-56af-47b9-ad55-981029af8e28 tempest-AttachVolumeTestJSON-1394496241 None] Deleted volume successfully. Apr 29 15:21:38 devstack sudo[101820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:21:38 devstack sudo[101819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-6082c3e6-83e0-4151-91a9-00eec55778d6 Apr 29 15:21:38 devstack sudo[101819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:21:38 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-d5613fec-6f27-43b5-8fff-d152b1c23cc2 tempest-GroupsV314Test-984512547 None] Lock "cinder-quobyte-aa4e3d0f-8116-4bad-8e06-cfb7ef985494" acquired by "delete_volume" :: waited 0.043s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:21:38 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-9fdd2754-56af-47b9-ad55-981029af8e28 tempest-AttachVolumeTestJSON-1394496241 None] Lock "cinder-d15a381b-081c-4f08-9782-b95843cc2e2a-delete_volume" released by "delete_volume" :: held 2.598s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:21:38 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91c919d-db88-43c2-a878-9aaec168abea]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:21:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-d5613fec-6f27-43b5-8fff-d152b1c23cc2 tempest-GroupsV314Test-984512547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-aa4e3d0f-8116-4bad-8e06-cfb7ef985494 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:21:38 devstack sudo[101823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-aa4e3d0f-8116-4bad-8e06-cfb7ef985494 Apr 29 15:21:38 devstack sudo[101823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:21:38 devstack sudo[101819]: pam_unix(sudo:session): session closed for user root Apr 29 15:21:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-bb8e5bb6-2d99-455d-b836-dfa33c550261 tempest-AttachVolumeTestJSON-1394496241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-6082c3e6-83e0-4151-91a9-00eec55778d6" returned: 0 in 0.770s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:21:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-bb8e5bb6-2d99-455d-b836-dfa33c550261 tempest-AttachVolumeTestJSON-1394496241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-6082c3e6-83e0-4151-91a9-00eec55778d6 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:21:38 devstack sudo[101820]: pam_unix(sudo:session): session closed for user root Apr 29 15:21:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ed42ede3-6332-4fbc-a244-01a70512db2c tempest-TestServerVolumeAttachmentScenario-2002744384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2eababd4-4fa1-4e86-9977-af4c24b43953" returned: 0 in 0.698s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:21:38 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-ed42ede3-6332-4fbc-a244-01a70512db2c tempest-TestServerVolumeAttachmentScenario-2002744384 None] <== create_volume: return (1714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:21:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-ed42ede3-6332-4fbc-a244-01a70512db2c tempest-TestServerVolumeAttachmentScenario-2002744384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.718s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:21:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-fbdea564-0382-4395-83d5-30d308c17257 tempest-TestServerVolumeAttachmentScenario-2002744384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.650s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:21:38 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-fbdea564-0382-4395-83d5-30d308c17257 tempest-TestServerVolumeAttachmentScenario-2002744384 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:21:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-594461304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=853deb88-67bd-4dfc-80e0-302a44d30fbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f5797faac4643dbaaf4af0de7fa2ea2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:21:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:21:26Z,use_quota=True,user_id='7992561cc065401496daefac0f0bd9b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:21:38 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-fbdea564-0382-4395-83d5-30d308c17257 tempest-TestServerVolumeAttachmentScenario-2002744384 None] Creating volume 853deb88-67bd-4dfc-80e0-302a44d30fbf {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:21:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-fbdea564-0382-4395-83d5-30d308c17257 tempest-TestServerVolumeAttachmentScenario-2002744384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:21:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-fbdea564-0382-4395-83d5-30d308c17257 tempest-TestServerVolumeAttachmentScenario-2002744384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:21:38 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-fbdea564-0382-4395-83d5-30d308c17257 tempest-TestServerVolumeAttachmentScenario-2002744384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:21:38 devstack sudo[101829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-6082c3e6-83e0-4151-91a9-00eec55778d6 Apr 29 15:21:38 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-fbdea564-0382-4395-83d5-30d308c17257 tempest-TestServerVolumeAttachmentScenario-2002744384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:21:38 devstack sudo[101829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:21:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-fbdea564-0382-4395-83d5-30d308c17257 tempest-TestServerVolumeAttachmentScenario-2002744384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:21:38 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-fbdea564-0382-4395-83d5-30d308c17257 tempest-TestServerVolumeAttachmentScenario-2002744384 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:21:38 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-fbdea564-0382-4395-83d5-30d308c17257 tempest-TestServerVolumeAttachmentScenario-2002744384 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:21:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-fbdea564-0382-4395-83d5-30d308c17257 tempest-TestServerVolumeAttachmentScenario-2002744384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-853deb88-67bd-4dfc-80e0-302a44d30fbf 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:21:38 devstack sudo[101833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-853deb88-67bd-4dfc-80e0-302a44d30fbf 1073741824 Apr 29 15:21:39 devstack sudo[101833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:21:39 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-ed42ede3-6332-4fbc-a244-01a70512db2c tempest-TestServerVolumeAttachmentScenario-2002744384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8ee35c3-eb85-4ff2-b953-7d0f8ed42462) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2eababd4-4fa1-4e86-9977-af4c24b43953', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:21:39 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-ed42ede3-6332-4fbc-a244-01a70512db2c tempest-TestServerVolumeAttachmentScenario-2002744384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03bb0185-18f6-4450-8bfd-095a67dabff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:21:39 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-ed42ede3-6332-4fbc-a244-01a70512db2c tempest-TestServerVolumeAttachmentScenario-2002744384 None] Volume volume-2eababd4-4fa1-4e86-9977-af4c24b43953 (2eababd4-4fa1-4e86-9977-af4c24b43953): created successfully Apr 29 15:21:39 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-ed42ede3-6332-4fbc-a244-01a70512db2c tempest-TestServerVolumeAttachmentScenario-2002744384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03bb0185-18f6-4450-8bfd-095a67dabff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:21:39 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-ed42ede3-6332-4fbc-a244-01a70512db2c tempest-TestServerVolumeAttachmentScenario-2002744384 None] Flow 'volume_create_manager' (7ea0cfe8-5807-4bc5-91a1-2bc05759a68b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:21:39 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-ed42ede3-6332-4fbc-a244-01a70512db2c tempest-TestServerVolumeAttachmentScenario-2002744384 None] Created volume successfully. Apr 29 15:21:39 devstack sudo[101823]: pam_unix(sudo:session): session closed for user root Apr 29 15:21:39 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-d5613fec-6f27-43b5-8fff-d152b1c23cc2 tempest-GroupsV314Test-984512547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-aa4e3d0f-8116-4bad-8e06-cfb7ef985494" returned: 0 in 0.802s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:21:39 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-d5613fec-6f27-43b5-8fff-d152b1c23cc2 tempest-GroupsV314Test-984512547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-aa4e3d0f-8116-4bad-8e06-cfb7ef985494 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:21:39 devstack sudo[101836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-aa4e3d0f-8116-4bad-8e06-cfb7ef985494 Apr 29 15:21:39 devstack sudo[101836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:21:39 devstack sudo[101829]: pam_unix(sudo:session): session closed for user root Apr 29 15:21:39 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-bb8e5bb6-2d99-455d-b836-dfa33c550261 tempest-AttachVolumeTestJSON-1394496241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-6082c3e6-83e0-4151-91a9-00eec55778d6" returned: 0 in 0.753s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:21:39 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-bb8e5bb6-2d99-455d-b836-dfa33c550261 tempest-AttachVolumeTestJSON-1394496241 None] Lock "cinder-quobyte-6082c3e6-83e0-4151-91a9-00eec55778d6" released by "delete_volume" :: held 1.611s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:21:39 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-bb8e5bb6-2d99-455d-b836-dfa33c550261 tempest-AttachVolumeTestJSON-1394496241 None] Created reservations ['59ebf2d5-fbd0-4633-9894-170d89cda920', 'f007d004-3936-451e-b2c6-6b6c18cbdbe9', '75aee69e-b804-48f0-afe0-da57a14e0ffb', 'fb66534d-88db-4a9e-a8fc-f476b65b29bb'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:21:39 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-bb8e5bb6-2d99-455d-b836-dfa33c550261 tempest-AttachVolumeTestJSON-1394496241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:21:39 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-bb8e5bb6-2d99-455d-b836-dfa33c550261 tempest-AttachVolumeTestJSON-1394496241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:21:39 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-bb8e5bb6-2d99-455d-b836-dfa33c550261 tempest-AttachVolumeTestJSON-1394496241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:21:39 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-bb8e5bb6-2d99-455d-b836-dfa33c550261 tempest-AttachVolumeTestJSON-1394496241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:21:39 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-bb8e5bb6-2d99-455d-b836-dfa33c550261 tempest-AttachVolumeTestJSON-1394496241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:21:39 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-bb8e5bb6-2d99-455d-b836-dfa33c550261 tempest-AttachVolumeTestJSON-1394496241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:21:39 devstack sudo[101843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:21:39 devstack sudo[101843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:21:39 devstack sudo[101833]: pam_unix(sudo:session): session closed for user root Apr 29 15:21:39 devstack sudo[101836]: pam_unix(sudo:session): session closed for user root Apr 29 15:21:39 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-fbdea564-0382-4395-83d5-30d308c17257 tempest-TestServerVolumeAttachmentScenario-2002744384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-853deb88-67bd-4dfc-80e0-302a44d30fbf 1073741824" returned: 0 in 1.009s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:21:39 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-d5613fec-6f27-43b5-8fff-d152b1c23cc2 tempest-GroupsV314Test-984512547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-aa4e3d0f-8116-4bad-8e06-cfb7ef985494" returned: 0 in 0.818s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:21:40 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-d5613fec-6f27-43b5-8fff-d152b1c23cc2 tempest-GroupsV314Test-984512547 None] Lock "cinder-quobyte-aa4e3d0f-8116-4bad-8e06-cfb7ef985494" released by "delete_volume" :: held 1.694s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:21:40 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-fbdea564-0382-4395-83d5-30d308c17257 tempest-TestServerVolumeAttachmentScenario-2002744384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-853deb88-67bd-4dfc-80e0-302a44d30fbf {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:21:40 devstack sudo[101846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-853deb88-67bd-4dfc-80e0-302a44d30fbf Apr 29 15:21:40 devstack sudo[101846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:21:40 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-d5613fec-6f27-43b5-8fff-d152b1c23cc2 tempest-GroupsV314Test-984512547 None] Created reservations ['8bd9897f-8cad-43a3-8ae9-64ca13ed45f2'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:21:40 devstack cinder-volume[84448]: WARNING cinder.quota [None req-d5613fec-6f27-43b5-8fff-d152b1c23cc2 tempest-GroupsV314Test-984512547 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1411156632 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1411156632, it is now deprecated. Please use the default quota class for default quota. Apr 29 15:21:40 devstack cinder-volume[84448]: WARNING cinder.quota [None req-d5613fec-6f27-43b5-8fff-d152b1c23cc2 tempest-GroupsV314Test-984512547 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1411156632 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1411156632, it is now deprecated. Please use the default quota class for default quota. Apr 29 15:21:40 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-d5613fec-6f27-43b5-8fff-d152b1c23cc2 tempest-GroupsV314Test-984512547 None] Created reservations ['7dc0b26e-2cdc-4bf7-8c8d-16b328bc45cf', '40029859-21ea-48ca-9f87-c00f76d65ac2', '6b5356be-6387-442b-b68a-05aaa006f883', '7b1a00dd-be8d-422d-8dcb-021038ec2c70'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:21:40 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-d5613fec-6f27-43b5-8fff-d152b1c23cc2 tempest-GroupsV314Test-984512547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:21:40 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-d5613fec-6f27-43b5-8fff-d152b1c23cc2 tempest-GroupsV314Test-984512547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:21:40 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-d5613fec-6f27-43b5-8fff-d152b1c23cc2 tempest-GroupsV314Test-984512547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:21:40 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-d5613fec-6f27-43b5-8fff-d152b1c23cc2 tempest-GroupsV314Test-984512547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:21:40 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-d5613fec-6f27-43b5-8fff-d152b1c23cc2 tempest-GroupsV314Test-984512547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:21:40 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-d5613fec-6f27-43b5-8fff-d152b1c23cc2 tempest-GroupsV314Test-984512547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:21:40 devstack sudo[101848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:21:40 devstack sudo[101848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:21:40 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-082c9d31-3ebd-471d-ab89-a671ef64c426 tempest-AttachVolumeTestJSON-1394496241 None] Acquiring lock "cinder-bf511176-359d-4e94-80d1-a4a3dbb97949-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:21:40 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-082c9d31-3ebd-471d-ab89-a671ef64c426 tempest-AttachVolumeTestJSON-1394496241 None] Lock "cinder-bf511176-359d-4e94-80d1-a4a3dbb97949-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:21:40 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-082c9d31-3ebd-471d-ab89-a671ef64c426 tempest-AttachVolumeTestJSON-1394496241 None] Acquiring lock "cinder-quobyte-bf511176-359d-4e94-80d1-a4a3dbb97949" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:21:40 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-082c9d31-3ebd-471d-ab89-a671ef64c426 tempest-AttachVolumeTestJSON-1394496241 None] Lock "cinder-quobyte-bf511176-359d-4e94-80d1-a4a3dbb97949" acquired by "delete_volume" :: waited 0.024s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:21:40 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa3d5cf-b0ef-4ea3-a100-0ca87a2052d1]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:21:40 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-082c9d31-3ebd-471d-ab89-a671ef64c426 tempest-AttachVolumeTestJSON-1394496241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-bf511176-359d-4e94-80d1-a4a3dbb97949 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:21:40 devstack sudo[101843]: pam_unix(sudo:session): session closed for user root Apr 29 15:21:40 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-bb8e5bb6-2d99-455d-b836-dfa33c550261 tempest-AttachVolumeTestJSON-1394496241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.752s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:21:40 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-bb8e5bb6-2d99-455d-b836-dfa33c550261 tempest-AttachVolumeTestJSON-1394496241 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:21:40 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-bb8e5bb6-2d99-455d-b836-dfa33c550261 tempest-AttachVolumeTestJSON-1394496241 None] Deleted volume successfully. Apr 29 15:21:40 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-bb8e5bb6-2d99-455d-b836-dfa33c550261 tempest-AttachVolumeTestJSON-1394496241 None] Lock "cinder-6082c3e6-83e0-4151-91a9-00eec55778d6-delete_volume" released by "delete_volume" :: held 2.656s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:21:40 devstack sudo[101851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-bf511176-359d-4e94-80d1-a4a3dbb97949 Apr 29 15:21:40 devstack sudo[101851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:21:40 devstack sudo[101846]: pam_unix(sudo:session): session closed for user root Apr 29 15:21:40 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-fbdea564-0382-4395-83d5-30d308c17257 tempest-TestServerVolumeAttachmentScenario-2002744384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-853deb88-67bd-4dfc-80e0-302a44d30fbf" returned: 0 in 0.841s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:21:40 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-fbdea564-0382-4395-83d5-30d308c17257 tempest-TestServerVolumeAttachmentScenario-2002744384 None] <== create_volume: return (1923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:21:40 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-fbdea564-0382-4395-83d5-30d308c17257 tempest-TestServerVolumeAttachmentScenario-2002744384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.927s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:21:40 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-fbdea564-0382-4395-83d5-30d308c17257 tempest-TestServerVolumeAttachmentScenario-2002744384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (687773e9-ccf1-4773-a0e1-ff1cb109de5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-853deb88-67bd-4dfc-80e0-302a44d30fbf', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:21:40 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-fbdea564-0382-4395-83d5-30d308c17257 tempest-TestServerVolumeAttachmentScenario-2002744384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89a82ef0-a7c5-40b6-af95-6a8aa2ed1378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:21:40 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-fd5de057-423d-4781-abb2-86a6462065ea tempest-GroupsV314Test-984512547 None] Acquiring lock "cinder-quobyte-9660f1f9-1d12-46e7-ac14-655c9138a60b" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:21:40 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-fbdea564-0382-4395-83d5-30d308c17257 tempest-TestServerVolumeAttachmentScenario-2002744384 None] Volume volume-853deb88-67bd-4dfc-80e0-302a44d30fbf (853deb88-67bd-4dfc-80e0-302a44d30fbf): created successfully Apr 29 15:21:40 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-fbdea564-0382-4395-83d5-30d308c17257 tempest-TestServerVolumeAttachmentScenario-2002744384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89a82ef0-a7c5-40b6-af95-6a8aa2ed1378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:21:40 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-fbdea564-0382-4395-83d5-30d308c17257 tempest-TestServerVolumeAttachmentScenario-2002744384 None] Flow 'volume_create_manager' (d544bfb6-6a6f-4cd5-ae5d-852168666634) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:21:40 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-fbdea564-0382-4395-83d5-30d308c17257 tempest-TestServerVolumeAttachmentScenario-2002744384 None] Created volume successfully. Apr 29 15:21:41 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-fd5de057-423d-4781-abb2-86a6462065ea tempest-GroupsV314Test-984512547 None] Lock "cinder-quobyte-9660f1f9-1d12-46e7-ac14-655c9138a60b" acquired by "delete_volume" :: waited 0.047s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:21:41 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba4a642-4ca8-434f-a150-dbdeecc8a7bb]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:21:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-fd5de057-423d-4781-abb2-86a6462065ea tempest-GroupsV314Test-984512547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9660f1f9-1d12-46e7-ac14-655c9138a60b {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:21:41 devstack sudo[101848]: pam_unix(sudo:session): session closed for user root Apr 29 15:21:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-d5613fec-6f27-43b5-8fff-d152b1c23cc2 tempest-GroupsV314Test-984512547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.803s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:21:41 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-d5613fec-6f27-43b5-8fff-d152b1c23cc2 tempest-GroupsV314Test-984512547 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:21:41 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-d5613fec-6f27-43b5-8fff-d152b1c23cc2 tempest-GroupsV314Test-984512547 None] Delete group completed successfully. Apr 29 15:21:41 devstack sudo[101855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9660f1f9-1d12-46e7-ac14-655c9138a60b Apr 29 15:21:41 devstack sudo[101855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:21:41 devstack sudo[101851]: pam_unix(sudo:session): session closed for user root Apr 29 15:21:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-082c9d31-3ebd-471d-ab89-a671ef64c426 tempest-AttachVolumeTestJSON-1394496241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-bf511176-359d-4e94-80d1-a4a3dbb97949" returned: 0 in 0.859s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:21:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-082c9d31-3ebd-471d-ab89-a671ef64c426 tempest-AttachVolumeTestJSON-1394496241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-bf511176-359d-4e94-80d1-a4a3dbb97949 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:21:41 devstack sudo[101860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-bf511176-359d-4e94-80d1-a4a3dbb97949 Apr 29 15:21:41 devstack sudo[101860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:21:41 devstack sudo[101855]: pam_unix(sudo:session): session closed for user root Apr 29 15:21:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-fd5de057-423d-4781-abb2-86a6462065ea tempest-GroupsV314Test-984512547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9660f1f9-1d12-46e7-ac14-655c9138a60b" returned: 0 in 0.888s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:21:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-fd5de057-423d-4781-abb2-86a6462065ea tempest-GroupsV314Test-984512547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9660f1f9-1d12-46e7-ac14-655c9138a60b {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:21:41 devstack sudo[101866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9660f1f9-1d12-46e7-ac14-655c9138a60b Apr 29 15:21:41 devstack sudo[101866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:21:42 devstack sudo[101860]: pam_unix(sudo:session): session closed for user root Apr 29 15:21:42 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-082c9d31-3ebd-471d-ab89-a671ef64c426 tempest-AttachVolumeTestJSON-1394496241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-bf511176-359d-4e94-80d1-a4a3dbb97949" returned: 0 in 0.860s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:21:42 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-082c9d31-3ebd-471d-ab89-a671ef64c426 tempest-AttachVolumeTestJSON-1394496241 None] Lock "cinder-quobyte-bf511176-359d-4e94-80d1-a4a3dbb97949" released by "delete_volume" :: held 1.796s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:21:42 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-082c9d31-3ebd-471d-ab89-a671ef64c426 tempest-AttachVolumeTestJSON-1394496241 None] Created reservations ['1ee233fc-deed-4272-997a-2f0f1541eeca', 'cf4f0b7d-ff63-4a63-880d-c5501b124865', '6db60a47-8470-46ca-842c-bbcdb4fb1800', 'ea0a29b7-a87d-4c42-9599-fa58ab1d70ca'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:21:42 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-082c9d31-3ebd-471d-ab89-a671ef64c426 tempest-AttachVolumeTestJSON-1394496241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:21:42 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-082c9d31-3ebd-471d-ab89-a671ef64c426 tempest-AttachVolumeTestJSON-1394496241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:21:42 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-082c9d31-3ebd-471d-ab89-a671ef64c426 tempest-AttachVolumeTestJSON-1394496241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:21:42 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-082c9d31-3ebd-471d-ab89-a671ef64c426 tempest-AttachVolumeTestJSON-1394496241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:21:42 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-082c9d31-3ebd-471d-ab89-a671ef64c426 tempest-AttachVolumeTestJSON-1394496241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:21:42 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-082c9d31-3ebd-471d-ab89-a671ef64c426 tempest-AttachVolumeTestJSON-1394496241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:21:42 devstack sudo[101871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:21:42 devstack sudo[101871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:21:42 devstack sudo[101866]: pam_unix(sudo:session): session closed for user root Apr 29 15:21:42 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-fd5de057-423d-4781-abb2-86a6462065ea tempest-GroupsV314Test-984512547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9660f1f9-1d12-46e7-ac14-655c9138a60b" returned: 0 in 0.806s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:21:42 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-fd5de057-423d-4781-abb2-86a6462065ea tempest-GroupsV314Test-984512547 None] Lock "cinder-quobyte-9660f1f9-1d12-46e7-ac14-655c9138a60b" released by "delete_volume" :: held 1.782s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:21:42 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-fd5de057-423d-4781-abb2-86a6462065ea tempest-GroupsV314Test-984512547 None] Created reservations ['2c2a2e3a-6cee-42d6-9387-d7ceb0b69a97'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:21:42 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-fd5de057-423d-4781-abb2-86a6462065ea tempest-GroupsV314Test-984512547 None] Created reservations ['692161a2-1b03-4418-a0b5-2975e5951b60', '1496bbd5-c584-4542-90e0-87eaeee56dda', '952f5e7b-d2dd-4544-b646-5b4b305b4e3d', '3129781b-f2a6-4ad8-bdaa-43ec69c4f1e2'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:21:43 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-fd5de057-423d-4781-abb2-86a6462065ea tempest-GroupsV314Test-984512547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:21:43 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-fd5de057-423d-4781-abb2-86a6462065ea tempest-GroupsV314Test-984512547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:21:43 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-fd5de057-423d-4781-abb2-86a6462065ea tempest-GroupsV314Test-984512547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:21:43 devstack sudo[101871]: pam_unix(sudo:session): session closed for user root Apr 29 15:21:43 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-fd5de057-423d-4781-abb2-86a6462065ea tempest-GroupsV314Test-984512547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:21:43 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-fd5de057-423d-4781-abb2-86a6462065ea tempest-GroupsV314Test-984512547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:21:43 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-fd5de057-423d-4781-abb2-86a6462065ea tempest-GroupsV314Test-984512547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:21:43 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-082c9d31-3ebd-471d-ab89-a671ef64c426 tempest-AttachVolumeTestJSON-1394496241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.778s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:21:43 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-082c9d31-3ebd-471d-ab89-a671ef64c426 tempest-AttachVolumeTestJSON-1394496241 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:21:43 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-082c9d31-3ebd-471d-ab89-a671ef64c426 tempest-AttachVolumeTestJSON-1394496241 None] Deleted volume successfully. Apr 29 15:21:43 devstack sudo[101876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:21:43 devstack sudo[101876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:21:43 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-082c9d31-3ebd-471d-ab89-a671ef64c426 tempest-AttachVolumeTestJSON-1394496241 None] Lock "cinder-bf511176-359d-4e94-80d1-a4a3dbb97949-delete_volume" released by "delete_volume" :: held 2.841s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:21:44 devstack sudo[101876]: pam_unix(sudo:session): session closed for user root Apr 29 15:21:44 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-fd5de057-423d-4781-abb2-86a6462065ea tempest-GroupsV314Test-984512547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.860s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:21:44 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-fd5de057-423d-4781-abb2-86a6462065ea tempest-GroupsV314Test-984512547 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:21:44 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-fd5de057-423d-4781-abb2-86a6462065ea tempest-GroupsV314Test-984512547 None] Delete group completed successfully. Apr 29 15:21:53 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:SELECT=89,cinder:UPDATE=94,cinder:INSERT=20,cinder:DELETE=3 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:21:53 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:SELECT=78,cinder:UPDATE=83,cinder:INSERT=18,cinder:DELETE=5 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:22:03 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-98961066-b628-4fdc-a424-c813a8ac43ad tempest-VolumeRetypeWithoutMigrationTest-1494035029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:22:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-98961066-b628-4fdc-a424-c813a8ac43ad tempest-VolumeRetypeWithoutMigrationTest-1494035029 None] Flow 'volume_create_manager' (7312543f-36c4-473b-8f14-fabe360372f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:22:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-98961066-b628-4fdc-a424-c813a8ac43ad tempest-VolumeRetypeWithoutMigrationTest-1494035029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6be3d45-8d50-4282-a789-2d2573b5774c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:22:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-98961066-b628-4fdc-a424-c813a8ac43ad tempest-VolumeRetypeWithoutMigrationTest-1494035029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6be3d45-8d50-4282-a789-2d2573b5774c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-454546724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03960015-080f-4414-956e-74d54d75c2c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea9e81d3b1d7405cbd5924d0d25353f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:22:04Z,use_quota=True,user_id='bd1437a00b7f4d29a6dc922c1be1b90c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c40c2a1d-7589-4723-b17d-ea048c749289),volume_type_id=c40c2a1d-7589-4723-b17d-ea048c749289)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:22:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-98961066-b628-4fdc-a424-c813a8ac43ad tempest-VolumeRetypeWithoutMigrationTest-1494035029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e3a418c-307d-4238-b5f4-ef7c41f11c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:22:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-98961066-b628-4fdc-a424-c813a8ac43ad tempest-VolumeRetypeWithoutMigrationTest-1494035029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e3a418c-307d-4238-b5f4-ef7c41f11c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:22:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-98961066-b628-4fdc-a424-c813a8ac43ad tempest-VolumeRetypeWithoutMigrationTest-1494035029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5591b3a3-8818-43fd-be03-04b900b33ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:22:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-98961066-b628-4fdc-a424-c813a8ac43ad tempest-VolumeRetypeWithoutMigrationTest-1494035029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5591b3a3-8818-43fd-be03-04b900b33ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03960015-080f-4414-956e-74d54d75c2c2', 'volume_name': 'volume-03960015-080f-4414-956e-74d54d75c2c2', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:22:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-98961066-b628-4fdc-a424-c813a8ac43ad tempest-VolumeRetypeWithoutMigrationTest-1494035029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c79d2389-bf00-41db-943d-2008a51591e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:22:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-98961066-b628-4fdc-a424-c813a8ac43ad tempest-VolumeRetypeWithoutMigrationTest-1494035029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c79d2389-bf00-41db-943d-2008a51591e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:22:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-98961066-b628-4fdc-a424-c813a8ac43ad tempest-VolumeRetypeWithoutMigrationTest-1494035029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b809ea7-a1b2-4374-b886-fbfa8b4da6cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:22:03 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-98961066-b628-4fdc-a424-c813a8ac43ad tempest-VolumeRetypeWithoutMigrationTest-1494035029 None] Volume 03960015-080f-4414-956e-74d54d75c2c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03960015-080f-4414-956e-74d54d75c2c2', 'volume_size': 1} Apr 29 15:22:03 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-98961066-b628-4fdc-a424-c813a8ac43ad tempest-VolumeRetypeWithoutMigrationTest-1494035029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:22:03 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-98961066-b628-4fdc-a424-c813a8ac43ad tempest-VolumeRetypeWithoutMigrationTest-1494035029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:22:03 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-98961066-b628-4fdc-a424-c813a8ac43ad tempest-VolumeRetypeWithoutMigrationTest-1494035029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-454546724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03960015-080f-4414-956e-74d54d75c2c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea9e81d3b1d7405cbd5924d0d25353f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:22:04Z,use_quota=True,user_id='bd1437a00b7f4d29a6dc922c1be1b90c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c40c2a1d-7589-4723-b17d-ea048c749289),volume_type_id=c40c2a1d-7589-4723-b17d-ea048c749289)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:22:03 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-98961066-b628-4fdc-a424-c813a8ac43ad tempest-VolumeRetypeWithoutMigrationTest-1494035029 None] Creating volume 03960015-080f-4414-956e-74d54d75c2c2 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:22:03 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-98961066-b628-4fdc-a424-c813a8ac43ad tempest-VolumeRetypeWithoutMigrationTest-1494035029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:22:03 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-98961066-b628-4fdc-a424-c813a8ac43ad tempest-VolumeRetypeWithoutMigrationTest-1494035029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:22:03 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-98961066-b628-4fdc-a424-c813a8ac43ad tempest-VolumeRetypeWithoutMigrationTest-1494035029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:22:03 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-98961066-b628-4fdc-a424-c813a8ac43ad tempest-VolumeRetypeWithoutMigrationTest-1494035029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:22:03 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-98961066-b628-4fdc-a424-c813a8ac43ad tempest-VolumeRetypeWithoutMigrationTest-1494035029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:22:03 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-98961066-b628-4fdc-a424-c813a8ac43ad tempest-VolumeRetypeWithoutMigrationTest-1494035029 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:22:03 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-98961066-b628-4fdc-a424-c813a8ac43ad tempest-VolumeRetypeWithoutMigrationTest-1494035029 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:22:03 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-98961066-b628-4fdc-a424-c813a8ac43ad tempest-VolumeRetypeWithoutMigrationTest-1494035029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-03960015-080f-4414-956e-74d54d75c2c2 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:22:03 devstack sudo[102017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-03960015-080f-4414-956e-74d54d75c2c2 1073741824 Apr 29 15:22:03 devstack sudo[102017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:22:04 devstack sudo[102017]: pam_unix(sudo:session): session closed for user root Apr 29 15:22:04 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-98961066-b628-4fdc-a424-c813a8ac43ad tempest-VolumeRetypeWithoutMigrationTest-1494035029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-03960015-080f-4414-956e-74d54d75c2c2 1073741824" returned: 0 in 0.813s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:22:04 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-98961066-b628-4fdc-a424-c813a8ac43ad tempest-VolumeRetypeWithoutMigrationTest-1494035029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-03960015-080f-4414-956e-74d54d75c2c2 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:22:04 devstack sudo[102023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-03960015-080f-4414-956e-74d54d75c2c2 Apr 29 15:22:04 devstack sudo[102023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:22:05 devstack sudo[102023]: pam_unix(sudo:session): session closed for user root Apr 29 15:22:05 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-98961066-b628-4fdc-a424-c813a8ac43ad tempest-VolumeRetypeWithoutMigrationTest-1494035029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-03960015-080f-4414-956e-74d54d75c2c2" returned: 0 in 0.598s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:22:05 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-98961066-b628-4fdc-a424-c813a8ac43ad tempest-VolumeRetypeWithoutMigrationTest-1494035029 None] <== create_volume: return (1465ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:22:05 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-98961066-b628-4fdc-a424-c813a8ac43ad tempest-VolumeRetypeWithoutMigrationTest-1494035029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.467s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:22:05 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-98961066-b628-4fdc-a424-c813a8ac43ad tempest-VolumeRetypeWithoutMigrationTest-1494035029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b809ea7-a1b2-4374-b886-fbfa8b4da6cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03960015-080f-4414-956e-74d54d75c2c2', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:22:05 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-98961066-b628-4fdc-a424-c813a8ac43ad tempest-VolumeRetypeWithoutMigrationTest-1494035029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (014008b6-3125-4b9d-b85f-4eb587e1ad89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:22:05 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-98961066-b628-4fdc-a424-c813a8ac43ad tempest-VolumeRetypeWithoutMigrationTest-1494035029 None] Volume volume-03960015-080f-4414-956e-74d54d75c2c2 (03960015-080f-4414-956e-74d54d75c2c2): created successfully Apr 29 15:22:05 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-98961066-b628-4fdc-a424-c813a8ac43ad tempest-VolumeRetypeWithoutMigrationTest-1494035029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (014008b6-3125-4b9d-b85f-4eb587e1ad89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:22:05 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-98961066-b628-4fdc-a424-c813a8ac43ad tempest-VolumeRetypeWithoutMigrationTest-1494035029 None] Flow 'volume_create_manager' (7312543f-36c4-473b-8f14-fabe360372f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:22:05 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-98961066-b628-4fdc-a424-c813a8ac43ad tempest-VolumeRetypeWithoutMigrationTest-1494035029 None] Created volume successfully. Apr 29 15:22:06 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-e0fe3901-d7be-4a71-9572-6e60163c884a tempest-VolumeRetypeWithoutMigrationTest-1494035029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:22:06 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-e0fe3901-d7be-4a71-9572-6e60163c884a tempest-VolumeRetypeWithoutMigrationTest-1494035029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:22:06 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-e0fe3901-d7be-4a71-9572-6e60163c884a tempest-VolumeRetypeWithoutMigrationTest-1494035029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:22:06 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-e0fe3901-d7be-4a71-9572-6e60163c884a tempest-VolumeRetypeWithoutMigrationTest-1494035029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:22:06 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-e0fe3901-d7be-4a71-9572-6e60163c884a tempest-VolumeRetypeWithoutMigrationTest-1494035029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:22:06 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-e0fe3901-d7be-4a71-9572-6e60163c884a tempest-VolumeRetypeWithoutMigrationTest-1494035029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:22:06 devstack sudo[102028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:22:06 devstack sudo[102028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:22:06 devstack sudo[102028]: pam_unix(sudo:session): session closed for user root Apr 29 15:22:06 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-e0fe3901-d7be-4a71-9572-6e60163c884a tempest-VolumeRetypeWithoutMigrationTest-1494035029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.624s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:22:06 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-e0fe3901-d7be-4a71-9572-6e60163c884a tempest-VolumeRetypeWithoutMigrationTest-1494035029 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:22:06 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-e0fe3901-d7be-4a71-9572-6e60163c884a tempest-VolumeRetypeWithoutMigrationTest-1494035029 None] Retype volume completed successfully. Apr 29 15:22:07 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a4d4af49-918e-4570-9538-46efc0bfbc8a tempest-VolumeRetypeWithoutMigrationTest-1494035029 None] Acquiring lock "cinder-03960015-080f-4414-956e-74d54d75c2c2-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:22:07 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a4d4af49-918e-4570-9538-46efc0bfbc8a tempest-VolumeRetypeWithoutMigrationTest-1494035029 None] Lock "cinder-03960015-080f-4414-956e-74d54d75c2c2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:22:07 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a4d4af49-918e-4570-9538-46efc0bfbc8a tempest-VolumeRetypeWithoutMigrationTest-1494035029 None] Acquiring lock "cinder-quobyte-03960015-080f-4414-956e-74d54d75c2c2" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:22:07 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a4d4af49-918e-4570-9538-46efc0bfbc8a tempest-VolumeRetypeWithoutMigrationTest-1494035029 None] Lock "cinder-quobyte-03960015-080f-4414-956e-74d54d75c2c2" acquired by "delete_volume" :: waited 0.017s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:22:07 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[4745a5d5-fc19-43d5-980c-7ad7893ad1c2]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:22:07 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a4d4af49-918e-4570-9538-46efc0bfbc8a tempest-VolumeRetypeWithoutMigrationTest-1494035029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-03960015-080f-4414-956e-74d54d75c2c2 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:22:07 devstack sudo[102031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-03960015-080f-4414-956e-74d54d75c2c2 Apr 29 15:22:07 devstack sudo[102031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:22:08 devstack sudo[102031]: pam_unix(sudo:session): session closed for user root Apr 29 15:22:08 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a4d4af49-918e-4570-9538-46efc0bfbc8a tempest-VolumeRetypeWithoutMigrationTest-1494035029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-03960015-080f-4414-956e-74d54d75c2c2" returned: 0 in 0.751s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:22:08 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a4d4af49-918e-4570-9538-46efc0bfbc8a tempest-VolumeRetypeWithoutMigrationTest-1494035029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-03960015-080f-4414-956e-74d54d75c2c2 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:22:08 devstack sudo[102036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-03960015-080f-4414-956e-74d54d75c2c2 Apr 29 15:22:08 devstack sudo[102036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:22:08 devstack sudo[102036]: pam_unix(sudo:session): session closed for user root Apr 29 15:22:08 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a4d4af49-918e-4570-9538-46efc0bfbc8a tempest-VolumeRetypeWithoutMigrationTest-1494035029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-03960015-080f-4414-956e-74d54d75c2c2" returned: 0 in 0.669s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:22:08 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a4d4af49-918e-4570-9538-46efc0bfbc8a tempest-VolumeRetypeWithoutMigrationTest-1494035029 None] Lock "cinder-quobyte-03960015-080f-4414-956e-74d54d75c2c2" released by "delete_volume" :: held 1.476s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:22:08 devstack cinder-volume[84448]: WARNING cinder.quota [None req-a4d4af49-918e-4570-9538-46efc0bfbc8a tempest-VolumeRetypeWithoutMigrationTest-1494035029 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 29 15:22:08 devstack cinder-volume[84448]: WARNING cinder.quota [None req-a4d4af49-918e-4570-9538-46efc0bfbc8a tempest-VolumeRetypeWithoutMigrationTest-1494035029 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 29 15:22:08 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-a4d4af49-918e-4570-9538-46efc0bfbc8a tempest-VolumeRetypeWithoutMigrationTest-1494035029 None] Created reservations ['96e0dfd0-db49-4cce-b2b9-b0724166a509', 'f42c08ec-5ed3-4e98-b2bd-a3db737a05cc', 'e62150de-bb95-4d80-afc0-47cc2bc74c66', '73ac7c31-a8a7-4049-a5e7-0a77aab5c84f'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:22:09 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-a4d4af49-918e-4570-9538-46efc0bfbc8a tempest-VolumeRetypeWithoutMigrationTest-1494035029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:22:09 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-a4d4af49-918e-4570-9538-46efc0bfbc8a tempest-VolumeRetypeWithoutMigrationTest-1494035029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:22:09 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-a4d4af49-918e-4570-9538-46efc0bfbc8a tempest-VolumeRetypeWithoutMigrationTest-1494035029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:22:09 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-a4d4af49-918e-4570-9538-46efc0bfbc8a tempest-VolumeRetypeWithoutMigrationTest-1494035029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:22:09 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-a4d4af49-918e-4570-9538-46efc0bfbc8a tempest-VolumeRetypeWithoutMigrationTest-1494035029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:22:09 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a4d4af49-918e-4570-9538-46efc0bfbc8a tempest-VolumeRetypeWithoutMigrationTest-1494035029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:22:09 devstack sudo[102039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:22:09 devstack sudo[102039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:22:09 devstack sudo[102039]: pam_unix(sudo:session): session closed for user root Apr 29 15:22:09 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a4d4af49-918e-4570-9538-46efc0bfbc8a tempest-VolumeRetypeWithoutMigrationTest-1494035029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.646s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:22:09 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-a4d4af49-918e-4570-9538-46efc0bfbc8a tempest-VolumeRetypeWithoutMigrationTest-1494035029 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:22:09 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-a4d4af49-918e-4570-9538-46efc0bfbc8a tempest-VolumeRetypeWithoutMigrationTest-1494035029 None] Deleted volume successfully. Apr 29 15:22:09 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a4d4af49-918e-4570-9538-46efc0bfbc8a tempest-VolumeRetypeWithoutMigrationTest-1494035029 None] Lock "cinder-03960015-080f-4414-956e-74d54d75c2c2-delete_volume" released by "delete_volume" :: held 2.343s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:22:15 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe29a404-b4fd-432c-8588-662c111f076b tempest-VolumesServicesTestJSON-1010882549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:22:15 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-fe29a404-b4fd-432c-8588-662c111f076b tempest-VolumesServicesTestJSON-1010882549 None] Flow 'volume_create_manager' (9e49312f-6c2a-45b2-9047-413b67832582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:22:15 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-fe29a404-b4fd-432c-8588-662c111f076b tempest-VolumesServicesTestJSON-1010882549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c699424c-f7d9-4fd2-a07a-5a5866e0d6fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:22:15 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-fe29a404-b4fd-432c-8588-662c111f076b tempest-VolumesServicesTestJSON-1010882549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c699424c-f7d9-4fd2-a07a-5a5866e0d6fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:22:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1313501680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf4a3020-2870-4d54-b75a-ec27e79407c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63511620d05e4f81a3b8843291a49bac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:22:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:22:15Z,use_quota=True,user_id='fe71d3a201124590a36638182b9ca224',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:22:15 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-fe29a404-b4fd-432c-8588-662c111f076b tempest-VolumesServicesTestJSON-1010882549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94444bd2-85aa-4279-92dd-6ad8a3a39a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:22:15 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-fe29a404-b4fd-432c-8588-662c111f076b tempest-VolumesServicesTestJSON-1010882549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94444bd2-85aa-4279-92dd-6ad8a3a39a20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:22:15 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-fe29a404-b4fd-432c-8588-662c111f076b tempest-VolumesServicesTestJSON-1010882549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02376f48-1213-41ac-8883-c09b89d43096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:22:15 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-fe29a404-b4fd-432c-8588-662c111f076b tempest-VolumesServicesTestJSON-1010882549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02376f48-1213-41ac-8883-c09b89d43096) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf4a3020-2870-4d54-b75a-ec27e79407c0', 'volume_name': 'volume-cf4a3020-2870-4d54-b75a-ec27e79407c0', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:22:15 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-fe29a404-b4fd-432c-8588-662c111f076b tempest-VolumesServicesTestJSON-1010882549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (697dbdc5-9a3f-4be7-8b40-84f9377c3e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:22:15 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-fe29a404-b4fd-432c-8588-662c111f076b tempest-VolumesServicesTestJSON-1010882549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (697dbdc5-9a3f-4be7-8b40-84f9377c3e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:22:15 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-fe29a404-b4fd-432c-8588-662c111f076b tempest-VolumesServicesTestJSON-1010882549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acfb6015-ad98-42fd-903a-8954bbc8ab59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:22:15 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-fe29a404-b4fd-432c-8588-662c111f076b tempest-VolumesServicesTestJSON-1010882549 None] Volume cf4a3020-2870-4d54-b75a-ec27e79407c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf4a3020-2870-4d54-b75a-ec27e79407c0', 'volume_size': 1} Apr 29 15:22:15 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-fe29a404-b4fd-432c-8588-662c111f076b tempest-VolumesServicesTestJSON-1010882549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:22:15 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-fe29a404-b4fd-432c-8588-662c111f076b tempest-VolumesServicesTestJSON-1010882549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:22:15 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-fe29a404-b4fd-432c-8588-662c111f076b tempest-VolumesServicesTestJSON-1010882549 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:22:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1313501680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf4a3020-2870-4d54-b75a-ec27e79407c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63511620d05e4f81a3b8843291a49bac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:22:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:22:15Z,use_quota=True,user_id='fe71d3a201124590a36638182b9ca224',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:22:15 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-fe29a404-b4fd-432c-8588-662c111f076b tempest-VolumesServicesTestJSON-1010882549 None] Creating volume cf4a3020-2870-4d54-b75a-ec27e79407c0 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:22:15 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-fe29a404-b4fd-432c-8588-662c111f076b tempest-VolumesServicesTestJSON-1010882549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:22:15 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-fe29a404-b4fd-432c-8588-662c111f076b tempest-VolumesServicesTestJSON-1010882549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:22:15 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-fe29a404-b4fd-432c-8588-662c111f076b tempest-VolumesServicesTestJSON-1010882549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:22:15 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-fe29a404-b4fd-432c-8588-662c111f076b tempest-VolumesServicesTestJSON-1010882549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:22:15 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-fe29a404-b4fd-432c-8588-662c111f076b tempest-VolumesServicesTestJSON-1010882549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:22:15 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-fe29a404-b4fd-432c-8588-662c111f076b tempest-VolumesServicesTestJSON-1010882549 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:22:15 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-fe29a404-b4fd-432c-8588-662c111f076b tempest-VolumesServicesTestJSON-1010882549 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:22:15 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-fe29a404-b4fd-432c-8588-662c111f076b tempest-VolumesServicesTestJSON-1010882549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cf4a3020-2870-4d54-b75a-ec27e79407c0 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:22:15 devstack sudo[102045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cf4a3020-2870-4d54-b75a-ec27e79407c0 1073741824 Apr 29 15:22:15 devstack sudo[102045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:22:16 devstack sudo[102045]: pam_unix(sudo:session): session closed for user root Apr 29 15:22:16 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-fe29a404-b4fd-432c-8588-662c111f076b tempest-VolumesServicesTestJSON-1010882549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cf4a3020-2870-4d54-b75a-ec27e79407c0 1073741824" returned: 0 in 0.891s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:22:16 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-fe29a404-b4fd-432c-8588-662c111f076b tempest-VolumesServicesTestJSON-1010882549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cf4a3020-2870-4d54-b75a-ec27e79407c0 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:22:16 devstack sudo[102051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cf4a3020-2870-4d54-b75a-ec27e79407c0 Apr 29 15:22:16 devstack sudo[102051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:22:17 devstack sudo[102051]: pam_unix(sudo:session): session closed for user root Apr 29 15:22:17 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-fe29a404-b4fd-432c-8588-662c111f076b tempest-VolumesServicesTestJSON-1010882549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cf4a3020-2870-4d54-b75a-ec27e79407c0" returned: 0 in 0.589s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:22:17 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-fe29a404-b4fd-432c-8588-662c111f076b tempest-VolumesServicesTestJSON-1010882549 None] <== create_volume: return (1530ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:22:17 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-fe29a404-b4fd-432c-8588-662c111f076b tempest-VolumesServicesTestJSON-1010882549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.533s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:22:17 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-fe29a404-b4fd-432c-8588-662c111f076b tempest-VolumesServicesTestJSON-1010882549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acfb6015-ad98-42fd-903a-8954bbc8ab59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf4a3020-2870-4d54-b75a-ec27e79407c0', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:22:17 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-fe29a404-b4fd-432c-8588-662c111f076b tempest-VolumesServicesTestJSON-1010882549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (220de3c4-5245-47a0-8682-c6415f072d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:22:17 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-fe29a404-b4fd-432c-8588-662c111f076b tempest-VolumesServicesTestJSON-1010882549 None] Volume volume-cf4a3020-2870-4d54-b75a-ec27e79407c0 (cf4a3020-2870-4d54-b75a-ec27e79407c0): created successfully Apr 29 15:22:17 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-fe29a404-b4fd-432c-8588-662c111f076b tempest-VolumesServicesTestJSON-1010882549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (220de3c4-5245-47a0-8682-c6415f072d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:22:17 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-fe29a404-b4fd-432c-8588-662c111f076b tempest-VolumesServicesTestJSON-1010882549 None] Flow 'volume_create_manager' (9e49312f-6c2a-45b2-9047-413b67832582) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:22:17 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-fe29a404-b4fd-432c-8588-662c111f076b tempest-VolumesServicesTestJSON-1010882549 None] Created volume successfully. Apr 29 15:22:17 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-1a106d90-7bc9-42cd-8b4e-a10c0b1396e8 tempest-VolumesServicesTestJSON-1010882549 None] Acquiring lock "cinder-cf4a3020-2870-4d54-b75a-ec27e79407c0-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:22:17 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-1a106d90-7bc9-42cd-8b4e-a10c0b1396e8 tempest-VolumesServicesTestJSON-1010882549 None] Lock "cinder-cf4a3020-2870-4d54-b75a-ec27e79407c0-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:22:17 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-1a106d90-7bc9-42cd-8b4e-a10c0b1396e8 tempest-VolumesServicesTestJSON-1010882549 None] Acquiring lock "cinder-quobyte-cf4a3020-2870-4d54-b75a-ec27e79407c0" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:22:17 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-1a106d90-7bc9-42cd-8b4e-a10c0b1396e8 tempest-VolumesServicesTestJSON-1010882549 None] Lock "cinder-quobyte-cf4a3020-2870-4d54-b75a-ec27e79407c0" acquired by "delete_volume" :: waited 0.019s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:22:17 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[92588e94-71c9-417e-8ce2-23c82cee863a]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:22:17 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1a106d90-7bc9-42cd-8b4e-a10c0b1396e8 tempest-VolumesServicesTestJSON-1010882549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cf4a3020-2870-4d54-b75a-ec27e79407c0 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:22:17 devstack sudo[102054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cf4a3020-2870-4d54-b75a-ec27e79407c0 Apr 29 15:22:17 devstack sudo[102054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:22:18 devstack sudo[102054]: pam_unix(sudo:session): session closed for user root Apr 29 15:22:18 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1a106d90-7bc9-42cd-8b4e-a10c0b1396e8 tempest-VolumesServicesTestJSON-1010882549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cf4a3020-2870-4d54-b75a-ec27e79407c0" returned: 0 in 0.810s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:22:18 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1a106d90-7bc9-42cd-8b4e-a10c0b1396e8 tempest-VolumesServicesTestJSON-1010882549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cf4a3020-2870-4d54-b75a-ec27e79407c0 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:22:18 devstack sudo[102059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cf4a3020-2870-4d54-b75a-ec27e79407c0 Apr 29 15:22:18 devstack sudo[102059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:22:18 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cd9265a-2515-4806-8629-c27793a50817 tempest-VolumeQuotasAdminTestJSON-525643154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:22:18 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6cd9265a-2515-4806-8629-c27793a50817 tempest-VolumeQuotasAdminTestJSON-525643154 None] Flow 'volume_create_manager' (842106a8-0254-4428-9f63-8b57ca6a2ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:22:18 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6cd9265a-2515-4806-8629-c27793a50817 tempest-VolumeQuotasAdminTestJSON-525643154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96e8c3b2-2f2c-463b-bf61-766e6a0358ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:22:18 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6cd9265a-2515-4806-8629-c27793a50817 tempest-VolumeQuotasAdminTestJSON-525643154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96e8c3b2-2f2c-463b-bf61-766e6a0358ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:22:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-942793493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9d296fd-1ffd-4dc5-9ac8-f3528f0a1e3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f98c47e6ec65472aafff585682510461',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:22:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:22:19Z,use_quota=True,user_id='391dd5d4378943e8b2f16a623fdd3e03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:22:18 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6cd9265a-2515-4806-8629-c27793a50817 tempest-VolumeQuotasAdminTestJSON-525643154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49617c47-d3f2-4227-a9c7-b3689ecc81bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:22:18 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6cd9265a-2515-4806-8629-c27793a50817 tempest-VolumeQuotasAdminTestJSON-525643154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49617c47-d3f2-4227-a9c7-b3689ecc81bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:22:18 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6cd9265a-2515-4806-8629-c27793a50817 tempest-VolumeQuotasAdminTestJSON-525643154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc58be47-f9a2-4960-a796-85cbd2573115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:22:18 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6cd9265a-2515-4806-8629-c27793a50817 tempest-VolumeQuotasAdminTestJSON-525643154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc58be47-f9a2-4960-a796-85cbd2573115) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9d296fd-1ffd-4dc5-9ac8-f3528f0a1e3c', 'volume_name': 'volume-e9d296fd-1ffd-4dc5-9ac8-f3528f0a1e3c', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:22:18 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6cd9265a-2515-4806-8629-c27793a50817 tempest-VolumeQuotasAdminTestJSON-525643154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9a2ffa4-ba5b-43a3-bdb3-f68aa10f9198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:22:18 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6cd9265a-2515-4806-8629-c27793a50817 tempest-VolumeQuotasAdminTestJSON-525643154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9a2ffa4-ba5b-43a3-bdb3-f68aa10f9198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:22:18 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6cd9265a-2515-4806-8629-c27793a50817 tempest-VolumeQuotasAdminTestJSON-525643154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e987f918-b7ed-45f2-8cff-0abe4306d0ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:22:18 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-6cd9265a-2515-4806-8629-c27793a50817 tempest-VolumeQuotasAdminTestJSON-525643154 None] Volume e9d296fd-1ffd-4dc5-9ac8-f3528f0a1e3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9d296fd-1ffd-4dc5-9ac8-f3528f0a1e3c', 'volume_size': 1} Apr 29 15:22:18 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-6cd9265a-2515-4806-8629-c27793a50817 tempest-VolumeQuotasAdminTestJSON-525643154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:22:18 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-6cd9265a-2515-4806-8629-c27793a50817 tempest-VolumeQuotasAdminTestJSON-525643154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:22:18 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-6cd9265a-2515-4806-8629-c27793a50817 tempest-VolumeQuotasAdminTestJSON-525643154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:22:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-942793493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9d296fd-1ffd-4dc5-9ac8-f3528f0a1e3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f98c47e6ec65472aafff585682510461',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:22:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:22:19Z,use_quota=True,user_id='391dd5d4378943e8b2f16a623fdd3e03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:22:18 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-6cd9265a-2515-4806-8629-c27793a50817 tempest-VolumeQuotasAdminTestJSON-525643154 None] Creating volume e9d296fd-1ffd-4dc5-9ac8-f3528f0a1e3c {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:22:18 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-6cd9265a-2515-4806-8629-c27793a50817 tempest-VolumeQuotasAdminTestJSON-525643154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:22:18 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-6cd9265a-2515-4806-8629-c27793a50817 tempest-VolumeQuotasAdminTestJSON-525643154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:22:18 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-6cd9265a-2515-4806-8629-c27793a50817 tempest-VolumeQuotasAdminTestJSON-525643154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:22:18 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-6cd9265a-2515-4806-8629-c27793a50817 tempest-VolumeQuotasAdminTestJSON-525643154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:22:18 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-6cd9265a-2515-4806-8629-c27793a50817 tempest-VolumeQuotasAdminTestJSON-525643154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:22:18 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-6cd9265a-2515-4806-8629-c27793a50817 tempest-VolumeQuotasAdminTestJSON-525643154 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:22:18 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-6cd9265a-2515-4806-8629-c27793a50817 tempest-VolumeQuotasAdminTestJSON-525643154 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:22:18 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6cd9265a-2515-4806-8629-c27793a50817 tempest-VolumeQuotasAdminTestJSON-525643154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-e9d296fd-1ffd-4dc5-9ac8-f3528f0a1e3c 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:22:18 devstack sudo[102061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-e9d296fd-1ffd-4dc5-9ac8-f3528f0a1e3c 1073741824 Apr 29 15:22:18 devstack sudo[102061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:22:19 devstack sudo[102059]: pam_unix(sudo:session): session closed for user root Apr 29 15:22:19 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1a106d90-7bc9-42cd-8b4e-a10c0b1396e8 tempest-VolumesServicesTestJSON-1010882549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cf4a3020-2870-4d54-b75a-ec27e79407c0" returned: 0 in 0.614s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:22:19 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-1a106d90-7bc9-42cd-8b4e-a10c0b1396e8 tempest-VolumesServicesTestJSON-1010882549 None] Lock "cinder-quobyte-cf4a3020-2870-4d54-b75a-ec27e79407c0" released by "delete_volume" :: held 1.481s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:22:19 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-1a106d90-7bc9-42cd-8b4e-a10c0b1396e8 tempest-VolumesServicesTestJSON-1010882549 None] Created reservations ['2c05b5ec-b85d-4ab5-85c1-62b6096b878a', '9d344f50-5f9e-4e7d-b9f5-411e6c6fbc5a', '25521fca-755b-48b7-9215-22b515cbacc6', '5b7415f3-bd7c-464d-bde7-9d73862dbbdb'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:22:19 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-5085a195-58ad-4592-9534-c40948bebf25 req-be41d1b4-10ae-4f91-9916-5a8990cda2b2 tempest-TestServerVolumeAttachmentScenario-2002744384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:22:19 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-1a106d90-7bc9-42cd-8b4e-a10c0b1396e8 tempest-VolumesServicesTestJSON-1010882549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:22:19 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-1a106d90-7bc9-42cd-8b4e-a10c0b1396e8 tempest-VolumesServicesTestJSON-1010882549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:22:19 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-1a106d90-7bc9-42cd-8b4e-a10c0b1396e8 tempest-VolumesServicesTestJSON-1010882549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:22:19 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-1a106d90-7bc9-42cd-8b4e-a10c0b1396e8 tempest-VolumesServicesTestJSON-1010882549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:22:19 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-1a106d90-7bc9-42cd-8b4e-a10c0b1396e8 tempest-VolumesServicesTestJSON-1010882549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:22:19 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1a106d90-7bc9-42cd-8b4e-a10c0b1396e8 tempest-VolumesServicesTestJSON-1010882549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:22:19 devstack sudo[102075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:22:19 devstack sudo[102075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:22:19 devstack sudo[102061]: pam_unix(sudo:session): session closed for user root Apr 29 15:22:19 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6cd9265a-2515-4806-8629-c27793a50817 tempest-VolumeQuotasAdminTestJSON-525643154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-e9d296fd-1ffd-4dc5-9ac8-f3528f0a1e3c 1073741824" returned: 0 in 0.797s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:22:19 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6cd9265a-2515-4806-8629-c27793a50817 tempest-VolumeQuotasAdminTestJSON-525643154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-e9d296fd-1ffd-4dc5-9ac8-f3528f0a1e3c {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:22:19 devstack sudo[102077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-e9d296fd-1ffd-4dc5-9ac8-f3528f0a1e3c Apr 29 15:22:19 devstack sudo[102077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:22:20 devstack sudo[102075]: pam_unix(sudo:session): session closed for user root Apr 29 15:22:20 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1a106d90-7bc9-42cd-8b4e-a10c0b1396e8 tempest-VolumesServicesTestJSON-1010882549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.618s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:22:20 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-1a106d90-7bc9-42cd-8b4e-a10c0b1396e8 tempest-VolumesServicesTestJSON-1010882549 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:22:20 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-1a106d90-7bc9-42cd-8b4e-a10c0b1396e8 tempest-VolumesServicesTestJSON-1010882549 None] Deleted volume successfully. Apr 29 15:22:20 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-1a106d90-7bc9-42cd-8b4e-a10c0b1396e8 tempest-VolumesServicesTestJSON-1010882549 None] Lock "cinder-cf4a3020-2870-4d54-b75a-ec27e79407c0-delete_volume" released by "delete_volume" :: held 2.332s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:22:20 devstack sudo[102077]: pam_unix(sudo:session): session closed for user root Apr 29 15:22:20 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6cd9265a-2515-4806-8629-c27793a50817 tempest-VolumeQuotasAdminTestJSON-525643154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-e9d296fd-1ffd-4dc5-9ac8-f3528f0a1e3c" returned: 0 in 0.645s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:22:20 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-6cd9265a-2515-4806-8629-c27793a50817 tempest-VolumeQuotasAdminTestJSON-525643154 None] <== create_volume: return (1486ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:22:20 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-6cd9265a-2515-4806-8629-c27793a50817 tempest-VolumeQuotasAdminTestJSON-525643154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.489s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:22:20 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-5085a195-58ad-4592-9534-c40948bebf25 req-be41d1b4-10ae-4f91-9916-5a8990cda2b2 tempest-TestServerVolumeAttachmentScenario-2002744384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.952s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:22:20 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6cd9265a-2515-4806-8629-c27793a50817 tempest-VolumeQuotasAdminTestJSON-525643154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e987f918-b7ed-45f2-8cff-0abe4306d0ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9d296fd-1ffd-4dc5-9ac8-f3528f0a1e3c', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:22:20 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6cd9265a-2515-4806-8629-c27793a50817 tempest-VolumeQuotasAdminTestJSON-525643154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (926d461d-ff82-4eb6-8f1b-a9f2453f70e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:22:20 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f79292a-0f0c-4bcb-9a51-9a4cc92de3ac]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:22:20 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-5085a195-58ad-4592-9534-c40948bebf25 req-be41d1b4-10ae-4f91-9916-5a8990cda2b2 tempest-TestServerVolumeAttachmentScenario-2002744384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2eababd4-4fa1-4e86-9977-af4c24b43953 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:22:20 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-6cd9265a-2515-4806-8629-c27793a50817 tempest-VolumeQuotasAdminTestJSON-525643154 None] Volume volume-e9d296fd-1ffd-4dc5-9ac8-f3528f0a1e3c (e9d296fd-1ffd-4dc5-9ac8-f3528f0a1e3c): created successfully Apr 29 15:22:20 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6cd9265a-2515-4806-8629-c27793a50817 tempest-VolumeQuotasAdminTestJSON-525643154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (926d461d-ff82-4eb6-8f1b-a9f2453f70e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:22:20 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6cd9265a-2515-4806-8629-c27793a50817 tempest-VolumeQuotasAdminTestJSON-525643154 None] Flow 'volume_create_manager' (842106a8-0254-4428-9f63-8b57ca6a2ffa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:22:20 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-6cd9265a-2515-4806-8629-c27793a50817 tempest-VolumeQuotasAdminTestJSON-525643154 None] Created volume successfully. Apr 29 15:22:20 devstack sudo[102081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2eababd4-4fa1-4e86-9977-af4c24b43953 Apr 29 15:22:20 devstack sudo[102081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:22:21 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a75603b8-00f8-426a-b036-f0b7ec845919 tempest-VolumeQuotasAdminTestJSON-525643154 None] Acquiring lock "cinder-e9d296fd-1ffd-4dc5-9ac8-f3528f0a1e3c-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:22:21 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a75603b8-00f8-426a-b036-f0b7ec845919 tempest-VolumeQuotasAdminTestJSON-525643154 None] Lock "cinder-e9d296fd-1ffd-4dc5-9ac8-f3528f0a1e3c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:22:21 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a75603b8-00f8-426a-b036-f0b7ec845919 tempest-VolumeQuotasAdminTestJSON-525643154 None] Acquiring lock "cinder-quobyte-e9d296fd-1ffd-4dc5-9ac8-f3528f0a1e3c" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:22:21 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a75603b8-00f8-426a-b036-f0b7ec845919 tempest-VolumeQuotasAdminTestJSON-525643154 None] Lock "cinder-quobyte-e9d296fd-1ffd-4dc5-9ac8-f3528f0a1e3c" acquired by "delete_volume" :: waited 0.020s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:22:21 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ea4715-1b9a-457a-a10d-8aaee932bb5b]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:22:21 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a75603b8-00f8-426a-b036-f0b7ec845919 tempest-VolumeQuotasAdminTestJSON-525643154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-e9d296fd-1ffd-4dc5-9ac8-f3528f0a1e3c {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:22:21 devstack sudo[102081]: pam_unix(sudo:session): session closed for user root Apr 29 15:22:21 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-5085a195-58ad-4592-9534-c40948bebf25 req-be41d1b4-10ae-4f91-9916-5a8990cda2b2 tempest-TestServerVolumeAttachmentScenario-2002744384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2eababd4-4fa1-4e86-9977-af4c24b43953" returned: 0 in 0.825s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:22:21 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-5085a195-58ad-4592-9534-c40948bebf25 req-be41d1b4-10ae-4f91-9916-5a8990cda2b2 tempest-TestServerVolumeAttachmentScenario-2002744384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.855s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:22:21 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-5085a195-58ad-4592-9534-c40948bebf25 req-be41d1b4-10ae-4f91-9916-5a8990cda2b2 tempest-TestServerVolumeAttachmentScenario-2002744384 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a', 'name': 'volume-2eababd4-4fa1-4e86-9977-af4c24b43953', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9bc8e7f2-5d42-462d-acf3-6197ad5ed387', 'enforce_multipath': True} {{(pid=84448) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 15:22:21 devstack sudo[102086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-e9d296fd-1ffd-4dc5-9ac8-f3528f0a1e3c Apr 29 15:22:21 devstack sudo[102086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:22:21 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-5085a195-58ad-4592-9534-c40948bebf25 req-be41d1b4-10ae-4f91-9916-5a8990cda2b2 tempest-TestServerVolumeAttachmentScenario-2002744384 None] attachment_update completed successfully. Apr 29 15:22:22 devstack sudo[102086]: pam_unix(sudo:session): session closed for user root Apr 29 15:22:22 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a75603b8-00f8-426a-b036-f0b7ec845919 tempest-VolumeQuotasAdminTestJSON-525643154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-e9d296fd-1ffd-4dc5-9ac8-f3528f0a1e3c" returned: 0 in 0.847s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:22:22 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a75603b8-00f8-426a-b036-f0b7ec845919 tempest-VolumeQuotasAdminTestJSON-525643154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-e9d296fd-1ffd-4dc5-9ac8-f3528f0a1e3c {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:22:22 devstack sudo[102158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-e9d296fd-1ffd-4dc5-9ac8-f3528f0a1e3c Apr 29 15:22:22 devstack sudo[102158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:22:22 devstack sudo[102158]: pam_unix(sudo:session): session closed for user root Apr 29 15:22:22 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a75603b8-00f8-426a-b036-f0b7ec845919 tempest-VolumeQuotasAdminTestJSON-525643154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-e9d296fd-1ffd-4dc5-9ac8-f3528f0a1e3c" returned: 0 in 0.658s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:22:22 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a75603b8-00f8-426a-b036-f0b7ec845919 tempest-VolumeQuotasAdminTestJSON-525643154 None] Lock "cinder-quobyte-e9d296fd-1ffd-4dc5-9ac8-f3528f0a1e3c" released by "delete_volume" :: held 1.551s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:22:22 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-a75603b8-00f8-426a-b036-f0b7ec845919 tempest-VolumeQuotasAdminTestJSON-525643154 None] Created reservations ['014863b0-9e53-4666-9036-066fd47ade5c', '5a602ec7-0c8e-4796-94d7-fedb6c483af8', '67417530-ae3c-4661-9a20-f4e681734da0', 'd93a9f11-280d-43e9-8bbb-4f70060ecdb4'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:22:22 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-a75603b8-00f8-426a-b036-f0b7ec845919 tempest-VolumeQuotasAdminTestJSON-525643154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:22:22 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-a75603b8-00f8-426a-b036-f0b7ec845919 tempest-VolumeQuotasAdminTestJSON-525643154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:22:22 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-a75603b8-00f8-426a-b036-f0b7ec845919 tempest-VolumeQuotasAdminTestJSON-525643154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:22:22 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-a75603b8-00f8-426a-b036-f0b7ec845919 tempest-VolumeQuotasAdminTestJSON-525643154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:22:22 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-a75603b8-00f8-426a-b036-f0b7ec845919 tempest-VolumeQuotasAdminTestJSON-525643154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:22:22 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a75603b8-00f8-426a-b036-f0b7ec845919 tempest-VolumeQuotasAdminTestJSON-525643154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:22:22 devstack sudo[102476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:22:22 devstack sudo[102476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:22:23 devstack sudo[102476]: pam_unix(sudo:session): session closed for user root Apr 29 15:22:23 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a75603b8-00f8-426a-b036-f0b7ec845919 tempest-VolumeQuotasAdminTestJSON-525643154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.621s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:22:23 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-a75603b8-00f8-426a-b036-f0b7ec845919 tempest-VolumeQuotasAdminTestJSON-525643154 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:22:23 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-a75603b8-00f8-426a-b036-f0b7ec845919 tempest-VolumeQuotasAdminTestJSON-525643154 None] Deleted volume successfully. Apr 29 15:22:23 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a75603b8-00f8-426a-b036-f0b7ec845919 tempest-VolumeQuotasAdminTestJSON-525643154 None] Lock "cinder-e9d296fd-1ffd-4dc5-9ac8-f3528f0a1e3c-delete_volume" released by "delete_volume" :: held 2.428s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:22:23 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7b43b11-6ecc-4c08-b0de-8983df27335b tempest-VolumeQuotasAdminTestJSON-525643154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:22:23 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c7b43b11-6ecc-4c08-b0de-8983df27335b tempest-VolumeQuotasAdminTestJSON-525643154 None] Flow 'volume_create_manager' (08d39ea0-6736-44a3-b7d5-993403d7e1f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:22:23 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c7b43b11-6ecc-4c08-b0de-8983df27335b tempest-VolumeQuotasAdminTestJSON-525643154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53cb1b2b-8dd4-42ac-bdf0-1c7dec05e618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:22:23 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c7b43b11-6ecc-4c08-b0de-8983df27335b tempest-VolumeQuotasAdminTestJSON-525643154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53cb1b2b-8dd4-42ac-bdf0-1c7dec05e618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:22:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1720733248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a8ebb81-9967-41c2-abf5-086216964d87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f98c47e6ec65472aafff585682510461',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:22:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:22:24Z,use_quota=True,user_id='391dd5d4378943e8b2f16a623fdd3e03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:22:23 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c7b43b11-6ecc-4c08-b0de-8983df27335b tempest-VolumeQuotasAdminTestJSON-525643154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ec0b57a-82a2-4e14-a158-290e1e653461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:22:23 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c7b43b11-6ecc-4c08-b0de-8983df27335b tempest-VolumeQuotasAdminTestJSON-525643154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ec0b57a-82a2-4e14-a158-290e1e653461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:22:23 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c7b43b11-6ecc-4c08-b0de-8983df27335b tempest-VolumeQuotasAdminTestJSON-525643154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (690266d0-e5a6-4e3e-a37a-fedeb6ba1687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:22:23 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c7b43b11-6ecc-4c08-b0de-8983df27335b tempest-VolumeQuotasAdminTestJSON-525643154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (690266d0-e5a6-4e3e-a37a-fedeb6ba1687) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a8ebb81-9967-41c2-abf5-086216964d87', 'volume_name': 'volume-4a8ebb81-9967-41c2-abf5-086216964d87', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:22:23 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c7b43b11-6ecc-4c08-b0de-8983df27335b tempest-VolumeQuotasAdminTestJSON-525643154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (078c0d86-01bf-4b7b-9945-fcee4949cea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:22:23 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c7b43b11-6ecc-4c08-b0de-8983df27335b tempest-VolumeQuotasAdminTestJSON-525643154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (078c0d86-01bf-4b7b-9945-fcee4949cea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:22:23 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c7b43b11-6ecc-4c08-b0de-8983df27335b tempest-VolumeQuotasAdminTestJSON-525643154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d54f957-1d53-4d8b-bdae-4ba09bc60f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:22:23 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-c7b43b11-6ecc-4c08-b0de-8983df27335b tempest-VolumeQuotasAdminTestJSON-525643154 None] Volume 4a8ebb81-9967-41c2-abf5-086216964d87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a8ebb81-9967-41c2-abf5-086216964d87', 'volume_size': 1} Apr 29 15:22:23 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-c7b43b11-6ecc-4c08-b0de-8983df27335b tempest-VolumeQuotasAdminTestJSON-525643154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:22:23 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-c7b43b11-6ecc-4c08-b0de-8983df27335b tempest-VolumeQuotasAdminTestJSON-525643154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:22:23 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-c7b43b11-6ecc-4c08-b0de-8983df27335b tempest-VolumeQuotasAdminTestJSON-525643154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:22:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1720733248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a8ebb81-9967-41c2-abf5-086216964d87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f98c47e6ec65472aafff585682510461',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:22:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:22:24Z,use_quota=True,user_id='391dd5d4378943e8b2f16a623fdd3e03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:22:23 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-c7b43b11-6ecc-4c08-b0de-8983df27335b tempest-VolumeQuotasAdminTestJSON-525643154 None] Creating volume 4a8ebb81-9967-41c2-abf5-086216964d87 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:22:23 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-c7b43b11-6ecc-4c08-b0de-8983df27335b tempest-VolumeQuotasAdminTestJSON-525643154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:22:23 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-c7b43b11-6ecc-4c08-b0de-8983df27335b tempest-VolumeQuotasAdminTestJSON-525643154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:22:23 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-c7b43b11-6ecc-4c08-b0de-8983df27335b tempest-VolumeQuotasAdminTestJSON-525643154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:22:23 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-c7b43b11-6ecc-4c08-b0de-8983df27335b tempest-VolumeQuotasAdminTestJSON-525643154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:22:23 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-c7b43b11-6ecc-4c08-b0de-8983df27335b tempest-VolumeQuotasAdminTestJSON-525643154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:22:23 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-c7b43b11-6ecc-4c08-b0de-8983df27335b tempest-VolumeQuotasAdminTestJSON-525643154 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:22:23 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-c7b43b11-6ecc-4c08-b0de-8983df27335b tempest-VolumeQuotasAdminTestJSON-525643154 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:22:23 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c7b43b11-6ecc-4c08-b0de-8983df27335b tempest-VolumeQuotasAdminTestJSON-525643154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4a8ebb81-9967-41c2-abf5-086216964d87 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:22:23 devstack sudo[102479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4a8ebb81-9967-41c2-abf5-086216964d87 1073741824 Apr 29 15:22:23 devstack sudo[102479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:22:24 devstack sudo[102479]: pam_unix(sudo:session): session closed for user root Apr 29 15:22:24 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c7b43b11-6ecc-4c08-b0de-8983df27335b tempest-VolumeQuotasAdminTestJSON-525643154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4a8ebb81-9967-41c2-abf5-086216964d87 1073741824" returned: 0 in 0.813s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:22:24 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c7b43b11-6ecc-4c08-b0de-8983df27335b tempest-VolumeQuotasAdminTestJSON-525643154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4a8ebb81-9967-41c2-abf5-086216964d87 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:22:24 devstack sudo[102485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4a8ebb81-9967-41c2-abf5-086216964d87 Apr 29 15:22:24 devstack sudo[102485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:22:25 devstack sudo[102485]: pam_unix(sudo:session): session closed for user root Apr 29 15:22:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c7b43b11-6ecc-4c08-b0de-8983df27335b tempest-VolumeQuotasAdminTestJSON-525643154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4a8ebb81-9967-41c2-abf5-086216964d87" returned: 0 in 0.620s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:22:25 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-c7b43b11-6ecc-4c08-b0de-8983df27335b tempest-VolumeQuotasAdminTestJSON-525643154 None] <== create_volume: return (1482ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:22:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-c7b43b11-6ecc-4c08-b0de-8983df27335b tempest-VolumeQuotasAdminTestJSON-525643154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.485s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:22:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c7b43b11-6ecc-4c08-b0de-8983df27335b tempest-VolumeQuotasAdminTestJSON-525643154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d54f957-1d53-4d8b-bdae-4ba09bc60f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a8ebb81-9967-41c2-abf5-086216964d87', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:22:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c7b43b11-6ecc-4c08-b0de-8983df27335b tempest-VolumeQuotasAdminTestJSON-525643154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fed15ed8-2f90-42b2-b1f6-f9f4c57e18c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:22:25 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-c7b43b11-6ecc-4c08-b0de-8983df27335b tempest-VolumeQuotasAdminTestJSON-525643154 None] Volume volume-4a8ebb81-9967-41c2-abf5-086216964d87 (4a8ebb81-9967-41c2-abf5-086216964d87): created successfully Apr 29 15:22:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c7b43b11-6ecc-4c08-b0de-8983df27335b tempest-VolumeQuotasAdminTestJSON-525643154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fed15ed8-2f90-42b2-b1f6-f9f4c57e18c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:22:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c7b43b11-6ecc-4c08-b0de-8983df27335b tempest-VolumeQuotasAdminTestJSON-525643154 None] Flow 'volume_create_manager' (08d39ea0-6736-44a3-b7d5-993403d7e1f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:22:25 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-c7b43b11-6ecc-4c08-b0de-8983df27335b tempest-VolumeQuotasAdminTestJSON-525643154 None] Created volume successfully. Apr 29 15:22:25 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-36a93637-9b11-4d3e-aeb2-3cbc94baa1d8 tempest-VolumeTypesAccessTest-895041097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:22:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-36a93637-9b11-4d3e-aeb2-3cbc94baa1d8 tempest-VolumeTypesAccessTest-895041097 None] Flow 'volume_create_manager' (f64dbab5-a097-4213-870f-81144a898af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:22:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-36a93637-9b11-4d3e-aeb2-3cbc94baa1d8 tempest-VolumeTypesAccessTest-895041097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bf09674-41a7-4648-a322-079549f22cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:22:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-36a93637-9b11-4d3e-aeb2-3cbc94baa1d8 tempest-VolumeTypesAccessTest-895041097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bf09674-41a7-4648-a322-079549f22cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:22:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-675071605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd175f81-6385-435e-b48b-b16b3be59f07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99068ce74cc94b999df9e8ec18643ce1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:22:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:22:26Z,use_quota=True,user_id='87273757a9184feaa2b9e7bf891be58b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3743077-bb8e-472b-8a78-f31cfe33471b),volume_type_id=e3743077-bb8e-472b-8a78-f31cfe33471b)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:22:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-36a93637-9b11-4d3e-aeb2-3cbc94baa1d8 tempest-VolumeTypesAccessTest-895041097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99817728-67bd-4922-af71-e169549ca3d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:22:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-36a93637-9b11-4d3e-aeb2-3cbc94baa1d8 tempest-VolumeTypesAccessTest-895041097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99817728-67bd-4922-af71-e169549ca3d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:22:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-36a93637-9b11-4d3e-aeb2-3cbc94baa1d8 tempest-VolumeTypesAccessTest-895041097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c8c8715-5114-4ddd-baee-3e8f2febcc12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:22:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-36a93637-9b11-4d3e-aeb2-3cbc94baa1d8 tempest-VolumeTypesAccessTest-895041097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c8c8715-5114-4ddd-baee-3e8f2febcc12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd175f81-6385-435e-b48b-b16b3be59f07', 'volume_name': 'volume-cd175f81-6385-435e-b48b-b16b3be59f07', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:22:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-36a93637-9b11-4d3e-aeb2-3cbc94baa1d8 tempest-VolumeTypesAccessTest-895041097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27d16b1a-33a5-4f5d-9e80-fc0a3e105788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:22:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-36a93637-9b11-4d3e-aeb2-3cbc94baa1d8 tempest-VolumeTypesAccessTest-895041097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27d16b1a-33a5-4f5d-9e80-fc0a3e105788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:22:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-36a93637-9b11-4d3e-aeb2-3cbc94baa1d8 tempest-VolumeTypesAccessTest-895041097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e5bf7e7-e2c6-4552-be30-679a23995ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:22:25 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-36a93637-9b11-4d3e-aeb2-3cbc94baa1d8 tempest-VolumeTypesAccessTest-895041097 None] Volume cd175f81-6385-435e-b48b-b16b3be59f07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd175f81-6385-435e-b48b-b16b3be59f07', 'volume_size': 1} Apr 29 15:22:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-36a93637-9b11-4d3e-aeb2-3cbc94baa1d8 tempest-VolumeTypesAccessTest-895041097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:22:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-36a93637-9b11-4d3e-aeb2-3cbc94baa1d8 tempest-VolumeTypesAccessTest-895041097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:22:25 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-36a93637-9b11-4d3e-aeb2-3cbc94baa1d8 tempest-VolumeTypesAccessTest-895041097 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:22:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-675071605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd175f81-6385-435e-b48b-b16b3be59f07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99068ce74cc94b999df9e8ec18643ce1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:22:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:22:26Z,use_quota=True,user_id='87273757a9184feaa2b9e7bf891be58b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3743077-bb8e-472b-8a78-f31cfe33471b),volume_type_id=e3743077-bb8e-472b-8a78-f31cfe33471b)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:22:25 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-36a93637-9b11-4d3e-aeb2-3cbc94baa1d8 tempest-VolumeTypesAccessTest-895041097 None] Creating volume cd175f81-6385-435e-b48b-b16b3be59f07 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:22:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-36a93637-9b11-4d3e-aeb2-3cbc94baa1d8 tempest-VolumeTypesAccessTest-895041097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:22:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-36a93637-9b11-4d3e-aeb2-3cbc94baa1d8 tempest-VolumeTypesAccessTest-895041097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:22:25 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-36a93637-9b11-4d3e-aeb2-3cbc94baa1d8 tempest-VolumeTypesAccessTest-895041097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:22:25 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-36a93637-9b11-4d3e-aeb2-3cbc94baa1d8 tempest-VolumeTypesAccessTest-895041097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:22:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-36a93637-9b11-4d3e-aeb2-3cbc94baa1d8 tempest-VolumeTypesAccessTest-895041097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:22:25 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-36a93637-9b11-4d3e-aeb2-3cbc94baa1d8 tempest-VolumeTypesAccessTest-895041097 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:22:25 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-36a93637-9b11-4d3e-aeb2-3cbc94baa1d8 tempest-VolumeTypesAccessTest-895041097 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:22:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-36a93637-9b11-4d3e-aeb2-3cbc94baa1d8 tempest-VolumeTypesAccessTest-895041097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cd175f81-6385-435e-b48b-b16b3be59f07 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:22:25 devstack sudo[102489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cd175f81-6385-435e-b48b-b16b3be59f07 1073741824 Apr 29 15:22:25 devstack sudo[102489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:22:26 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-5f4cf1a6-70f3-407e-8c27-128e6c4593b4 tempest-VolumeQuotasAdminTestJSON-485271846 None] Transfer volume completed successfully. Apr 29 15:22:26 devstack sudo[102489]: pam_unix(sudo:session): session closed for user root Apr 29 15:22:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-36a93637-9b11-4d3e-aeb2-3cbc94baa1d8 tempest-VolumeTypesAccessTest-895041097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cd175f81-6385-435e-b48b-b16b3be59f07 1073741824" returned: 0 in 0.913s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:22:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-36a93637-9b11-4d3e-aeb2-3cbc94baa1d8 tempest-VolumeTypesAccessTest-895041097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cd175f81-6385-435e-b48b-b16b3be59f07 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:22:26 devstack sudo[102495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cd175f81-6385-435e-b48b-b16b3be59f07 Apr 29 15:22:26 devstack sudo[102495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:22:27 devstack sudo[102495]: pam_unix(sudo:session): session closed for user root Apr 29 15:22:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-36a93637-9b11-4d3e-aeb2-3cbc94baa1d8 tempest-VolumeTypesAccessTest-895041097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cd175f81-6385-435e-b48b-b16b3be59f07" returned: 0 in 0.620s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:22:27 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-36a93637-9b11-4d3e-aeb2-3cbc94baa1d8 tempest-VolumeTypesAccessTest-895041097 None] <== create_volume: return (1578ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:22:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-36a93637-9b11-4d3e-aeb2-3cbc94baa1d8 tempest-VolumeTypesAccessTest-895041097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.580s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:22:27 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-36a93637-9b11-4d3e-aeb2-3cbc94baa1d8 tempest-VolumeTypesAccessTest-895041097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e5bf7e7-e2c6-4552-be30-679a23995ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd175f81-6385-435e-b48b-b16b3be59f07', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:22:27 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-36a93637-9b11-4d3e-aeb2-3cbc94baa1d8 tempest-VolumeTypesAccessTest-895041097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ade88396-7f73-4de0-b7ca-48b59e946e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:22:27 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-36a93637-9b11-4d3e-aeb2-3cbc94baa1d8 tempest-VolumeTypesAccessTest-895041097 None] Volume volume-cd175f81-6385-435e-b48b-b16b3be59f07 (cd175f81-6385-435e-b48b-b16b3be59f07): created successfully Apr 29 15:22:27 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-36a93637-9b11-4d3e-aeb2-3cbc94baa1d8 tempest-VolumeTypesAccessTest-895041097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ade88396-7f73-4de0-b7ca-48b59e946e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:22:27 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-36a93637-9b11-4d3e-aeb2-3cbc94baa1d8 tempest-VolumeTypesAccessTest-895041097 None] Flow 'volume_create_manager' (f64dbab5-a097-4213-870f-81144a898af2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:22:27 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-36a93637-9b11-4d3e-aeb2-3cbc94baa1d8 tempest-VolumeTypesAccessTest-895041097 None] Created volume successfully. Apr 29 15:22:27 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-df277267-d724-424a-8111-cd149387e826 tempest-VolumeQuotasAdminTestJSON-813108990 None] Acquiring lock "cinder-4a8ebb81-9967-41c2-abf5-086216964d87-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:22:27 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-df277267-d724-424a-8111-cd149387e826 tempest-VolumeQuotasAdminTestJSON-813108990 None] Lock "cinder-4a8ebb81-9967-41c2-abf5-086216964d87-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:22:27 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-df277267-d724-424a-8111-cd149387e826 tempest-VolumeQuotasAdminTestJSON-813108990 None] Acquiring lock "cinder-quobyte-4a8ebb81-9967-41c2-abf5-086216964d87" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:22:27 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-df277267-d724-424a-8111-cd149387e826 tempest-VolumeQuotasAdminTestJSON-813108990 None] Lock "cinder-quobyte-4a8ebb81-9967-41c2-abf5-086216964d87" acquired by "delete_volume" :: waited 0.029s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:22:27 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b179ac8-a40b-4e98-8eb7-2413e445af06]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:22:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-df277267-d724-424a-8111-cd149387e826 tempest-VolumeQuotasAdminTestJSON-813108990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4a8ebb81-9967-41c2-abf5-086216964d87 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:22:27 devstack sudo[102498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4a8ebb81-9967-41c2-abf5-086216964d87 Apr 29 15:22:27 devstack sudo[102498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:22:28 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-afde6803-dc51-47f6-ab10-8d1aaefd51d2 tempest-VolumeTypesAccessTest-895041097 None] Acquiring lock "cinder-cd175f81-6385-435e-b48b-b16b3be59f07-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:22:28 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-afde6803-dc51-47f6-ab10-8d1aaefd51d2 tempest-VolumeTypesAccessTest-895041097 None] Lock "cinder-cd175f81-6385-435e-b48b-b16b3be59f07-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:22:28 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-afde6803-dc51-47f6-ab10-8d1aaefd51d2 tempest-VolumeTypesAccessTest-895041097 None] Acquiring lock "cinder-quobyte-cd175f81-6385-435e-b48b-b16b3be59f07" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:22:28 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-afde6803-dc51-47f6-ab10-8d1aaefd51d2 tempest-VolumeTypesAccessTest-895041097 None] Lock "cinder-quobyte-cd175f81-6385-435e-b48b-b16b3be59f07" acquired by "delete_volume" :: waited 0.019s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:22:28 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[a116fce9-6535-4b65-adeb-c4ba31ee0e09]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:22:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-afde6803-dc51-47f6-ab10-8d1aaefd51d2 tempest-VolumeTypesAccessTest-895041097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cd175f81-6385-435e-b48b-b16b3be59f07 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:22:28 devstack sudo[102501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cd175f81-6385-435e-b48b-b16b3be59f07 Apr 29 15:22:28 devstack sudo[102501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:22:28 devstack sudo[102498]: pam_unix(sudo:session): session closed for user root Apr 29 15:22:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-df277267-d724-424a-8111-cd149387e826 tempest-VolumeQuotasAdminTestJSON-813108990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4a8ebb81-9967-41c2-abf5-086216964d87" returned: 0 in 0.782s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:22:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-df277267-d724-424a-8111-cd149387e826 tempest-VolumeQuotasAdminTestJSON-813108990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4a8ebb81-9967-41c2-abf5-086216964d87 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:22:28 devstack sudo[102505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4a8ebb81-9967-41c2-abf5-086216964d87 Apr 29 15:22:28 devstack sudo[102505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:22:29 devstack sudo[102501]: pam_unix(sudo:session): session closed for user root Apr 29 15:22:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-afde6803-dc51-47f6-ab10-8d1aaefd51d2 tempest-VolumeTypesAccessTest-895041097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cd175f81-6385-435e-b48b-b16b3be59f07" returned: 0 in 0.756s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:22:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-afde6803-dc51-47f6-ab10-8d1aaefd51d2 tempest-VolumeTypesAccessTest-895041097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cd175f81-6385-435e-b48b-b16b3be59f07 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:22:29 devstack sudo[102511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cd175f81-6385-435e-b48b-b16b3be59f07 Apr 29 15:22:29 devstack sudo[102511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:22:29 devstack sudo[102505]: pam_unix(sudo:session): session closed for user root Apr 29 15:22:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-df277267-d724-424a-8111-cd149387e826 tempest-VolumeQuotasAdminTestJSON-813108990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4a8ebb81-9967-41c2-abf5-086216964d87" returned: 0 in 0.642s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:22:29 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-df277267-d724-424a-8111-cd149387e826 tempest-VolumeQuotasAdminTestJSON-813108990 None] Lock "cinder-quobyte-4a8ebb81-9967-41c2-abf5-086216964d87" released by "delete_volume" :: held 1.479s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:22:29 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-df277267-d724-424a-8111-cd149387e826 tempest-VolumeQuotasAdminTestJSON-813108990 None] Created reservations ['06d6ab87-c463-48c4-a825-a167cc14f173', 'ede2edd8-6736-470b-ad11-598328a287b6', 'f349698a-683a-409c-9866-17e147f4780d', '6eeda5d1-0725-4b55-a25d-26bd23555940'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:22:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-df277267-d724-424a-8111-cd149387e826 tempest-VolumeQuotasAdminTestJSON-813108990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:22:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-df277267-d724-424a-8111-cd149387e826 tempest-VolumeQuotasAdminTestJSON-813108990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:22:29 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-df277267-d724-424a-8111-cd149387e826 tempest-VolumeQuotasAdminTestJSON-813108990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:22:29 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-df277267-d724-424a-8111-cd149387e826 tempest-VolumeQuotasAdminTestJSON-813108990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:22:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-df277267-d724-424a-8111-cd149387e826 tempest-VolumeQuotasAdminTestJSON-813108990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:22:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-df277267-d724-424a-8111-cd149387e826 tempest-VolumeQuotasAdminTestJSON-813108990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:22:29 devstack sudo[102513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:22:29 devstack sudo[102513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:22:29 devstack sudo[102511]: pam_unix(sudo:session): session closed for user root Apr 29 15:22:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-afde6803-dc51-47f6-ab10-8d1aaefd51d2 tempest-VolumeTypesAccessTest-895041097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cd175f81-6385-435e-b48b-b16b3be59f07" returned: 0 in 0.602s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:22:29 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-afde6803-dc51-47f6-ab10-8d1aaefd51d2 tempest-VolumeTypesAccessTest-895041097 None] Lock "cinder-quobyte-cd175f81-6385-435e-b48b-b16b3be59f07" released by "delete_volume" :: held 1.412s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:22:29 devstack cinder-volume[84448]: WARNING cinder.quota [None req-afde6803-dc51-47f6-ab10-8d1aaefd51d2 tempest-VolumeTypesAccessTest-895041097 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-259435125 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-259435125, it is now deprecated. Please use the default quota class for default quota. Apr 29 15:22:29 devstack cinder-volume[84448]: WARNING cinder.quota [None req-afde6803-dc51-47f6-ab10-8d1aaefd51d2 tempest-VolumeTypesAccessTest-895041097 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-259435125 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-259435125, it is now deprecated. Please use the default quota class for default quota. Apr 29 15:22:29 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-afde6803-dc51-47f6-ab10-8d1aaefd51d2 tempest-VolumeTypesAccessTest-895041097 None] Created reservations ['e37a325f-ad6f-4dd1-a245-e97a96142de6', 'ceaf3e8d-6411-4dbe-babf-74bc496007b0', 'cdf19b74-6311-4836-9ad8-83059a7b082b', 'cda7201e-0e25-4f01-a5fb-0fa4d8b133e6'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:22:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-afde6803-dc51-47f6-ab10-8d1aaefd51d2 tempest-VolumeTypesAccessTest-895041097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:22:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-afde6803-dc51-47f6-ab10-8d1aaefd51d2 tempest-VolumeTypesAccessTest-895041097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:22:29 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-afde6803-dc51-47f6-ab10-8d1aaefd51d2 tempest-VolumeTypesAccessTest-895041097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:22:29 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-afde6803-dc51-47f6-ab10-8d1aaefd51d2 tempest-VolumeTypesAccessTest-895041097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:22:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-afde6803-dc51-47f6-ab10-8d1aaefd51d2 tempest-VolumeTypesAccessTest-895041097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:22:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-afde6803-dc51-47f6-ab10-8d1aaefd51d2 tempest-VolumeTypesAccessTest-895041097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:22:29 devstack sudo[102517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:22:29 devstack sudo[102517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:22:29 devstack sudo[102513]: pam_unix(sudo:session): session closed for user root Apr 29 15:22:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-df277267-d724-424a-8111-cd149387e826 tempest-VolumeQuotasAdminTestJSON-813108990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.643s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:22:29 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-df277267-d724-424a-8111-cd149387e826 tempest-VolumeQuotasAdminTestJSON-813108990 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:22:30 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-df277267-d724-424a-8111-cd149387e826 tempest-VolumeQuotasAdminTestJSON-813108990 None] Deleted volume successfully. Apr 29 15:22:30 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-df277267-d724-424a-8111-cd149387e826 tempest-VolumeQuotasAdminTestJSON-813108990 None] Lock "cinder-4a8ebb81-9967-41c2-abf5-086216964d87-delete_volume" released by "delete_volume" :: held 2.344s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:22:30 devstack cinder-volume[84448]: DEBUG oslo_service.periodic_task [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84448) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 15:22:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:22:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:22:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:22:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:22:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:22:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:22:30 devstack sudo[102547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:22:30 devstack sudo[102547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:22:30 devstack sudo[102517]: pam_unix(sudo:session): session closed for user root Apr 29 15:22:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-afde6803-dc51-47f6-ab10-8d1aaefd51d2 tempest-VolumeTypesAccessTest-895041097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.667s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:22:30 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-afde6803-dc51-47f6-ab10-8d1aaefd51d2 tempest-VolumeTypesAccessTest-895041097 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:22:30 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-afde6803-dc51-47f6-ab10-8d1aaefd51d2 tempest-VolumeTypesAccessTest-895041097 None] Deleted volume successfully. Apr 29 15:22:30 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-afde6803-dc51-47f6-ab10-8d1aaefd51d2 tempest-VolumeTypesAccessTest-895041097 None] Lock "cinder-cd175f81-6385-435e-b48b-b16b3be59f07-delete_volume" released by "delete_volume" :: held 2.342s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:22:31 devstack sudo[102547]: pam_unix(sudo:session): session closed for user root Apr 29 15:22:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.933s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:22:31 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:22:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-4df86ad1-f179-4cc6-be34-a82230d90200 req-e93e30a1-b219-4d55-b2bc-dd6a14989fe4 tempest-TestServerVolumeAttachmentScenario-2002744384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:22:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-4df86ad1-f179-4cc6-be34-a82230d90200 req-e93e30a1-b219-4d55-b2bc-dd6a14989fe4 tempest-TestServerVolumeAttachmentScenario-2002744384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:22:31 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aebaa30-14c6-4c77-95c7-70fbb84769aa]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:22:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-4df86ad1-f179-4cc6-be34-a82230d90200 req-e93e30a1-b219-4d55-b2bc-dd6a14989fe4 tempest-TestServerVolumeAttachmentScenario-2002744384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-853deb88-67bd-4dfc-80e0-302a44d30fbf {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:22:31 devstack sudo[102573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-853deb88-67bd-4dfc-80e0-302a44d30fbf Apr 29 15:22:31 devstack sudo[102573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:22:32 devstack sudo[102573]: pam_unix(sudo:session): session closed for user root Apr 29 15:22:32 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-4df86ad1-f179-4cc6-be34-a82230d90200 req-e93e30a1-b219-4d55-b2bc-dd6a14989fe4 tempest-TestServerVolumeAttachmentScenario-2002744384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-853deb88-67bd-4dfc-80e0-302a44d30fbf" returned: 0 in 0.882s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:22:32 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-4df86ad1-f179-4cc6-be34-a82230d90200 req-e93e30a1-b219-4d55-b2bc-dd6a14989fe4 tempest-TestServerVolumeAttachmentScenario-2002744384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.904s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:22:32 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-4df86ad1-f179-4cc6-be34-a82230d90200 req-e93e30a1-b219-4d55-b2bc-dd6a14989fe4 tempest-TestServerVolumeAttachmentScenario-2002744384 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a', 'name': 'volume-853deb88-67bd-4dfc-80e0-302a44d30fbf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4e1516c8-21d4-469b-b3f3-4b710901c151', 'enforce_multipath': True} {{(pid=84448) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 15:22:32 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-4df86ad1-f179-4cc6-be34-a82230d90200 req-e93e30a1-b219-4d55-b2bc-dd6a14989fe4 tempest-TestServerVolumeAttachmentScenario-2002744384 None] attachment_update completed successfully. Apr 29 15:22:39 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-514ffe91-9b95-49eb-9e69-67777da8c3e1 tempest-VolumesTransfersTest-105064299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:22:39 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-514ffe91-9b95-49eb-9e69-67777da8c3e1 tempest-VolumesTransfersTest-105064299 None] Flow 'volume_create_manager' (80bb387e-d241-4c63-aa62-4043bf3301fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:22:39 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-514ffe91-9b95-49eb-9e69-67777da8c3e1 tempest-VolumesTransfersTest-105064299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed79bbac-6950-46ef-93e7-1a1c4d28128a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:22:39 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-514ffe91-9b95-49eb-9e69-67777da8c3e1 tempest-VolumesTransfersTest-105064299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed79bbac-6950-46ef-93e7-1a1c4d28128a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:22:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1405159858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e513b03c-874d-45e5-a9d8-1a68bb2aea94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85f9456484a24a16af8a6c2b27ca5782',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:22:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:22:39Z,use_quota=True,user_id='38ccf73399c644fd98a61dd22214e20d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:22:39 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-514ffe91-9b95-49eb-9e69-67777da8c3e1 tempest-VolumesTransfersTest-105064299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1efc3e28-2a93-4c57-a2a7-b5667b1b3747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:22:39 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-514ffe91-9b95-49eb-9e69-67777da8c3e1 tempest-VolumesTransfersTest-105064299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1efc3e28-2a93-4c57-a2a7-b5667b1b3747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:22:39 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-514ffe91-9b95-49eb-9e69-67777da8c3e1 tempest-VolumesTransfersTest-105064299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (651890ca-edf8-4912-849b-4259f3032551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:22:39 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-514ffe91-9b95-49eb-9e69-67777da8c3e1 tempest-VolumesTransfersTest-105064299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (651890ca-edf8-4912-849b-4259f3032551) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e513b03c-874d-45e5-a9d8-1a68bb2aea94', 'volume_name': 'volume-e513b03c-874d-45e5-a9d8-1a68bb2aea94', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:22:39 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-514ffe91-9b95-49eb-9e69-67777da8c3e1 tempest-VolumesTransfersTest-105064299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1ecddd6-ebc7-4117-8138-09cc6326a1b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:22:39 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-514ffe91-9b95-49eb-9e69-67777da8c3e1 tempest-VolumesTransfersTest-105064299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1ecddd6-ebc7-4117-8138-09cc6326a1b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:22:39 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-514ffe91-9b95-49eb-9e69-67777da8c3e1 tempest-VolumesTransfersTest-105064299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa821bf6-3fe4-4bbc-99be-83dd201e9dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:22:39 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-514ffe91-9b95-49eb-9e69-67777da8c3e1 tempest-VolumesTransfersTest-105064299 None] Volume e513b03c-874d-45e5-a9d8-1a68bb2aea94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e513b03c-874d-45e5-a9d8-1a68bb2aea94', 'volume_size': 1} Apr 29 15:22:39 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-514ffe91-9b95-49eb-9e69-67777da8c3e1 tempest-VolumesTransfersTest-105064299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:22:39 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-514ffe91-9b95-49eb-9e69-67777da8c3e1 tempest-VolumesTransfersTest-105064299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:22:39 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-514ffe91-9b95-49eb-9e69-67777da8c3e1 tempest-VolumesTransfersTest-105064299 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:22:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1405159858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e513b03c-874d-45e5-a9d8-1a68bb2aea94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85f9456484a24a16af8a6c2b27ca5782',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:22:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:22:39Z,use_quota=True,user_id='38ccf73399c644fd98a61dd22214e20d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:22:39 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-514ffe91-9b95-49eb-9e69-67777da8c3e1 tempest-VolumesTransfersTest-105064299 None] Creating volume e513b03c-874d-45e5-a9d8-1a68bb2aea94 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:22:39 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-514ffe91-9b95-49eb-9e69-67777da8c3e1 tempest-VolumesTransfersTest-105064299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:22:39 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-514ffe91-9b95-49eb-9e69-67777da8c3e1 tempest-VolumesTransfersTest-105064299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:22:39 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-514ffe91-9b95-49eb-9e69-67777da8c3e1 tempest-VolumesTransfersTest-105064299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:22:39 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-514ffe91-9b95-49eb-9e69-67777da8c3e1 tempest-VolumesTransfersTest-105064299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:22:39 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-514ffe91-9b95-49eb-9e69-67777da8c3e1 tempest-VolumesTransfersTest-105064299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:22:39 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-514ffe91-9b95-49eb-9e69-67777da8c3e1 tempest-VolumesTransfersTest-105064299 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:22:39 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-514ffe91-9b95-49eb-9e69-67777da8c3e1 tempest-VolumesTransfersTest-105064299 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:22:39 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-514ffe91-9b95-49eb-9e69-67777da8c3e1 tempest-VolumesTransfersTest-105064299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-e513b03c-874d-45e5-a9d8-1a68bb2aea94 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:22:39 devstack sudo[102615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-e513b03c-874d-45e5-a9d8-1a68bb2aea94 1073741824 Apr 29 15:22:39 devstack sudo[102615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:22:39 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-6d50e1f3-30f9-476d-9aad-14be5d0368cb req-7e258e4c-ba7d-48d4-8adb-5994c14d1ed1 tempest-TestServerVolumeAttachmentScenario-2002744384 None] Terminate volume connection completed successfully. Apr 29 15:22:39 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-6d50e1f3-30f9-476d-9aad-14be5d0368cb req-7e258e4c-ba7d-48d4-8adb-5994c14d1ed1 tempest-TestServerVolumeAttachmentScenario-2002744384 None] Deleting attachment 4e1516c8-21d4-469b-b3f3-4b710901c151. {{(pid=84448) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 15:22:40 devstack sudo[102615]: pam_unix(sudo:session): session closed for user root Apr 29 15:22:40 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-514ffe91-9b95-49eb-9e69-67777da8c3e1 tempest-VolumesTransfersTest-105064299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-e513b03c-874d-45e5-a9d8-1a68bb2aea94 1073741824" returned: 0 in 0.991s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:22:40 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-514ffe91-9b95-49eb-9e69-67777da8c3e1 tempest-VolumesTransfersTest-105064299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-e513b03c-874d-45e5-a9d8-1a68bb2aea94 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:22:40 devstack sudo[102624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-e513b03c-874d-45e5-a9d8-1a68bb2aea94 Apr 29 15:22:40 devstack sudo[102624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:22:40 devstack sudo[102624]: pam_unix(sudo:session): session closed for user root Apr 29 15:22:40 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-514ffe91-9b95-49eb-9e69-67777da8c3e1 tempest-VolumesTransfersTest-105064299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-e513b03c-874d-45e5-a9d8-1a68bb2aea94" returned: 0 in 0.658s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:22:40 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-514ffe91-9b95-49eb-9e69-67777da8c3e1 tempest-VolumesTransfersTest-105064299 None] <== create_volume: return (1693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:22:40 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-514ffe91-9b95-49eb-9e69-67777da8c3e1 tempest-VolumesTransfersTest-105064299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.696s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:22:40 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-514ffe91-9b95-49eb-9e69-67777da8c3e1 tempest-VolumesTransfersTest-105064299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa821bf6-3fe4-4bbc-99be-83dd201e9dbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e513b03c-874d-45e5-a9d8-1a68bb2aea94', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:22:40 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-514ffe91-9b95-49eb-9e69-67777da8c3e1 tempest-VolumesTransfersTest-105064299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e858c836-7cda-427b-925a-005b6a369554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:22:40 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-514ffe91-9b95-49eb-9e69-67777da8c3e1 tempest-VolumesTransfersTest-105064299 None] Volume volume-e513b03c-874d-45e5-a9d8-1a68bb2aea94 (e513b03c-874d-45e5-a9d8-1a68bb2aea94): created successfully Apr 29 15:22:40 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-514ffe91-9b95-49eb-9e69-67777da8c3e1 tempest-VolumesTransfersTest-105064299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e858c836-7cda-427b-925a-005b6a369554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:22:40 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-514ffe91-9b95-49eb-9e69-67777da8c3e1 tempest-VolumesTransfersTest-105064299 None] Flow 'volume_create_manager' (80bb387e-d241-4c63-aa62-4043bf3301fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:22:40 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-514ffe91-9b95-49eb-9e69-67777da8c3e1 tempest-VolumesTransfersTest-105064299 None] Created volume successfully. Apr 29 15:22:41 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-3dea65d9-3954-4649-8a6d-76b5ac55a990 tempest-VolumesTransfersTest-970696453 None] Transfer volume completed successfully. Apr 29 15:22:43 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-34e0acbd-d9cb-422a-90f4-c99ddbd3df5b tempest-VolumesTransfersTest-771495425 None] Acquiring lock "cinder-e513b03c-874d-45e5-a9d8-1a68bb2aea94-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:22:43 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-34e0acbd-d9cb-422a-90f4-c99ddbd3df5b tempest-VolumesTransfersTest-771495425 None] Lock "cinder-e513b03c-874d-45e5-a9d8-1a68bb2aea94-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:22:43 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-34e0acbd-d9cb-422a-90f4-c99ddbd3df5b tempest-VolumesTransfersTest-771495425 None] Acquiring lock "cinder-quobyte-e513b03c-874d-45e5-a9d8-1a68bb2aea94" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:22:43 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-34e0acbd-d9cb-422a-90f4-c99ddbd3df5b tempest-VolumesTransfersTest-771495425 None] Lock "cinder-quobyte-e513b03c-874d-45e5-a9d8-1a68bb2aea94" acquired by "delete_volume" :: waited 0.032s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:22:43 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfffdb25-0401-4cdc-a07b-d41d88f06e98]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:22:43 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-34e0acbd-d9cb-422a-90f4-c99ddbd3df5b tempest-VolumesTransfersTest-771495425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-e513b03c-874d-45e5-a9d8-1a68bb2aea94 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:22:43 devstack sudo[102653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-e513b03c-874d-45e5-a9d8-1a68bb2aea94 Apr 29 15:22:43 devstack sudo[102653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:22:43 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-99c5d793-e6f8-472c-8b6a-8f3d303e5040 req-e0f0a93f-4513-4a62-a65a-3db790bc98f6 tempest-TestServerVolumeAttachmentScenario-2002744384 None] Terminate volume connection completed successfully. Apr 29 15:22:43 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-99c5d793-e6f8-472c-8b6a-8f3d303e5040 req-e0f0a93f-4513-4a62-a65a-3db790bc98f6 tempest-TestServerVolumeAttachmentScenario-2002744384 None] Deleting attachment 9bc8e7f2-5d42-462d-acf3-6197ad5ed387. {{(pid=84448) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 15:22:43 devstack sudo[102653]: pam_unix(sudo:session): session closed for user root Apr 29 15:22:43 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-34e0acbd-d9cb-422a-90f4-c99ddbd3df5b tempest-VolumesTransfersTest-771495425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-e513b03c-874d-45e5-a9d8-1a68bb2aea94" returned: 0 in 0.798s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:22:43 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-34e0acbd-d9cb-422a-90f4-c99ddbd3df5b tempest-VolumesTransfersTest-771495425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-e513b03c-874d-45e5-a9d8-1a68bb2aea94 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:22:44 devstack sudo[102662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-e513b03c-874d-45e5-a9d8-1a68bb2aea94 Apr 29 15:22:44 devstack sudo[102662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:22:44 devstack sudo[102662]: pam_unix(sudo:session): session closed for user root Apr 29 15:22:44 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-34e0acbd-d9cb-422a-90f4-c99ddbd3df5b tempest-VolumesTransfersTest-771495425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-e513b03c-874d-45e5-a9d8-1a68bb2aea94" returned: 0 in 0.732s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:22:44 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-34e0acbd-d9cb-422a-90f4-c99ddbd3df5b tempest-VolumesTransfersTest-771495425 None] Lock "cinder-quobyte-e513b03c-874d-45e5-a9d8-1a68bb2aea94" released by "delete_volume" :: held 1.579s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:22:44 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-34e0acbd-d9cb-422a-90f4-c99ddbd3df5b tempest-VolumesTransfersTest-771495425 None] Created reservations ['53e2be13-aa9f-4611-aaa7-2868cd18d8ab', '94c4b6e9-be07-4836-90da-3d56aa8ea2fb', 'addf261d-0d23-44b2-ad31-50e8b57a1f9a', 'a8c55635-34a4-4d2c-9b10-1c18ba127e2e'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:22:44 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-34e0acbd-d9cb-422a-90f4-c99ddbd3df5b tempest-VolumesTransfersTest-771495425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:22:44 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-34e0acbd-d9cb-422a-90f4-c99ddbd3df5b tempest-VolumesTransfersTest-771495425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:22:44 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-34e0acbd-d9cb-422a-90f4-c99ddbd3df5b tempest-VolumesTransfersTest-771495425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:22:44 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-34e0acbd-d9cb-422a-90f4-c99ddbd3df5b tempest-VolumesTransfersTest-771495425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:22:44 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-34e0acbd-d9cb-422a-90f4-c99ddbd3df5b tempest-VolumesTransfersTest-771495425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:22:44 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-34e0acbd-d9cb-422a-90f4-c99ddbd3df5b tempest-VolumesTransfersTest-771495425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:22:44 devstack sudo[102666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:22:44 devstack sudo[102666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:22:45 devstack sudo[102666]: pam_unix(sudo:session): session closed for user root Apr 29 15:22:45 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-34e0acbd-d9cb-422a-90f4-c99ddbd3df5b tempest-VolumesTransfersTest-771495425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.710s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:22:45 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-34e0acbd-d9cb-422a-90f4-c99ddbd3df5b tempest-VolumesTransfersTest-771495425 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:22:45 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-34e0acbd-d9cb-422a-90f4-c99ddbd3df5b tempest-VolumesTransfersTest-771495425 None] Deleted volume successfully. Apr 29 15:22:45 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-34e0acbd-d9cb-422a-90f4-c99ddbd3df5b tempest-VolumesTransfersTest-771495425 None] Lock "cinder-e513b03c-874d-45e5-a9d8-1a68bb2aea94-delete_volume" released by "delete_volume" :: held 2.554s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:22:45 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-c319cfdf-9f5c-4c30-9fe9-6b7774e295d7 tempest-VolumesTransfersTest-105064299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:22:45 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c319cfdf-9f5c-4c30-9fe9-6b7774e295d7 tempest-VolumesTransfersTest-105064299 None] Flow 'volume_create_manager' (b251e82c-5070-4816-842d-4693db8d1d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:22:45 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c319cfdf-9f5c-4c30-9fe9-6b7774e295d7 tempest-VolumesTransfersTest-105064299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b06e566-8b54-4580-8827-c65f528cd948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:22:45 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c319cfdf-9f5c-4c30-9fe9-6b7774e295d7 tempest-VolumesTransfersTest-105064299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b06e566-8b54-4580-8827-c65f528cd948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:22:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1842245924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce03aed6-8360-44bc-a85c-1f5552d0175b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85f9456484a24a16af8a6c2b27ca5782',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:22:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:22:46Z,use_quota=True,user_id='38ccf73399c644fd98a61dd22214e20d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:22:45 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c319cfdf-9f5c-4c30-9fe9-6b7774e295d7 tempest-VolumesTransfersTest-105064299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b743cfe3-7c69-4fa1-ba0f-e732efff2b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:22:45 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c319cfdf-9f5c-4c30-9fe9-6b7774e295d7 tempest-VolumesTransfersTest-105064299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b743cfe3-7c69-4fa1-ba0f-e732efff2b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:22:45 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c319cfdf-9f5c-4c30-9fe9-6b7774e295d7 tempest-VolumesTransfersTest-105064299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f32de952-8a10-4526-8fd4-94d196cd71b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:22:45 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c319cfdf-9f5c-4c30-9fe9-6b7774e295d7 tempest-VolumesTransfersTest-105064299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f32de952-8a10-4526-8fd4-94d196cd71b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce03aed6-8360-44bc-a85c-1f5552d0175b', 'volume_name': 'volume-ce03aed6-8360-44bc-a85c-1f5552d0175b', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:22:45 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c319cfdf-9f5c-4c30-9fe9-6b7774e295d7 tempest-VolumesTransfersTest-105064299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f610fdf2-5d9f-46a8-a06c-58c4a9260111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:22:45 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c319cfdf-9f5c-4c30-9fe9-6b7774e295d7 tempest-VolumesTransfersTest-105064299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f610fdf2-5d9f-46a8-a06c-58c4a9260111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:22:45 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c319cfdf-9f5c-4c30-9fe9-6b7774e295d7 tempest-VolumesTransfersTest-105064299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f741ef29-71b8-40fe-a247-adc714ebe931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:22:45 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-c319cfdf-9f5c-4c30-9fe9-6b7774e295d7 tempest-VolumesTransfersTest-105064299 None] Volume ce03aed6-8360-44bc-a85c-1f5552d0175b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce03aed6-8360-44bc-a85c-1f5552d0175b', 'volume_size': 1} Apr 29 15:22:45 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-c319cfdf-9f5c-4c30-9fe9-6b7774e295d7 tempest-VolumesTransfersTest-105064299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:22:45 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-c319cfdf-9f5c-4c30-9fe9-6b7774e295d7 tempest-VolumesTransfersTest-105064299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:22:45 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-c319cfdf-9f5c-4c30-9fe9-6b7774e295d7 tempest-VolumesTransfersTest-105064299 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:22:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1842245924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce03aed6-8360-44bc-a85c-1f5552d0175b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85f9456484a24a16af8a6c2b27ca5782',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:22:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:22:46Z,use_quota=True,user_id='38ccf73399c644fd98a61dd22214e20d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:22:45 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-c319cfdf-9f5c-4c30-9fe9-6b7774e295d7 tempest-VolumesTransfersTest-105064299 None] Creating volume ce03aed6-8360-44bc-a85c-1f5552d0175b {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:22:45 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-c319cfdf-9f5c-4c30-9fe9-6b7774e295d7 tempest-VolumesTransfersTest-105064299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:22:45 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-c319cfdf-9f5c-4c30-9fe9-6b7774e295d7 tempest-VolumesTransfersTest-105064299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:22:46 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-c319cfdf-9f5c-4c30-9fe9-6b7774e295d7 tempest-VolumesTransfersTest-105064299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:22:46 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-c319cfdf-9f5c-4c30-9fe9-6b7774e295d7 tempest-VolumesTransfersTest-105064299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:22:46 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-c319cfdf-9f5c-4c30-9fe9-6b7774e295d7 tempest-VolumesTransfersTest-105064299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:22:46 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-c319cfdf-9f5c-4c30-9fe9-6b7774e295d7 tempest-VolumesTransfersTest-105064299 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:22:46 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-c319cfdf-9f5c-4c30-9fe9-6b7774e295d7 tempest-VolumesTransfersTest-105064299 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:22:46 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c319cfdf-9f5c-4c30-9fe9-6b7774e295d7 tempest-VolumesTransfersTest-105064299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ce03aed6-8360-44bc-a85c-1f5552d0175b 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:22:46 devstack sudo[102671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ce03aed6-8360-44bc-a85c-1f5552d0175b 1073741824 Apr 29 15:22:46 devstack sudo[102671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:22:47 devstack sudo[102671]: pam_unix(sudo:session): session closed for user root Apr 29 15:22:47 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c319cfdf-9f5c-4c30-9fe9-6b7774e295d7 tempest-VolumesTransfersTest-105064299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ce03aed6-8360-44bc-a85c-1f5552d0175b 1073741824" returned: 0 in 1.043s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:22:47 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c319cfdf-9f5c-4c30-9fe9-6b7774e295d7 tempest-VolumesTransfersTest-105064299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ce03aed6-8360-44bc-a85c-1f5552d0175b {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:22:47 devstack sudo[102726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ce03aed6-8360-44bc-a85c-1f5552d0175b Apr 29 15:22:47 devstack sudo[102726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:22:47 devstack sudo[102726]: pam_unix(sudo:session): session closed for user root Apr 29 15:22:47 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c319cfdf-9f5c-4c30-9fe9-6b7774e295d7 tempest-VolumesTransfersTest-105064299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ce03aed6-8360-44bc-a85c-1f5552d0175b" returned: 0 in 0.672s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:22:47 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-c319cfdf-9f5c-4c30-9fe9-6b7774e295d7 tempest-VolumesTransfersTest-105064299 None] <== create_volume: return (1774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:22:47 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-c319cfdf-9f5c-4c30-9fe9-6b7774e295d7 tempest-VolumesTransfersTest-105064299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.776s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:22:47 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c319cfdf-9f5c-4c30-9fe9-6b7774e295d7 tempest-VolumesTransfersTest-105064299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f741ef29-71b8-40fe-a247-adc714ebe931) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce03aed6-8360-44bc-a85c-1f5552d0175b', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:22:47 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c319cfdf-9f5c-4c30-9fe9-6b7774e295d7 tempest-VolumesTransfersTest-105064299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b39bf7a2-e036-46f1-93bd-a43d9cb39fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:22:47 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-c319cfdf-9f5c-4c30-9fe9-6b7774e295d7 tempest-VolumesTransfersTest-105064299 None] Volume volume-ce03aed6-8360-44bc-a85c-1f5552d0175b (ce03aed6-8360-44bc-a85c-1f5552d0175b): created successfully Apr 29 15:22:47 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c319cfdf-9f5c-4c30-9fe9-6b7774e295d7 tempest-VolumesTransfersTest-105064299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b39bf7a2-e036-46f1-93bd-a43d9cb39fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:22:47 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c319cfdf-9f5c-4c30-9fe9-6b7774e295d7 tempest-VolumesTransfersTest-105064299 None] Flow 'volume_create_manager' (b251e82c-5070-4816-842d-4693db8d1d7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:22:47 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-c319cfdf-9f5c-4c30-9fe9-6b7774e295d7 tempest-VolumesTransfersTest-105064299 None] Created volume successfully. Apr 29 15:22:48 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-c0bfa18c-addd-4661-96bd-b27ff138c7a7 tempest-VolumesTransfersTest-771495425 None] Acquiring lock "cinder-ce03aed6-8360-44bc-a85c-1f5552d0175b-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:22:48 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-c0bfa18c-addd-4661-96bd-b27ff138c7a7 tempest-VolumesTransfersTest-771495425 None] Lock "cinder-ce03aed6-8360-44bc-a85c-1f5552d0175b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:22:48 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-c0bfa18c-addd-4661-96bd-b27ff138c7a7 tempest-VolumesTransfersTest-771495425 None] Acquiring lock "cinder-quobyte-ce03aed6-8360-44bc-a85c-1f5552d0175b" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:22:48 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-c0bfa18c-addd-4661-96bd-b27ff138c7a7 tempest-VolumesTransfersTest-771495425 None] Lock "cinder-quobyte-ce03aed6-8360-44bc-a85c-1f5552d0175b" acquired by "delete_volume" :: waited 0.033s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:22:48 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ffcb26-4699-447c-96b4-b91eb4771c05]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:22:48 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c0bfa18c-addd-4661-96bd-b27ff138c7a7 tempest-VolumesTransfersTest-771495425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ce03aed6-8360-44bc-a85c-1f5552d0175b {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:22:48 devstack sudo[102734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ce03aed6-8360-44bc-a85c-1f5552d0175b Apr 29 15:22:48 devstack sudo[102734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:22:48 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-bae52066-93a7-4d14-90ca-d29782a1cabd tempest-VolumesListAdminTestJSON-79163490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:22:48 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-bae52066-93a7-4d14-90ca-d29782a1cabd tempest-VolumesListAdminTestJSON-79163490 None] Flow 'volume_create_manager' (055f2eea-6332-4969-a3cc-a4238be7e983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:22:48 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-bae52066-93a7-4d14-90ca-d29782a1cabd tempest-VolumesListAdminTestJSON-79163490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37ff1c43-5939-4776-8571-05188b50c35c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:22:48 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-bae52066-93a7-4d14-90ca-d29782a1cabd tempest-VolumesListAdminTestJSON-79163490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37ff1c43-5939-4776-8571-05188b50c35c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:22:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1138341183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7427f07-c99f-40a6-a6be-d566622a5e48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e81ca5d83e524540983125af5926d28d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:22:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:22:49Z,use_quota=True,user_id='37305a4bc2514434b732ee790d7f91e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:22:48 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-bae52066-93a7-4d14-90ca-d29782a1cabd tempest-VolumesListAdminTestJSON-79163490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (384662c9-ef9a-4cac-a21b-183f53b93391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:22:48 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-bae52066-93a7-4d14-90ca-d29782a1cabd tempest-VolumesListAdminTestJSON-79163490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (384662c9-ef9a-4cac-a21b-183f53b93391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:22:49 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-bae52066-93a7-4d14-90ca-d29782a1cabd tempest-VolumesListAdminTestJSON-79163490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a830c45a-ce90-4b1e-9268-d035091c645b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:22:49 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-bae52066-93a7-4d14-90ca-d29782a1cabd tempest-VolumesListAdminTestJSON-79163490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a830c45a-ce90-4b1e-9268-d035091c645b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7427f07-c99f-40a6-a6be-d566622a5e48', 'volume_name': 'volume-d7427f07-c99f-40a6-a6be-d566622a5e48', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:22:49 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-bae52066-93a7-4d14-90ca-d29782a1cabd tempest-VolumesListAdminTestJSON-79163490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc69fdac-b631-4ac9-a135-d5963590891a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:22:49 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-bae52066-93a7-4d14-90ca-d29782a1cabd tempest-VolumesListAdminTestJSON-79163490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc69fdac-b631-4ac9-a135-d5963590891a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:22:49 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-bae52066-93a7-4d14-90ca-d29782a1cabd tempest-VolumesListAdminTestJSON-79163490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d04969a-6a11-47af-a9c6-00ae935e4797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:22:49 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-bae52066-93a7-4d14-90ca-d29782a1cabd tempest-VolumesListAdminTestJSON-79163490 None] Volume d7427f07-c99f-40a6-a6be-d566622a5e48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7427f07-c99f-40a6-a6be-d566622a5e48', 'volume_size': 1} Apr 29 15:22:49 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-bae52066-93a7-4d14-90ca-d29782a1cabd tempest-VolumesListAdminTestJSON-79163490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:22:49 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-bae52066-93a7-4d14-90ca-d29782a1cabd tempest-VolumesListAdminTestJSON-79163490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:22:49 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-bae52066-93a7-4d14-90ca-d29782a1cabd tempest-VolumesListAdminTestJSON-79163490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:22:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1138341183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7427f07-c99f-40a6-a6be-d566622a5e48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e81ca5d83e524540983125af5926d28d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:22:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:22:49Z,use_quota=True,user_id='37305a4bc2514434b732ee790d7f91e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:22:49 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-bae52066-93a7-4d14-90ca-d29782a1cabd tempest-VolumesListAdminTestJSON-79163490 None] Creating volume d7427f07-c99f-40a6-a6be-d566622a5e48 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:22:49 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-bae52066-93a7-4d14-90ca-d29782a1cabd tempest-VolumesListAdminTestJSON-79163490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:22:49 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-bae52066-93a7-4d14-90ca-d29782a1cabd tempest-VolumesListAdminTestJSON-79163490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:22:49 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-bae52066-93a7-4d14-90ca-d29782a1cabd tempest-VolumesListAdminTestJSON-79163490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:22:49 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-bae52066-93a7-4d14-90ca-d29782a1cabd tempest-VolumesListAdminTestJSON-79163490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:22:49 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-bae52066-93a7-4d14-90ca-d29782a1cabd tempest-VolumesListAdminTestJSON-79163490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:22:49 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-bae52066-93a7-4d14-90ca-d29782a1cabd tempest-VolumesListAdminTestJSON-79163490 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:22:49 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-bae52066-93a7-4d14-90ca-d29782a1cabd tempest-VolumesListAdminTestJSON-79163490 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:22:49 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-bae52066-93a7-4d14-90ca-d29782a1cabd tempest-VolumesListAdminTestJSON-79163490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d7427f07-c99f-40a6-a6be-d566622a5e48 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:22:49 devstack sudo[102737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d7427f07-c99f-40a6-a6be-d566622a5e48 1073741824 Apr 29 15:22:49 devstack sudo[102737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:22:49 devstack sudo[102734]: pam_unix(sudo:session): session closed for user root Apr 29 15:22:49 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c0bfa18c-addd-4661-96bd-b27ff138c7a7 tempest-VolumesTransfersTest-771495425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ce03aed6-8360-44bc-a85c-1f5552d0175b" returned: 0 in 0.912s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:22:49 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c0bfa18c-addd-4661-96bd-b27ff138c7a7 tempest-VolumesTransfersTest-771495425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ce03aed6-8360-44bc-a85c-1f5552d0175b {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:22:49 devstack sudo[102743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ce03aed6-8360-44bc-a85c-1f5552d0175b Apr 29 15:22:49 devstack sudo[102743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:22:49 devstack sudo[102737]: pam_unix(sudo:session): session closed for user root Apr 29 15:22:49 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-bae52066-93a7-4d14-90ca-d29782a1cabd tempest-VolumesListAdminTestJSON-79163490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d7427f07-c99f-40a6-a6be-d566622a5e48 1073741824" returned: 0 in 0.953s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:22:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-bae52066-93a7-4d14-90ca-d29782a1cabd tempest-VolumesListAdminTestJSON-79163490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d7427f07-c99f-40a6-a6be-d566622a5e48 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:22:50 devstack sudo[102749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d7427f07-c99f-40a6-a6be-d566622a5e48 Apr 29 15:22:50 devstack sudo[102749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:22:50 devstack sudo[102743]: pam_unix(sudo:session): session closed for user root Apr 29 15:22:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c0bfa18c-addd-4661-96bd-b27ff138c7a7 tempest-VolumesTransfersTest-771495425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ce03aed6-8360-44bc-a85c-1f5552d0175b" returned: 0 in 0.698s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:22:50 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-c0bfa18c-addd-4661-96bd-b27ff138c7a7 tempest-VolumesTransfersTest-771495425 None] Lock "cinder-quobyte-ce03aed6-8360-44bc-a85c-1f5552d0175b" released by "delete_volume" :: held 1.661s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:22:50 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-c0bfa18c-addd-4661-96bd-b27ff138c7a7 tempest-VolumesTransfersTest-771495425 None] Created reservations ['f837100b-13f8-4754-84fe-02d5e6361cc7', 'ded94ff9-1783-4c4d-a36d-5320b7aed1c9', '2340aeea-6b37-4d0e-817f-43b735024eed', '6c5c8c1e-0dbe-4259-ab3f-89b675380932'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:22:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-c0bfa18c-addd-4661-96bd-b27ff138c7a7 tempest-VolumesTransfersTest-771495425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:22:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-c0bfa18c-addd-4661-96bd-b27ff138c7a7 tempest-VolumesTransfersTest-771495425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:22:50 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-c0bfa18c-addd-4661-96bd-b27ff138c7a7 tempest-VolumesTransfersTest-771495425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:22:50 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-c0bfa18c-addd-4661-96bd-b27ff138c7a7 tempest-VolumesTransfersTest-771495425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:22:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-c0bfa18c-addd-4661-96bd-b27ff138c7a7 tempest-VolumesTransfersTest-771495425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:22:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c0bfa18c-addd-4661-96bd-b27ff138c7a7 tempest-VolumesTransfersTest-771495425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:22:50 devstack sudo[102752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:22:50 devstack sudo[102752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:22:50 devstack sudo[102749]: pam_unix(sudo:session): session closed for user root Apr 29 15:22:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-bae52066-93a7-4d14-90ca-d29782a1cabd tempest-VolumesListAdminTestJSON-79163490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d7427f07-c99f-40a6-a6be-d566622a5e48" returned: 0 in 0.608s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:22:50 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-bae52066-93a7-4d14-90ca-d29782a1cabd tempest-VolumesListAdminTestJSON-79163490 None] <== create_volume: return (1603ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:22:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-bae52066-93a7-4d14-90ca-d29782a1cabd tempest-VolumesListAdminTestJSON-79163490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.608s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:22:50 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-bae52066-93a7-4d14-90ca-d29782a1cabd tempest-VolumesListAdminTestJSON-79163490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d04969a-6a11-47af-a9c6-00ae935e4797) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7427f07-c99f-40a6-a6be-d566622a5e48', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:22:50 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-bae52066-93a7-4d14-90ca-d29782a1cabd tempest-VolumesListAdminTestJSON-79163490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (815284d2-c130-4f3c-80ae-4255a7fc9684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:22:50 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-bae52066-93a7-4d14-90ca-d29782a1cabd tempest-VolumesListAdminTestJSON-79163490 None] Volume volume-d7427f07-c99f-40a6-a6be-d566622a5e48 (d7427f07-c99f-40a6-a6be-d566622a5e48): created successfully Apr 29 15:22:50 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-bae52066-93a7-4d14-90ca-d29782a1cabd tempest-VolumesListAdminTestJSON-79163490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (815284d2-c130-4f3c-80ae-4255a7fc9684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:22:50 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-bae52066-93a7-4d14-90ca-d29782a1cabd tempest-VolumesListAdminTestJSON-79163490 None] Flow 'volume_create_manager' (055f2eea-6332-4969-a3cc-a4238be7e983) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:22:50 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-bae52066-93a7-4d14-90ca-d29782a1cabd tempest-VolumesListAdminTestJSON-79163490 None] Created volume successfully. Apr 29 15:22:50 devstack sudo[102752]: pam_unix(sudo:session): session closed for user root Apr 29 15:22:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c0bfa18c-addd-4661-96bd-b27ff138c7a7 tempest-VolumesTransfersTest-771495425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.669s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:22:50 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-c0bfa18c-addd-4661-96bd-b27ff138c7a7 tempest-VolumesTransfersTest-771495425 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:22:50 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-c0bfa18c-addd-4661-96bd-b27ff138c7a7 tempest-VolumesTransfersTest-771495425 None] Deleted volume successfully. Apr 29 15:22:51 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-c0bfa18c-addd-4661-96bd-b27ff138c7a7 tempest-VolumesTransfersTest-771495425 None] Lock "cinder-ce03aed6-8360-44bc-a85c-1f5552d0175b-delete_volume" released by "delete_volume" :: held 2.581s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:22:51 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb84da52-5e33-4f83-8f2f-d7851620be36 tempest-VolumesListAdminTestJSON-79163490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:22:51 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cb84da52-5e33-4f83-8f2f-d7851620be36 tempest-VolumesListAdminTestJSON-79163490 None] Flow 'volume_create_manager' (44580934-759f-4c02-b7ff-a65da7376e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:22:51 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cb84da52-5e33-4f83-8f2f-d7851620be36 tempest-VolumesListAdminTestJSON-79163490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c57d1094-9b90-4e4c-a58d-2313e82f0261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:22:51 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cb84da52-5e33-4f83-8f2f-d7851620be36 tempest-VolumesListAdminTestJSON-79163490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c57d1094-9b90-4e4c-a58d-2313e82f0261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:22:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1742160597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd3a0807-cbc2-4268-aefc-483d2d963af1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e81ca5d83e524540983125af5926d28d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:22:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:22:52Z,use_quota=True,user_id='37305a4bc2514434b732ee790d7f91e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:22:51 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cb84da52-5e33-4f83-8f2f-d7851620be36 tempest-VolumesListAdminTestJSON-79163490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97cd8c45-472c-4182-9bf1-394aaf45a289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:22:51 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cb84da52-5e33-4f83-8f2f-d7851620be36 tempest-VolumesListAdminTestJSON-79163490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97cd8c45-472c-4182-9bf1-394aaf45a289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:22:51 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cb84da52-5e33-4f83-8f2f-d7851620be36 tempest-VolumesListAdminTestJSON-79163490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (929de5a8-476d-4b19-97f9-7c7d4c7ac949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:22:51 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cb84da52-5e33-4f83-8f2f-d7851620be36 tempest-VolumesListAdminTestJSON-79163490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (929de5a8-476d-4b19-97f9-7c7d4c7ac949) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd3a0807-cbc2-4268-aefc-483d2d963af1', 'volume_name': 'volume-cd3a0807-cbc2-4268-aefc-483d2d963af1', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:22:51 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cb84da52-5e33-4f83-8f2f-d7851620be36 tempest-VolumesListAdminTestJSON-79163490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0798b33e-f73f-4439-b680-264670738990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:22:51 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cb84da52-5e33-4f83-8f2f-d7851620be36 tempest-VolumesListAdminTestJSON-79163490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0798b33e-f73f-4439-b680-264670738990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:22:51 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cb84da52-5e33-4f83-8f2f-d7851620be36 tempest-VolumesListAdminTestJSON-79163490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (543231ad-431b-4c21-ae5c-a64528c7f930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:22:51 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-cb84da52-5e33-4f83-8f2f-d7851620be36 tempest-VolumesListAdminTestJSON-79163490 None] Volume cd3a0807-cbc2-4268-aefc-483d2d963af1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd3a0807-cbc2-4268-aefc-483d2d963af1', 'volume_size': 1} Apr 29 15:22:51 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-cb84da52-5e33-4f83-8f2f-d7851620be36 tempest-VolumesListAdminTestJSON-79163490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:22:51 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-cb84da52-5e33-4f83-8f2f-d7851620be36 tempest-VolumesListAdminTestJSON-79163490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:22:51 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-cb84da52-5e33-4f83-8f2f-d7851620be36 tempest-VolumesListAdminTestJSON-79163490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:22:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1742160597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd3a0807-cbc2-4268-aefc-483d2d963af1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e81ca5d83e524540983125af5926d28d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:22:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:22:52Z,use_quota=True,user_id='37305a4bc2514434b732ee790d7f91e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:22:51 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-cb84da52-5e33-4f83-8f2f-d7851620be36 tempest-VolumesListAdminTestJSON-79163490 None] Creating volume cd3a0807-cbc2-4268-aefc-483d2d963af1 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:22:51 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-cb84da52-5e33-4f83-8f2f-d7851620be36 tempest-VolumesListAdminTestJSON-79163490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:22:51 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-cb84da52-5e33-4f83-8f2f-d7851620be36 tempest-VolumesListAdminTestJSON-79163490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:22:51 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-cb84da52-5e33-4f83-8f2f-d7851620be36 tempest-VolumesListAdminTestJSON-79163490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:22:51 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-cb84da52-5e33-4f83-8f2f-d7851620be36 tempest-VolumesListAdminTestJSON-79163490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:22:51 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-cb84da52-5e33-4f83-8f2f-d7851620be36 tempest-VolumesListAdminTestJSON-79163490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:22:51 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-cb84da52-5e33-4f83-8f2f-d7851620be36 tempest-VolumesListAdminTestJSON-79163490 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:22:51 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-cb84da52-5e33-4f83-8f2f-d7851620be36 tempest-VolumesListAdminTestJSON-79163490 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:22:51 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cb84da52-5e33-4f83-8f2f-d7851620be36 tempest-VolumesListAdminTestJSON-79163490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cd3a0807-cbc2-4268-aefc-483d2d963af1 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:22:51 devstack sudo[102756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cd3a0807-cbc2-4268-aefc-483d2d963af1 1073741824 Apr 29 15:22:51 devstack sudo[102756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:22:52 devstack sudo[102756]: pam_unix(sudo:session): session closed for user root Apr 29 15:22:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cb84da52-5e33-4f83-8f2f-d7851620be36 tempest-VolumesListAdminTestJSON-79163490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cd3a0807-cbc2-4268-aefc-483d2d963af1 1073741824" returned: 0 in 0.861s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:22:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cb84da52-5e33-4f83-8f2f-d7851620be36 tempest-VolumesListAdminTestJSON-79163490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cd3a0807-cbc2-4268-aefc-483d2d963af1 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:22:52 devstack sudo[102763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cd3a0807-cbc2-4268-aefc-483d2d963af1 Apr 29 15:22:52 devstack sudo[102763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:22:53 devstack sudo[102763]: pam_unix(sudo:session): session closed for user root Apr 29 15:22:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cb84da52-5e33-4f83-8f2f-d7851620be36 tempest-VolumesListAdminTestJSON-79163490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cd3a0807-cbc2-4268-aefc-483d2d963af1" returned: 0 in 0.701s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:22:53 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-cb84da52-5e33-4f83-8f2f-d7851620be36 tempest-VolumesListAdminTestJSON-79163490 None] <== create_volume: return (1608ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:22:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-cb84da52-5e33-4f83-8f2f-d7851620be36 tempest-VolumesListAdminTestJSON-79163490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.610s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:22:53 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cb84da52-5e33-4f83-8f2f-d7851620be36 tempest-VolumesListAdminTestJSON-79163490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (543231ad-431b-4c21-ae5c-a64528c7f930) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd3a0807-cbc2-4268-aefc-483d2d963af1', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:22:53 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cb84da52-5e33-4f83-8f2f-d7851620be36 tempest-VolumesListAdminTestJSON-79163490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d233260-9587-4d25-98c1-50176e1e0aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:22:53 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-cb84da52-5e33-4f83-8f2f-d7851620be36 tempest-VolumesListAdminTestJSON-79163490 None] Volume volume-cd3a0807-cbc2-4268-aefc-483d2d963af1 (cd3a0807-cbc2-4268-aefc-483d2d963af1): created successfully Apr 29 15:22:53 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cb84da52-5e33-4f83-8f2f-d7851620be36 tempest-VolumesListAdminTestJSON-79163490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d233260-9587-4d25-98c1-50176e1e0aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:22:53 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cb84da52-5e33-4f83-8f2f-d7851620be36 tempest-VolumesListAdminTestJSON-79163490 None] Flow 'volume_create_manager' (44580934-759f-4c02-b7ff-a65da7376e25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:22:53 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-cb84da52-5e33-4f83-8f2f-d7851620be36 tempest-VolumesListAdminTestJSON-79163490 None] Created volume successfully. Apr 29 15:22:54 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-704f61df-b266-4028-b729-f0dbff18f389 tempest-VolumesListAdminTestJSON-79163490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:22:54 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-704f61df-b266-4028-b729-f0dbff18f389 tempest-VolumesListAdminTestJSON-79163490 None] Flow 'volume_create_manager' (51a7da7e-de3a-4cf9-8b62-ac1c32739810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:22:54 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-704f61df-b266-4028-b729-f0dbff18f389 tempest-VolumesListAdminTestJSON-79163490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d091bc13-eb5c-4ce8-baee-5883ab99fe73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:22:54 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-704f61df-b266-4028-b729-f0dbff18f389 tempest-VolumesListAdminTestJSON-79163490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d091bc13-eb5c-4ce8-baee-5883ab99fe73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:22:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1680347931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d55d1927-b303-43cc-8a48-4cc3bfb6d3f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e81ca5d83e524540983125af5926d28d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:22:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:22:54Z,use_quota=True,user_id='37305a4bc2514434b732ee790d7f91e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:22:54 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-704f61df-b266-4028-b729-f0dbff18f389 tempest-VolumesListAdminTestJSON-79163490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c854396-8417-4aae-ad85-0a6da458511e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:22:54 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-704f61df-b266-4028-b729-f0dbff18f389 tempest-VolumesListAdminTestJSON-79163490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c854396-8417-4aae-ad85-0a6da458511e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:22:54 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-704f61df-b266-4028-b729-f0dbff18f389 tempest-VolumesListAdminTestJSON-79163490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eca6d05f-e22b-4c38-a3e2-93d20644b713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:22:54 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-704f61df-b266-4028-b729-f0dbff18f389 tempest-VolumesListAdminTestJSON-79163490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eca6d05f-e22b-4c38-a3e2-93d20644b713) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd55d1927-b303-43cc-8a48-4cc3bfb6d3f8', 'volume_name': 'volume-d55d1927-b303-43cc-8a48-4cc3bfb6d3f8', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:22:54 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-704f61df-b266-4028-b729-f0dbff18f389 tempest-VolumesListAdminTestJSON-79163490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (665f8da5-dc56-49a2-9a7f-98956f26a861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:22:54 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-704f61df-b266-4028-b729-f0dbff18f389 tempest-VolumesListAdminTestJSON-79163490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (665f8da5-dc56-49a2-9a7f-98956f26a861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:22:54 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-704f61df-b266-4028-b729-f0dbff18f389 tempest-VolumesListAdminTestJSON-79163490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50c70296-e3e3-4f29-8499-fc01a3107978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:22:54 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-704f61df-b266-4028-b729-f0dbff18f389 tempest-VolumesListAdminTestJSON-79163490 None] Volume d55d1927-b303-43cc-8a48-4cc3bfb6d3f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d55d1927-b303-43cc-8a48-4cc3bfb6d3f8', 'volume_size': 1} Apr 29 15:22:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-704f61df-b266-4028-b729-f0dbff18f389 tempest-VolumesListAdminTestJSON-79163490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:22:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-704f61df-b266-4028-b729-f0dbff18f389 tempest-VolumesListAdminTestJSON-79163490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:22:54 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-704f61df-b266-4028-b729-f0dbff18f389 tempest-VolumesListAdminTestJSON-79163490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:22:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1680347931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d55d1927-b303-43cc-8a48-4cc3bfb6d3f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e81ca5d83e524540983125af5926d28d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:22:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:22:54Z,use_quota=True,user_id='37305a4bc2514434b732ee790d7f91e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:22:54 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-704f61df-b266-4028-b729-f0dbff18f389 tempest-VolumesListAdminTestJSON-79163490 None] Creating volume d55d1927-b303-43cc-8a48-4cc3bfb6d3f8 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:22:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-704f61df-b266-4028-b729-f0dbff18f389 tempest-VolumesListAdminTestJSON-79163490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:22:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-704f61df-b266-4028-b729-f0dbff18f389 tempest-VolumesListAdminTestJSON-79163490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:22:54 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-704f61df-b266-4028-b729-f0dbff18f389 tempest-VolumesListAdminTestJSON-79163490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:22:54 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-704f61df-b266-4028-b729-f0dbff18f389 tempest-VolumesListAdminTestJSON-79163490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:22:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-704f61df-b266-4028-b729-f0dbff18f389 tempest-VolumesListAdminTestJSON-79163490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:22:54 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-704f61df-b266-4028-b729-f0dbff18f389 tempest-VolumesListAdminTestJSON-79163490 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:22:54 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-704f61df-b266-4028-b729-f0dbff18f389 tempest-VolumesListAdminTestJSON-79163490 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:22:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-704f61df-b266-4028-b729-f0dbff18f389 tempest-VolumesListAdminTestJSON-79163490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d55d1927-b303-43cc-8a48-4cc3bfb6d3f8 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:22:54 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-d5a80b5f-6205-4bff-9dd2-eac73cfc91a3 tempest-TestServerVolumeAttachmentScenario-2002744384 None] Acquiring lock "cinder-853deb88-67bd-4dfc-80e0-302a44d30fbf-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:22:54 devstack sudo[102766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d55d1927-b303-43cc-8a48-4cc3bfb6d3f8 1073741824 Apr 29 15:22:54 devstack sudo[102766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:22:54 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-d5a80b5f-6205-4bff-9dd2-eac73cfc91a3 tempest-TestServerVolumeAttachmentScenario-2002744384 None] Lock "cinder-853deb88-67bd-4dfc-80e0-302a44d30fbf-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:22:54 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-d5a80b5f-6205-4bff-9dd2-eac73cfc91a3 tempest-TestServerVolumeAttachmentScenario-2002744384 None] Acquiring lock "cinder-quobyte-853deb88-67bd-4dfc-80e0-302a44d30fbf" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:22:54 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-d5a80b5f-6205-4bff-9dd2-eac73cfc91a3 tempest-TestServerVolumeAttachmentScenario-2002744384 None] Lock "cinder-quobyte-853deb88-67bd-4dfc-80e0-302a44d30fbf" acquired by "delete_volume" :: waited 0.016s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:22:54 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ab21de-2a3f-48c4-a21e-328896ec9ce4]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:22:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-d5a80b5f-6205-4bff-9dd2-eac73cfc91a3 tempest-TestServerVolumeAttachmentScenario-2002744384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-853deb88-67bd-4dfc-80e0-302a44d30fbf {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:22:54 devstack sudo[102768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-853deb88-67bd-4dfc-80e0-302a44d30fbf Apr 29 15:22:54 devstack sudo[102768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:22:55 devstack sudo[102766]: pam_unix(sudo:session): session closed for user root Apr 29 15:22:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-704f61df-b266-4028-b729-f0dbff18f389 tempest-VolumesListAdminTestJSON-79163490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d55d1927-b303-43cc-8a48-4cc3bfb6d3f8 1073741824" returned: 0 in 0.946s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:22:55 devstack sudo[102768]: pam_unix(sudo:session): session closed for user root Apr 29 15:22:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-d5a80b5f-6205-4bff-9dd2-eac73cfc91a3 tempest-TestServerVolumeAttachmentScenario-2002744384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-853deb88-67bd-4dfc-80e0-302a44d30fbf" returned: 0 in 0.820s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:22:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-d5a80b5f-6205-4bff-9dd2-eac73cfc91a3 tempest-TestServerVolumeAttachmentScenario-2002744384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-853deb88-67bd-4dfc-80e0-302a44d30fbf {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:22:55 devstack sudo[102776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-853deb88-67bd-4dfc-80e0-302a44d30fbf Apr 29 15:22:55 devstack sudo[102776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:22:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-704f61df-b266-4028-b729-f0dbff18f389 tempest-VolumesListAdminTestJSON-79163490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d55d1927-b303-43cc-8a48-4cc3bfb6d3f8 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:22:55 devstack sudo[102778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d55d1927-b303-43cc-8a48-4cc3bfb6d3f8 Apr 29 15:22:55 devstack sudo[102778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:22:55 devstack sudo[102776]: pam_unix(sudo:session): session closed for user root Apr 29 15:22:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-d5a80b5f-6205-4bff-9dd2-eac73cfc91a3 tempest-TestServerVolumeAttachmentScenario-2002744384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-853deb88-67bd-4dfc-80e0-302a44d30fbf" returned: 0 in 0.657s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:22:55 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-d5a80b5f-6205-4bff-9dd2-eac73cfc91a3 tempest-TestServerVolumeAttachmentScenario-2002744384 None] Lock "cinder-quobyte-853deb88-67bd-4dfc-80e0-302a44d30fbf" released by "delete_volume" :: held 1.529s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:22:56 devstack sudo[102778]: pam_unix(sudo:session): session closed for user root Apr 29 15:22:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-704f61df-b266-4028-b729-f0dbff18f389 tempest-VolumesListAdminTestJSON-79163490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d55d1927-b303-43cc-8a48-4cc3bfb6d3f8" returned: 0 in 0.700s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:22:56 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-704f61df-b266-4028-b729-f0dbff18f389 tempest-VolumesListAdminTestJSON-79163490 None] <== create_volume: return (1711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:22:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-704f61df-b266-4028-b729-f0dbff18f389 tempest-VolumesListAdminTestJSON-79163490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.716s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:22:56 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-d5a80b5f-6205-4bff-9dd2-eac73cfc91a3 tempest-TestServerVolumeAttachmentScenario-2002744384 None] Created reservations ['7904243b-538b-4013-9e2e-45b7473f9304', 'f40fe01a-b764-4ae6-b780-7a74ffca23d1', '473640df-900f-4503-99ad-9ec844ea156f', '120486b4-d48d-4895-a0ff-bcc34f359728'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:22:56 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-704f61df-b266-4028-b729-f0dbff18f389 tempest-VolumesListAdminTestJSON-79163490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50c70296-e3e3-4f29-8499-fc01a3107978) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d55d1927-b303-43cc-8a48-4cc3bfb6d3f8', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:22:56 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-704f61df-b266-4028-b729-f0dbff18f389 tempest-VolumesListAdminTestJSON-79163490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00db0381-4450-4d4f-b35b-85dc4248cfd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:22:56 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-704f61df-b266-4028-b729-f0dbff18f389 tempest-VolumesListAdminTestJSON-79163490 None] Volume volume-d55d1927-b303-43cc-8a48-4cc3bfb6d3f8 (d55d1927-b303-43cc-8a48-4cc3bfb6d3f8): created successfully Apr 29 15:22:56 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-704f61df-b266-4028-b729-f0dbff18f389 tempest-VolumesListAdminTestJSON-79163490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00db0381-4450-4d4f-b35b-85dc4248cfd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:22:56 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-704f61df-b266-4028-b729-f0dbff18f389 tempest-VolumesListAdminTestJSON-79163490 None] Flow 'volume_create_manager' (51a7da7e-de3a-4cf9-8b62-ac1c32739810) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:22:56 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-704f61df-b266-4028-b729-f0dbff18f389 tempest-VolumesListAdminTestJSON-79163490 None] Created volume successfully. Apr 29 15:22:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-d5a80b5f-6205-4bff-9dd2-eac73cfc91a3 tempest-TestServerVolumeAttachmentScenario-2002744384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:22:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-d5a80b5f-6205-4bff-9dd2-eac73cfc91a3 tempest-TestServerVolumeAttachmentScenario-2002744384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:22:56 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-d5a80b5f-6205-4bff-9dd2-eac73cfc91a3 tempest-TestServerVolumeAttachmentScenario-2002744384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:22:56 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-d5a80b5f-6205-4bff-9dd2-eac73cfc91a3 tempest-TestServerVolumeAttachmentScenario-2002744384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:22:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-d5a80b5f-6205-4bff-9dd2-eac73cfc91a3 tempest-TestServerVolumeAttachmentScenario-2002744384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:22:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-d5a80b5f-6205-4bff-9dd2-eac73cfc91a3 tempest-TestServerVolumeAttachmentScenario-2002744384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:22:56 devstack sudo[102783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:22:56 devstack sudo[102783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:22:56 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a46f227c-1ad4-47cb-b1a9-e69d9530485e tempest-TestServerVolumeAttachmentScenario-2002744384 None] Acquiring lock "cinder-2eababd4-4fa1-4e86-9977-af4c24b43953-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:22:56 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a46f227c-1ad4-47cb-b1a9-e69d9530485e tempest-TestServerVolumeAttachmentScenario-2002744384 None] Lock "cinder-2eababd4-4fa1-4e86-9977-af4c24b43953-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:22:56 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a46f227c-1ad4-47cb-b1a9-e69d9530485e tempest-TestServerVolumeAttachmentScenario-2002744384 None] Acquiring lock "cinder-quobyte-2eababd4-4fa1-4e86-9977-af4c24b43953" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:22:56 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a46f227c-1ad4-47cb-b1a9-e69d9530485e tempest-TestServerVolumeAttachmentScenario-2002744384 None] Lock "cinder-quobyte-2eababd4-4fa1-4e86-9977-af4c24b43953" acquired by "delete_volume" :: waited 0.020s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:22:56 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a7a4353-0da5-4508-89a8-7c27c8bd40e9]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:22:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a46f227c-1ad4-47cb-b1a9-e69d9530485e tempest-TestServerVolumeAttachmentScenario-2002744384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2eababd4-4fa1-4e86-9977-af4c24b43953 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:22:56 devstack sudo[102783]: pam_unix(sudo:session): session closed for user root Apr 29 15:22:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-d5a80b5f-6205-4bff-9dd2-eac73cfc91a3 tempest-TestServerVolumeAttachmentScenario-2002744384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.707s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:22:56 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-d5a80b5f-6205-4bff-9dd2-eac73cfc91a3 tempest-TestServerVolumeAttachmentScenario-2002744384 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:22:56 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-d5a80b5f-6205-4bff-9dd2-eac73cfc91a3 tempest-TestServerVolumeAttachmentScenario-2002744384 None] Deleted volume successfully. Apr 29 15:22:56 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-d5a80b5f-6205-4bff-9dd2-eac73cfc91a3 tempest-TestServerVolumeAttachmentScenario-2002744384 None] Lock "cinder-853deb88-67bd-4dfc-80e0-302a44d30fbf-delete_volume" released by "delete_volume" :: held 2.497s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:22:56 devstack sudo[102786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2eababd4-4fa1-4e86-9977-af4c24b43953 Apr 29 15:22:56 devstack sudo[102786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:22:57 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-272d1d42-11a4-4307-9e6f-8ea2bb65ba81 tempest-VolumesListAdminTestJSON-1510948756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:22:57 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-272d1d42-11a4-4307-9e6f-8ea2bb65ba81 tempest-VolumesListAdminTestJSON-1510948756 None] Flow 'volume_create_manager' (95bb4f38-c33a-4359-943d-d8458657bbbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:22:57 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-272d1d42-11a4-4307-9e6f-8ea2bb65ba81 tempest-VolumesListAdminTestJSON-1510948756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8aeade90-5987-4325-ad3c-716cb9e22a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:22:57 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-272d1d42-11a4-4307-9e6f-8ea2bb65ba81 tempest-VolumesListAdminTestJSON-1510948756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8aeade90-5987-4325-ad3c-716cb9e22a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4210fef2-7842-4c7b-91fa-1cb04b8a4df3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1773fdeed9184f4a860f36965f6c4d7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:22:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:22:57Z,use_quota=True,user_id='bb5445e16f204c788760891af9ed7880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:22:57 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-272d1d42-11a4-4307-9e6f-8ea2bb65ba81 tempest-VolumesListAdminTestJSON-1510948756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98c1cce0-c566-4e91-b422-543ae29e94bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:22:57 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-272d1d42-11a4-4307-9e6f-8ea2bb65ba81 tempest-VolumesListAdminTestJSON-1510948756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98c1cce0-c566-4e91-b422-543ae29e94bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:22:57 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-272d1d42-11a4-4307-9e6f-8ea2bb65ba81 tempest-VolumesListAdminTestJSON-1510948756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (572f8e12-2f0f-42c6-901f-58fa8d715627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:22:57 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-272d1d42-11a4-4307-9e6f-8ea2bb65ba81 tempest-VolumesListAdminTestJSON-1510948756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (572f8e12-2f0f-42c6-901f-58fa8d715627) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4210fef2-7842-4c7b-91fa-1cb04b8a4df3', 'volume_name': 'volume-4210fef2-7842-4c7b-91fa-1cb04b8a4df3', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:22:57 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-272d1d42-11a4-4307-9e6f-8ea2bb65ba81 tempest-VolumesListAdminTestJSON-1510948756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be22995d-8fe2-47ff-9fa4-b2d382f62ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:22:57 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-272d1d42-11a4-4307-9e6f-8ea2bb65ba81 tempest-VolumesListAdminTestJSON-1510948756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be22995d-8fe2-47ff-9fa4-b2d382f62ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:22:57 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-272d1d42-11a4-4307-9e6f-8ea2bb65ba81 tempest-VolumesListAdminTestJSON-1510948756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc77221a-af78-47fe-a8e0-afe5e91d34d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:22:57 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-272d1d42-11a4-4307-9e6f-8ea2bb65ba81 tempest-VolumesListAdminTestJSON-1510948756 None] Volume 4210fef2-7842-4c7b-91fa-1cb04b8a4df3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4210fef2-7842-4c7b-91fa-1cb04b8a4df3', 'volume_size': 1} Apr 29 15:22:57 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-272d1d42-11a4-4307-9e6f-8ea2bb65ba81 tempest-VolumesListAdminTestJSON-1510948756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:22:57 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-272d1d42-11a4-4307-9e6f-8ea2bb65ba81 tempest-VolumesListAdminTestJSON-1510948756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:22:57 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-272d1d42-11a4-4307-9e6f-8ea2bb65ba81 tempest-VolumesListAdminTestJSON-1510948756 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4210fef2-7842-4c7b-91fa-1cb04b8a4df3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1773fdeed9184f4a860f36965f6c4d7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:22:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:22:57Z,use_quota=True,user_id='bb5445e16f204c788760891af9ed7880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:22:57 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-272d1d42-11a4-4307-9e6f-8ea2bb65ba81 tempest-VolumesListAdminTestJSON-1510948756 None] Creating volume 4210fef2-7842-4c7b-91fa-1cb04b8a4df3 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:22:57 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-272d1d42-11a4-4307-9e6f-8ea2bb65ba81 tempest-VolumesListAdminTestJSON-1510948756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:22:57 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-272d1d42-11a4-4307-9e6f-8ea2bb65ba81 tempest-VolumesListAdminTestJSON-1510948756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:22:57 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-272d1d42-11a4-4307-9e6f-8ea2bb65ba81 tempest-VolumesListAdminTestJSON-1510948756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:22:57 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-272d1d42-11a4-4307-9e6f-8ea2bb65ba81 tempest-VolumesListAdminTestJSON-1510948756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:22:57 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-272d1d42-11a4-4307-9e6f-8ea2bb65ba81 tempest-VolumesListAdminTestJSON-1510948756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:22:57 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-272d1d42-11a4-4307-9e6f-8ea2bb65ba81 tempest-VolumesListAdminTestJSON-1510948756 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:22:57 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-272d1d42-11a4-4307-9e6f-8ea2bb65ba81 tempest-VolumesListAdminTestJSON-1510948756 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:22:57 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-272d1d42-11a4-4307-9e6f-8ea2bb65ba81 tempest-VolumesListAdminTestJSON-1510948756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4210fef2-7842-4c7b-91fa-1cb04b8a4df3 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:22:57 devstack sudo[102788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4210fef2-7842-4c7b-91fa-1cb04b8a4df3 1073741824 Apr 29 15:22:57 devstack sudo[102788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:22:57 devstack sudo[102786]: pam_unix(sudo:session): session closed for user root Apr 29 15:22:57 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a46f227c-1ad4-47cb-b1a9-e69d9530485e tempest-TestServerVolumeAttachmentScenario-2002744384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2eababd4-4fa1-4e86-9977-af4c24b43953" returned: 0 in 0.833s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:22:57 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a46f227c-1ad4-47cb-b1a9-e69d9530485e tempest-TestServerVolumeAttachmentScenario-2002744384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2eababd4-4fa1-4e86-9977-af4c24b43953 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:22:57 devstack sudo[102793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2eababd4-4fa1-4e86-9977-af4c24b43953 Apr 29 15:22:57 devstack sudo[102793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:22:58 devstack sudo[102788]: pam_unix(sudo:session): session closed for user root Apr 29 15:22:58 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-272d1d42-11a4-4307-9e6f-8ea2bb65ba81 tempest-VolumesListAdminTestJSON-1510948756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4210fef2-7842-4c7b-91fa-1cb04b8a4df3 1073741824" returned: 0 in 0.853s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:22:58 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-272d1d42-11a4-4307-9e6f-8ea2bb65ba81 tempest-VolumesListAdminTestJSON-1510948756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4210fef2-7842-4c7b-91fa-1cb04b8a4df3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:22:58 devstack sudo[102793]: pam_unix(sudo:session): session closed for user root Apr 29 15:22:58 devstack sudo[102799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4210fef2-7842-4c7b-91fa-1cb04b8a4df3 Apr 29 15:22:58 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a46f227c-1ad4-47cb-b1a9-e69d9530485e tempest-TestServerVolumeAttachmentScenario-2002744384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2eababd4-4fa1-4e86-9977-af4c24b43953" returned: 0 in 0.670s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:22:58 devstack sudo[102799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:22:58 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a46f227c-1ad4-47cb-b1a9-e69d9530485e tempest-TestServerVolumeAttachmentScenario-2002744384 None] Lock "cinder-quobyte-2eababd4-4fa1-4e86-9977-af4c24b43953" released by "delete_volume" :: held 1.559s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:22:58 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-a46f227c-1ad4-47cb-b1a9-e69d9530485e tempest-TestServerVolumeAttachmentScenario-2002744384 None] Created reservations ['efae8b27-8cd5-4a0f-9b59-98bcbc563c13', 'a5787036-10f3-437d-b756-dbdb414fa60f', '79077d75-b5d5-428e-aa99-1db2d540035d', '3f8ef32a-1246-42cf-a9f9-030fd93e12aa'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:22:58 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-a46f227c-1ad4-47cb-b1a9-e69d9530485e tempest-TestServerVolumeAttachmentScenario-2002744384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:22:58 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-a46f227c-1ad4-47cb-b1a9-e69d9530485e tempest-TestServerVolumeAttachmentScenario-2002744384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:22:58 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-a46f227c-1ad4-47cb-b1a9-e69d9530485e tempest-TestServerVolumeAttachmentScenario-2002744384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:22:58 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-a46f227c-1ad4-47cb-b1a9-e69d9530485e tempest-TestServerVolumeAttachmentScenario-2002744384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:22:58 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-a46f227c-1ad4-47cb-b1a9-e69d9530485e tempest-TestServerVolumeAttachmentScenario-2002744384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:22:58 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a46f227c-1ad4-47cb-b1a9-e69d9530485e tempest-TestServerVolumeAttachmentScenario-2002744384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:22:58 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5ea4cb1-f194-4cee-8afd-81151f1f9358 tempest-VolumesTransfersV357Test-677231037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:22:58 devstack sudo[102801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:22:58 devstack sudo[102801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:22:58 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b5ea4cb1-f194-4cee-8afd-81151f1f9358 tempest-VolumesTransfersV357Test-677231037 None] Flow 'volume_create_manager' (7e9c4e50-1324-42a3-8ece-b514d87bcd32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:22:58 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b5ea4cb1-f194-4cee-8afd-81151f1f9358 tempest-VolumesTransfersV357Test-677231037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9938e653-b23b-48f9-a018-2bcca9d6c434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:22:58 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b5ea4cb1-f194-4cee-8afd-81151f1f9358 tempest-VolumesTransfersV357Test-677231037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9938e653-b23b-48f9-a018-2bcca9d6c434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:22:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-255149080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab3f7e4d-9be0-4e6c-a3a8-3287bb0de079,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c6fe3614e00488492fa1bd405a9d541',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:22:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:22:58Z,use_quota=True,user_id='d69b32c7ba3b4cd584afc03d050fc24b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:22:58 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b5ea4cb1-f194-4cee-8afd-81151f1f9358 tempest-VolumesTransfersV357Test-677231037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a69855f7-c807-4bc4-afe5-34dbf2c5b5d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:22:58 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b5ea4cb1-f194-4cee-8afd-81151f1f9358 tempest-VolumesTransfersV357Test-677231037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a69855f7-c807-4bc4-afe5-34dbf2c5b5d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:22:58 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b5ea4cb1-f194-4cee-8afd-81151f1f9358 tempest-VolumesTransfersV357Test-677231037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (208f4e87-fe51-4b88-84c5-6852b4df7f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:22:58 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b5ea4cb1-f194-4cee-8afd-81151f1f9358 tempest-VolumesTransfersV357Test-677231037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (208f4e87-fe51-4b88-84c5-6852b4df7f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab3f7e4d-9be0-4e6c-a3a8-3287bb0de079', 'volume_name': 'volume-ab3f7e4d-9be0-4e6c-a3a8-3287bb0de079', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:22:58 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b5ea4cb1-f194-4cee-8afd-81151f1f9358 tempest-VolumesTransfersV357Test-677231037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bb290a1-66fb-4c4e-ba00-f68bc1a78c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:22:58 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b5ea4cb1-f194-4cee-8afd-81151f1f9358 tempest-VolumesTransfersV357Test-677231037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bb290a1-66fb-4c4e-ba00-f68bc1a78c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:22:58 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b5ea4cb1-f194-4cee-8afd-81151f1f9358 tempest-VolumesTransfersV357Test-677231037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c12886d-428d-4f5b-bc24-71b023c59afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:22:58 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-b5ea4cb1-f194-4cee-8afd-81151f1f9358 tempest-VolumesTransfersV357Test-677231037 None] Volume ab3f7e4d-9be0-4e6c-a3a8-3287bb0de079: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab3f7e4d-9be0-4e6c-a3a8-3287bb0de079', 'volume_size': 1} Apr 29 15:22:58 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-b5ea4cb1-f194-4cee-8afd-81151f1f9358 tempest-VolumesTransfersV357Test-677231037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:22:58 devstack sudo[102799]: pam_unix(sudo:session): session closed for user root Apr 29 15:22:58 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-272d1d42-11a4-4307-9e6f-8ea2bb65ba81 tempest-VolumesListAdminTestJSON-1510948756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4210fef2-7842-4c7b-91fa-1cb04b8a4df3" returned: 0 in 0.657s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:22:58 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-272d1d42-11a4-4307-9e6f-8ea2bb65ba81 tempest-VolumesListAdminTestJSON-1510948756 None] <== create_volume: return (1566ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:22:58 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-272d1d42-11a4-4307-9e6f-8ea2bb65ba81 tempest-VolumesListAdminTestJSON-1510948756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.569s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:22:58 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-b5ea4cb1-f194-4cee-8afd-81151f1f9358 tempest-VolumesTransfersV357Test-677231037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.365s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:22:58 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-b5ea4cb1-f194-4cee-8afd-81151f1f9358 tempest-VolumesTransfersV357Test-677231037 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:22:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-255149080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab3f7e4d-9be0-4e6c-a3a8-3287bb0de079,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c6fe3614e00488492fa1bd405a9d541',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:22:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:22:58Z,use_quota=True,user_id='d69b32c7ba3b4cd584afc03d050fc24b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:22:58 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-b5ea4cb1-f194-4cee-8afd-81151f1f9358 tempest-VolumesTransfersV357Test-677231037 None] Creating volume ab3f7e4d-9be0-4e6c-a3a8-3287bb0de079 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:22:58 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-b5ea4cb1-f194-4cee-8afd-81151f1f9358 tempest-VolumesTransfersV357Test-677231037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:22:58 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-b5ea4cb1-f194-4cee-8afd-81151f1f9358 tempest-VolumesTransfersV357Test-677231037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:22:58 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-b5ea4cb1-f194-4cee-8afd-81151f1f9358 tempest-VolumesTransfersV357Test-677231037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:22:58 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-b5ea4cb1-f194-4cee-8afd-81151f1f9358 tempest-VolumesTransfersV357Test-677231037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:22:58 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-b5ea4cb1-f194-4cee-8afd-81151f1f9358 tempest-VolumesTransfersV357Test-677231037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:22:58 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-b5ea4cb1-f194-4cee-8afd-81151f1f9358 tempest-VolumesTransfersV357Test-677231037 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:22:58 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-b5ea4cb1-f194-4cee-8afd-81151f1f9358 tempest-VolumesTransfersV357Test-677231037 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:22:58 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-b5ea4cb1-f194-4cee-8afd-81151f1f9358 tempest-VolumesTransfersV357Test-677231037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ab3f7e4d-9be0-4e6c-a3a8-3287bb0de079 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:22:58 devstack sudo[102804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ab3f7e4d-9be0-4e6c-a3a8-3287bb0de079 1073741824 Apr 29 15:22:58 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-272d1d42-11a4-4307-9e6f-8ea2bb65ba81 tempest-VolumesListAdminTestJSON-1510948756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc77221a-af78-47fe-a8e0-afe5e91d34d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4210fef2-7842-4c7b-91fa-1cb04b8a4df3', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:22:58 devstack sudo[102804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:22:58 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-272d1d42-11a4-4307-9e6f-8ea2bb65ba81 tempest-VolumesListAdminTestJSON-1510948756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c6ff7fd-2157-4d8e-8a33-e198296bc5cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:22:58 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-272d1d42-11a4-4307-9e6f-8ea2bb65ba81 tempest-VolumesListAdminTestJSON-1510948756 None] Volume volume-4210fef2-7842-4c7b-91fa-1cb04b8a4df3 (4210fef2-7842-4c7b-91fa-1cb04b8a4df3): created successfully Apr 29 15:22:58 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-272d1d42-11a4-4307-9e6f-8ea2bb65ba81 tempest-VolumesListAdminTestJSON-1510948756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c6ff7fd-2157-4d8e-8a33-e198296bc5cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:22:58 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-272d1d42-11a4-4307-9e6f-8ea2bb65ba81 tempest-VolumesListAdminTestJSON-1510948756 None] Flow 'volume_create_manager' (95bb4f38-c33a-4359-943d-d8458657bbbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:22:58 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-272d1d42-11a4-4307-9e6f-8ea2bb65ba81 tempest-VolumesListAdminTestJSON-1510948756 None] Created volume successfully. Apr 29 15:22:59 devstack sudo[102801]: pam_unix(sudo:session): session closed for user root Apr 29 15:22:59 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a46f227c-1ad4-47cb-b1a9-e69d9530485e tempest-TestServerVolumeAttachmentScenario-2002744384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.649s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:22:59 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-a46f227c-1ad4-47cb-b1a9-e69d9530485e tempest-TestServerVolumeAttachmentScenario-2002744384 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:22:59 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-a46f227c-1ad4-47cb-b1a9-e69d9530485e tempest-TestServerVolumeAttachmentScenario-2002744384 None] Deleted volume successfully. Apr 29 15:22:59 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a46f227c-1ad4-47cb-b1a9-e69d9530485e tempest-TestServerVolumeAttachmentScenario-2002744384 None] Lock "cinder-2eababd4-4fa1-4e86-9977-af4c24b43953-delete_volume" released by "delete_volume" :: held 2.454s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:22:59 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-517a6081-2ae0-4ecf-929c-d13cc93f3f28 tempest-VolumesListAdminTestJSON-1510948756 None] Acquiring lock "cinder-4210fef2-7842-4c7b-91fa-1cb04b8a4df3-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:22:59 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-517a6081-2ae0-4ecf-929c-d13cc93f3f28 tempest-VolumesListAdminTestJSON-1510948756 None] Lock "cinder-4210fef2-7842-4c7b-91fa-1cb04b8a4df3-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:22:59 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-517a6081-2ae0-4ecf-929c-d13cc93f3f28 tempest-VolumesListAdminTestJSON-1510948756 None] Acquiring lock "cinder-quobyte-4210fef2-7842-4c7b-91fa-1cb04b8a4df3" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:22:59 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-517a6081-2ae0-4ecf-929c-d13cc93f3f28 tempest-VolumesListAdminTestJSON-1510948756 None] Lock "cinder-quobyte-4210fef2-7842-4c7b-91fa-1cb04b8a4df3" acquired by "delete_volume" :: waited 0.025s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:22:59 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec2d0df-b8d7-4ed9-a8dc-2f51831abeed]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:22:59 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-517a6081-2ae0-4ecf-929c-d13cc93f3f28 tempest-VolumesListAdminTestJSON-1510948756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4210fef2-7842-4c7b-91fa-1cb04b8a4df3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:22:59 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-8caf83e1-5b1b-4a1c-8c72-f48c75e3151e tempest-VolumesListAdminTestJSON-79163490 None] Acquiring lock "cinder-d55d1927-b303-43cc-8a48-4cc3bfb6d3f8-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:22:59 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-8caf83e1-5b1b-4a1c-8c72-f48c75e3151e tempest-VolumesListAdminTestJSON-79163490 None] Lock "cinder-d55d1927-b303-43cc-8a48-4cc3bfb6d3f8-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:22:59 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-8caf83e1-5b1b-4a1c-8c72-f48c75e3151e tempest-VolumesListAdminTestJSON-79163490 None] Acquiring lock "cinder-quobyte-d55d1927-b303-43cc-8a48-4cc3bfb6d3f8" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:22:59 devstack sudo[102811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4210fef2-7842-4c7b-91fa-1cb04b8a4df3 Apr 29 15:22:59 devstack sudo[102811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:22:59 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-8caf83e1-5b1b-4a1c-8c72-f48c75e3151e tempest-VolumesListAdminTestJSON-79163490 None] Lock "cinder-quobyte-d55d1927-b303-43cc-8a48-4cc3bfb6d3f8" acquired by "delete_volume" :: waited 0.027s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:22:59 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b4b5762-f46a-4f68-afd6-ab7c54698cef]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:22:59 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-8caf83e1-5b1b-4a1c-8c72-f48c75e3151e tempest-VolumesListAdminTestJSON-79163490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d55d1927-b303-43cc-8a48-4cc3bfb6d3f8 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:22:59 devstack sudo[102804]: pam_unix(sudo:session): session closed for user root Apr 29 15:22:59 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-b5ea4cb1-f194-4cee-8afd-81151f1f9358 tempest-VolumesTransfersV357Test-677231037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ab3f7e4d-9be0-4e6c-a3a8-3287bb0de079 1073741824" returned: 0 in 1.041s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:22:59 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-b5ea4cb1-f194-4cee-8afd-81151f1f9358 tempest-VolumesTransfersV357Test-677231037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ab3f7e4d-9be0-4e6c-a3a8-3287bb0de079 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:23:00 devstack sudo[102814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ab3f7e4d-9be0-4e6c-a3a8-3287bb0de079 Apr 29 15:23:00 devstack sudo[102814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:23:00 devstack sudo[102813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d55d1927-b303-43cc-8a48-4cc3bfb6d3f8 Apr 29 15:23:00 devstack sudo[102813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:23:00 devstack sudo[102811]: pam_unix(sudo:session): session closed for user root Apr 29 15:23:00 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-517a6081-2ae0-4ecf-929c-d13cc93f3f28 tempest-VolumesListAdminTestJSON-1510948756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4210fef2-7842-4c7b-91fa-1cb04b8a4df3" returned: 0 in 0.969s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:23:00 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-517a6081-2ae0-4ecf-929c-d13cc93f3f28 tempest-VolumesListAdminTestJSON-1510948756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4210fef2-7842-4c7b-91fa-1cb04b8a4df3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:23:00 devstack sudo[102824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4210fef2-7842-4c7b-91fa-1cb04b8a4df3 Apr 29 15:23:00 devstack sudo[102824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:23:00 devstack sudo[102814]: pam_unix(sudo:session): session closed for user root Apr 29 15:23:00 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-b5ea4cb1-f194-4cee-8afd-81151f1f9358 tempest-VolumesTransfersV357Test-677231037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ab3f7e4d-9be0-4e6c-a3a8-3287bb0de079" returned: 0 in 0.721s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:23:00 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-b5ea4cb1-f194-4cee-8afd-81151f1f9358 tempest-VolumesTransfersV357Test-677231037 None] <== create_volume: return (1812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:23:00 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-b5ea4cb1-f194-4cee-8afd-81151f1f9358 tempest-VolumesTransfersV357Test-677231037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.816s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:23:00 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b5ea4cb1-f194-4cee-8afd-81151f1f9358 tempest-VolumesTransfersV357Test-677231037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c12886d-428d-4f5b-bc24-71b023c59afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab3f7e4d-9be0-4e6c-a3a8-3287bb0de079', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:23:00 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b5ea4cb1-f194-4cee-8afd-81151f1f9358 tempest-VolumesTransfersV357Test-677231037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b11c0a11-a72a-4f75-811b-33c29575a3ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:23:00 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-b5ea4cb1-f194-4cee-8afd-81151f1f9358 tempest-VolumesTransfersV357Test-677231037 None] Volume volume-ab3f7e4d-9be0-4e6c-a3a8-3287bb0de079 (ab3f7e4d-9be0-4e6c-a3a8-3287bb0de079): created successfully Apr 29 15:23:00 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b5ea4cb1-f194-4cee-8afd-81151f1f9358 tempest-VolumesTransfersV357Test-677231037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b11c0a11-a72a-4f75-811b-33c29575a3ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:23:00 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b5ea4cb1-f194-4cee-8afd-81151f1f9358 tempest-VolumesTransfersV357Test-677231037 None] Flow 'volume_create_manager' (7e9c4e50-1324-42a3-8ece-b514d87bcd32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:23:00 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-b5ea4cb1-f194-4cee-8afd-81151f1f9358 tempest-VolumesTransfersV357Test-677231037 None] Created volume successfully. Apr 29 15:23:00 devstack sudo[102813]: pam_unix(sudo:session): session closed for user root Apr 29 15:23:00 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-8caf83e1-5b1b-4a1c-8c72-f48c75e3151e tempest-VolumesListAdminTestJSON-79163490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d55d1927-b303-43cc-8a48-4cc3bfb6d3f8" returned: 0 in 0.920s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:23:00 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-8caf83e1-5b1b-4a1c-8c72-f48c75e3151e tempest-VolumesListAdminTestJSON-79163490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d55d1927-b303-43cc-8a48-4cc3bfb6d3f8 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:23:00 devstack sudo[102828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d55d1927-b303-43cc-8a48-4cc3bfb6d3f8 Apr 29 15:23:00 devstack sudo[102828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:23:01 devstack sudo[102824]: pam_unix(sudo:session): session closed for user root Apr 29 15:23:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-517a6081-2ae0-4ecf-929c-d13cc93f3f28 tempest-VolumesListAdminTestJSON-1510948756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4210fef2-7842-4c7b-91fa-1cb04b8a4df3" returned: 0 in 0.766s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:23:01 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-517a6081-2ae0-4ecf-929c-d13cc93f3f28 tempest-VolumesListAdminTestJSON-1510948756 None] Lock "cinder-quobyte-4210fef2-7842-4c7b-91fa-1cb04b8a4df3" released by "delete_volume" :: held 1.797s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:23:01 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-517a6081-2ae0-4ecf-929c-d13cc93f3f28 tempest-VolumesListAdminTestJSON-1510948756 None] Created reservations ['bd8d29ae-df5b-467e-8b62-ec4f8adf84ce', '580b21a2-8d19-47c5-b8e8-2bd3219fe380', '6311efe6-e744-4173-8590-c8e876f71fc6', '6c1e5da3-9c0b-419e-8efa-8362a5c1bf86'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:23:01 devstack sudo[102828]: pam_unix(sudo:session): session closed for user root Apr 29 15:23:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-8caf83e1-5b1b-4a1c-8c72-f48c75e3151e tempest-VolumesListAdminTestJSON-79163490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d55d1927-b303-43cc-8a48-4cc3bfb6d3f8" returned: 0 in 0.668s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:23:01 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-8caf83e1-5b1b-4a1c-8c72-f48c75e3151e tempest-VolumesListAdminTestJSON-79163490 None] Lock "cinder-quobyte-d55d1927-b303-43cc-8a48-4cc3bfb6d3f8" released by "delete_volume" :: held 1.651s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:23:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-517a6081-2ae0-4ecf-929c-d13cc93f3f28 tempest-VolumesListAdminTestJSON-1510948756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:23:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-517a6081-2ae0-4ecf-929c-d13cc93f3f28 tempest-VolumesListAdminTestJSON-1510948756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:23:01 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-517a6081-2ae0-4ecf-929c-d13cc93f3f28 tempest-VolumesListAdminTestJSON-1510948756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:23:01 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-517a6081-2ae0-4ecf-929c-d13cc93f3f28 tempest-VolumesListAdminTestJSON-1510948756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:23:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-517a6081-2ae0-4ecf-929c-d13cc93f3f28 tempest-VolumesListAdminTestJSON-1510948756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:23:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-517a6081-2ae0-4ecf-929c-d13cc93f3f28 tempest-VolumesListAdminTestJSON-1510948756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:23:01 devstack sudo[102832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:23:01 devstack sudo[102832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:23:01 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-8caf83e1-5b1b-4a1c-8c72-f48c75e3151e tempest-VolumesListAdminTestJSON-79163490 None] Created reservations ['58356ebc-6bfc-4cdf-8f7e-104ac201bb60', '062ff3ca-1670-4a5e-a8f1-6c67377c3cfa', '59659beb-beef-4581-94d3-60d0447ecab3', '8284b7df-4054-4062-b38f-f16d85039daf'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:23:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-8caf83e1-5b1b-4a1c-8c72-f48c75e3151e tempest-VolumesListAdminTestJSON-79163490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:23:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-8caf83e1-5b1b-4a1c-8c72-f48c75e3151e tempest-VolumesListAdminTestJSON-79163490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:23:01 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-8caf83e1-5b1b-4a1c-8c72-f48c75e3151e tempest-VolumesListAdminTestJSON-79163490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:23:01 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-8caf83e1-5b1b-4a1c-8c72-f48c75e3151e tempest-VolumesListAdminTestJSON-79163490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:23:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-8caf83e1-5b1b-4a1c-8c72-f48c75e3151e tempest-VolumesListAdminTestJSON-79163490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:23:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-8caf83e1-5b1b-4a1c-8c72-f48c75e3151e tempest-VolumesListAdminTestJSON-79163490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:23:01 devstack sudo[102834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:23:01 devstack sudo[102834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:23:02 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-48fff5c2-0ba1-4cb8-af98-6b0e6d55a316 tempest-VolumesTransfersV357Test-378998454 None] Transfer volume completed successfully. Apr 29 15:23:02 devstack sudo[102834]: pam_unix(sudo:session): session closed for user root Apr 29 15:23:02 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-8caf83e1-5b1b-4a1c-8c72-f48c75e3151e tempest-VolumesListAdminTestJSON-79163490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.890s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:23:02 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-8caf83e1-5b1b-4a1c-8c72-f48c75e3151e tempest-VolumesListAdminTestJSON-79163490 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:23:02 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-8caf83e1-5b1b-4a1c-8c72-f48c75e3151e tempest-VolumesListAdminTestJSON-79163490 None] Deleted volume successfully. Apr 29 15:23:02 devstack sudo[102832]: pam_unix(sudo:session): session closed for user root Apr 29 15:23:02 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-8caf83e1-5b1b-4a1c-8c72-f48c75e3151e tempest-VolumesListAdminTestJSON-79163490 None] Lock "cinder-d55d1927-b303-43cc-8a48-4cc3bfb6d3f8-delete_volume" released by "delete_volume" :: held 2.848s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:23:02 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-517a6081-2ae0-4ecf-929c-d13cc93f3f28 tempest-VolumesListAdminTestJSON-1510948756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 1.057s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:23:02 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-517a6081-2ae0-4ecf-929c-d13cc93f3f28 tempest-VolumesListAdminTestJSON-1510948756 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:23:02 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-517a6081-2ae0-4ecf-929c-d13cc93f3f28 tempest-VolumesListAdminTestJSON-1510948756 None] Deleted volume successfully. Apr 29 15:23:02 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-7781e930-a92e-490a-9158-bfdcfc9e4c99 tempest-VolumesListAdminTestJSON-79163490 None] Acquiring lock "cinder-cd3a0807-cbc2-4268-aefc-483d2d963af1-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:23:02 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-517a6081-2ae0-4ecf-929c-d13cc93f3f28 tempest-VolumesListAdminTestJSON-1510948756 None] Lock "cinder-4210fef2-7842-4c7b-91fa-1cb04b8a4df3-delete_volume" released by "delete_volume" :: held 3.141s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:23:02 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-7781e930-a92e-490a-9158-bfdcfc9e4c99 tempest-VolumesListAdminTestJSON-79163490 None] Lock "cinder-cd3a0807-cbc2-4268-aefc-483d2d963af1-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:23:02 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-7781e930-a92e-490a-9158-bfdcfc9e4c99 tempest-VolumesListAdminTestJSON-79163490 None] Acquiring lock "cinder-quobyte-cd3a0807-cbc2-4268-aefc-483d2d963af1" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:23:02 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-7781e930-a92e-490a-9158-bfdcfc9e4c99 tempest-VolumesListAdminTestJSON-79163490 None] Lock "cinder-quobyte-cd3a0807-cbc2-4268-aefc-483d2d963af1" acquired by "delete_volume" :: waited 0.018s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:23:02 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b2c3c5-8393-4929-ad9d-7cf8d79de631]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:23:02 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7781e930-a92e-490a-9158-bfdcfc9e4c99 tempest-VolumesListAdminTestJSON-79163490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cd3a0807-cbc2-4268-aefc-483d2d963af1 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:23:02 devstack sudo[102838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cd3a0807-cbc2-4268-aefc-483d2d963af1 Apr 29 15:23:02 devstack sudo[102838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:23:03 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-5d3a96ff-8c7a-4cc7-a7c9-0937370059c9 tempest-VolumesTransfersV357Test-487085452 None] Acquiring lock "cinder-ab3f7e4d-9be0-4e6c-a3a8-3287bb0de079-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:23:03 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-5d3a96ff-8c7a-4cc7-a7c9-0937370059c9 tempest-VolumesTransfersV357Test-487085452 None] Lock "cinder-ab3f7e4d-9be0-4e6c-a3a8-3287bb0de079-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:23:03 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:SELECT=114,cinder:UPDATE=122,cinder:INSERT=33,cinder:DELETE=14 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:23:03 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:UPDATE=143,cinder:SELECT=90,cinder:INSERT=23,cinder:DELETE=9 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:23:03 devstack sudo[102838]: pam_unix(sudo:session): session closed for user root Apr 29 15:23:03 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7781e930-a92e-490a-9158-bfdcfc9e4c99 tempest-VolumesListAdminTestJSON-79163490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cd3a0807-cbc2-4268-aefc-483d2d963af1" returned: 0 in 0.852s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:23:03 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7781e930-a92e-490a-9158-bfdcfc9e4c99 tempest-VolumesListAdminTestJSON-79163490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cd3a0807-cbc2-4268-aefc-483d2d963af1 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:23:03 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-5d3a96ff-8c7a-4cc7-a7c9-0937370059c9 tempest-VolumesTransfersV357Test-487085452 None] Acquiring lock "cinder-quobyte-ab3f7e4d-9be0-4e6c-a3a8-3287bb0de079" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:23:03 devstack sudo[102844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cd3a0807-cbc2-4268-aefc-483d2d963af1 Apr 29 15:23:03 devstack sudo[102844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:23:03 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-5d3a96ff-8c7a-4cc7-a7c9-0937370059c9 tempest-VolumesTransfersV357Test-487085452 None] Lock "cinder-quobyte-ab3f7e4d-9be0-4e6c-a3a8-3287bb0de079" acquired by "delete_volume" :: waited 0.023s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:23:03 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64b3c32-3d50-49be-b7e9-485b1761899c]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:23:03 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-5d3a96ff-8c7a-4cc7-a7c9-0937370059c9 tempest-VolumesTransfersV357Test-487085452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ab3f7e4d-9be0-4e6c-a3a8-3287bb0de079 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:23:03 devstack sudo[102846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ab3f7e4d-9be0-4e6c-a3a8-3287bb0de079 Apr 29 15:23:03 devstack sudo[102846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:23:04 devstack sudo[102844]: pam_unix(sudo:session): session closed for user root Apr 29 15:23:04 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7781e930-a92e-490a-9158-bfdcfc9e4c99 tempest-VolumesListAdminTestJSON-79163490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cd3a0807-cbc2-4268-aefc-483d2d963af1" returned: 0 in 0.692s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:23:04 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-7781e930-a92e-490a-9158-bfdcfc9e4c99 tempest-VolumesListAdminTestJSON-79163490 None] Lock "cinder-quobyte-cd3a0807-cbc2-4268-aefc-483d2d963af1" released by "delete_volume" :: held 1.593s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:23:04 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-7781e930-a92e-490a-9158-bfdcfc9e4c99 tempest-VolumesListAdminTestJSON-79163490 None] Created reservations ['3dcfcc1a-22fc-42b5-b57a-aa83b50846d4', 'cdc9ab30-5866-41c1-ab2b-01f35e377664', '30880e42-8f28-44b3-a3bb-9a7955184fca', '863dbadd-64bf-494c-a17d-c071671eba3b'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:23:04 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-7781e930-a92e-490a-9158-bfdcfc9e4c99 tempest-VolumesListAdminTestJSON-79163490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:23:04 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-7781e930-a92e-490a-9158-bfdcfc9e4c99 tempest-VolumesListAdminTestJSON-79163490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:23:04 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-7781e930-a92e-490a-9158-bfdcfc9e4c99 tempest-VolumesListAdminTestJSON-79163490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:23:04 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-7781e930-a92e-490a-9158-bfdcfc9e4c99 tempest-VolumesListAdminTestJSON-79163490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:23:04 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-7781e930-a92e-490a-9158-bfdcfc9e4c99 tempest-VolumesListAdminTestJSON-79163490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:23:04 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7781e930-a92e-490a-9158-bfdcfc9e4c99 tempest-VolumesListAdminTestJSON-79163490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:23:04 devstack sudo[102853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:23:04 devstack sudo[102853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:23:04 devstack sudo[102846]: pam_unix(sudo:session): session closed for user root Apr 29 15:23:04 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-5d3a96ff-8c7a-4cc7-a7c9-0937370059c9 tempest-VolumesTransfersV357Test-487085452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ab3f7e4d-9be0-4e6c-a3a8-3287bb0de079" returned: 0 in 0.848s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:23:04 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-5d3a96ff-8c7a-4cc7-a7c9-0937370059c9 tempest-VolumesTransfersV357Test-487085452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ab3f7e4d-9be0-4e6c-a3a8-3287bb0de079 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:23:04 devstack sudo[102855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ab3f7e4d-9be0-4e6c-a3a8-3287bb0de079 Apr 29 15:23:04 devstack sudo[102855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:23:04 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-75f06e7d-8559-4595-8f4f-697f92be837c tempest-VolumesListAdminTestJSON-79163490 None] Acquiring lock "cinder-d7427f07-c99f-40a6-a6be-d566622a5e48-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:23:05 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-75f06e7d-8559-4595-8f4f-697f92be837c tempest-VolumesListAdminTestJSON-79163490 None] Lock "cinder-d7427f07-c99f-40a6-a6be-d566622a5e48-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:23:05 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-75f06e7d-8559-4595-8f4f-697f92be837c tempest-VolumesListAdminTestJSON-79163490 None] Acquiring lock "cinder-quobyte-d7427f07-c99f-40a6-a6be-d566622a5e48" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:23:05 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-75f06e7d-8559-4595-8f4f-697f92be837c tempest-VolumesListAdminTestJSON-79163490 None] Lock "cinder-quobyte-d7427f07-c99f-40a6-a6be-d566622a5e48" acquired by "delete_volume" :: waited 0.027s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:23:05 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3806217-5874-4f29-a13b-d5e0a74a64af]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:23:05 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-75f06e7d-8559-4595-8f4f-697f92be837c tempest-VolumesListAdminTestJSON-79163490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d7427f07-c99f-40a6-a6be-d566622a5e48 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:23:05 devstack sudo[102853]: pam_unix(sudo:session): session closed for user root Apr 29 15:23:05 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7781e930-a92e-490a-9158-bfdcfc9e4c99 tempest-VolumesListAdminTestJSON-79163490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.780s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:23:05 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-7781e930-a92e-490a-9158-bfdcfc9e4c99 tempest-VolumesListAdminTestJSON-79163490 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:23:05 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-7781e930-a92e-490a-9158-bfdcfc9e4c99 tempest-VolumesListAdminTestJSON-79163490 None] Deleted volume successfully. Apr 29 15:23:05 devstack sudo[102855]: pam_unix(sudo:session): session closed for user root Apr 29 15:23:05 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-5d3a96ff-8c7a-4cc7-a7c9-0937370059c9 tempest-VolumesTransfersV357Test-487085452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ab3f7e4d-9be0-4e6c-a3a8-3287bb0de079" returned: 0 in 0.714s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:23:05 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-5d3a96ff-8c7a-4cc7-a7c9-0937370059c9 tempest-VolumesTransfersV357Test-487085452 None] Lock "cinder-quobyte-ab3f7e4d-9be0-4e6c-a3a8-3287bb0de079" released by "delete_volume" :: held 1.622s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:23:05 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-7781e930-a92e-490a-9158-bfdcfc9e4c99 tempest-VolumesListAdminTestJSON-79163490 None] Lock "cinder-cd3a0807-cbc2-4268-aefc-483d2d963af1-delete_volume" released by "delete_volume" :: held 2.612s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:23:05 devstack sudo[102860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d7427f07-c99f-40a6-a6be-d566622a5e48 Apr 29 15:23:05 devstack sudo[102860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:23:05 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-5d3a96ff-8c7a-4cc7-a7c9-0937370059c9 tempest-VolumesTransfersV357Test-487085452 None] Created reservations ['a904adee-55a9-4e61-8178-389b932eda50', '7badbfe7-9180-47fd-b077-b7a9ebb183df', 'ed82607e-0115-4083-ac7a-f102f20acdb4', '5ffce02b-bcec-45cf-80c7-d2d8f59d2086'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:23:05 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-5d3a96ff-8c7a-4cc7-a7c9-0937370059c9 tempest-VolumesTransfersV357Test-487085452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:23:05 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-5d3a96ff-8c7a-4cc7-a7c9-0937370059c9 tempest-VolumesTransfersV357Test-487085452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:23:05 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-5d3a96ff-8c7a-4cc7-a7c9-0937370059c9 tempest-VolumesTransfersV357Test-487085452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:23:05 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-5d3a96ff-8c7a-4cc7-a7c9-0937370059c9 tempest-VolumesTransfersV357Test-487085452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:23:05 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-5d3a96ff-8c7a-4cc7-a7c9-0937370059c9 tempest-VolumesTransfersV357Test-487085452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:23:05 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-5d3a96ff-8c7a-4cc7-a7c9-0937370059c9 tempest-VolumesTransfersV357Test-487085452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:23:05 devstack sudo[102862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:23:05 devstack sudo[102862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:23:06 devstack sudo[102860]: pam_unix(sudo:session): session closed for user root Apr 29 15:23:06 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-75f06e7d-8559-4595-8f4f-697f92be837c tempest-VolumesListAdminTestJSON-79163490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d7427f07-c99f-40a6-a6be-d566622a5e48" returned: 0 in 0.855s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:23:06 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-75f06e7d-8559-4595-8f4f-697f92be837c tempest-VolumesListAdminTestJSON-79163490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d7427f07-c99f-40a6-a6be-d566622a5e48 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:23:06 devstack sudo[102862]: pam_unix(sudo:session): session closed for user root Apr 29 15:23:06 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-5d3a96ff-8c7a-4cc7-a7c9-0937370059c9 tempest-VolumesTransfersV357Test-487085452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.651s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:23:06 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-5d3a96ff-8c7a-4cc7-a7c9-0937370059c9 tempest-VolumesTransfersV357Test-487085452 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:23:06 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-5d3a96ff-8c7a-4cc7-a7c9-0937370059c9 tempest-VolumesTransfersV357Test-487085452 None] Deleted volume successfully. Apr 29 15:23:06 devstack sudo[102869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d7427f07-c99f-40a6-a6be-d566622a5e48 Apr 29 15:23:06 devstack sudo[102869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:23:06 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-5d3a96ff-8c7a-4cc7-a7c9-0937370059c9 tempest-VolumesTransfersV357Test-487085452 None] Lock "cinder-ab3f7e4d-9be0-4e6c-a3a8-3287bb0de079-delete_volume" released by "delete_volume" :: held 2.608s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:23:06 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-5534dbf6-b3f0-4a11-978f-a43e9f39086f tempest-VolumesTransfersV357Test-677231037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:23:06 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-5534dbf6-b3f0-4a11-978f-a43e9f39086f tempest-VolumesTransfersV357Test-677231037 None] Flow 'volume_create_manager' (1b643085-35c5-414b-844e-7e5761d84244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:23:06 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-5534dbf6-b3f0-4a11-978f-a43e9f39086f tempest-VolumesTransfersV357Test-677231037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79eea60d-56db-437c-baff-8a507af13062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:23:06 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-5534dbf6-b3f0-4a11-978f-a43e9f39086f tempest-VolumesTransfersV357Test-677231037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79eea60d-56db-437c-baff-8a507af13062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:23:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-883595782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12308890-8fa8-4d11-8cb6-22db1d6d0b36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c6fe3614e00488492fa1bd405a9d541',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:23:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:23:06Z,use_quota=True,user_id='d69b32c7ba3b4cd584afc03d050fc24b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:23:06 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-5534dbf6-b3f0-4a11-978f-a43e9f39086f tempest-VolumesTransfersV357Test-677231037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31840d2d-d063-41d4-8351-2b11d8e956c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:23:06 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-5534dbf6-b3f0-4a11-978f-a43e9f39086f tempest-VolumesTransfersV357Test-677231037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31840d2d-d063-41d4-8351-2b11d8e956c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:23:06 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-5534dbf6-b3f0-4a11-978f-a43e9f39086f tempest-VolumesTransfersV357Test-677231037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0fdcbf2-2e75-4df2-a066-c80e2a837f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:23:06 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-5534dbf6-b3f0-4a11-978f-a43e9f39086f tempest-VolumesTransfersV357Test-677231037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0fdcbf2-2e75-4df2-a066-c80e2a837f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12308890-8fa8-4d11-8cb6-22db1d6d0b36', 'volume_name': 'volume-12308890-8fa8-4d11-8cb6-22db1d6d0b36', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:23:06 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-5534dbf6-b3f0-4a11-978f-a43e9f39086f tempest-VolumesTransfersV357Test-677231037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c453274a-ce10-4291-876f-a28800f70393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:23:06 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-5534dbf6-b3f0-4a11-978f-a43e9f39086f tempest-VolumesTransfersV357Test-677231037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c453274a-ce10-4291-876f-a28800f70393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:23:06 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-5534dbf6-b3f0-4a11-978f-a43e9f39086f tempest-VolumesTransfersV357Test-677231037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f64f11a8-cc7f-485a-bb7a-4362f8d31107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:23:06 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-5534dbf6-b3f0-4a11-978f-a43e9f39086f tempest-VolumesTransfersV357Test-677231037 None] Volume 12308890-8fa8-4d11-8cb6-22db1d6d0b36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12308890-8fa8-4d11-8cb6-22db1d6d0b36', 'volume_size': 1} Apr 29 15:23:06 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-5534dbf6-b3f0-4a11-978f-a43e9f39086f tempest-VolumesTransfersV357Test-677231037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:23:06 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-5534dbf6-b3f0-4a11-978f-a43e9f39086f tempest-VolumesTransfersV357Test-677231037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:23:06 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-5534dbf6-b3f0-4a11-978f-a43e9f39086f tempest-VolumesTransfersV357Test-677231037 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:23:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-883595782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12308890-8fa8-4d11-8cb6-22db1d6d0b36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c6fe3614e00488492fa1bd405a9d541',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:23:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:23:06Z,use_quota=True,user_id='d69b32c7ba3b4cd584afc03d050fc24b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:23:06 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-5534dbf6-b3f0-4a11-978f-a43e9f39086f tempest-VolumesTransfersV357Test-677231037 None] Creating volume 12308890-8fa8-4d11-8cb6-22db1d6d0b36 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:23:06 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-5534dbf6-b3f0-4a11-978f-a43e9f39086f tempest-VolumesTransfersV357Test-677231037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:23:06 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-5534dbf6-b3f0-4a11-978f-a43e9f39086f tempest-VolumesTransfersV357Test-677231037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:23:06 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-5534dbf6-b3f0-4a11-978f-a43e9f39086f tempest-VolumesTransfersV357Test-677231037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:23:06 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-5534dbf6-b3f0-4a11-978f-a43e9f39086f tempest-VolumesTransfersV357Test-677231037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:23:06 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-5534dbf6-b3f0-4a11-978f-a43e9f39086f tempest-VolumesTransfersV357Test-677231037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:23:06 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-5534dbf6-b3f0-4a11-978f-a43e9f39086f tempest-VolumesTransfersV357Test-677231037 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:23:06 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-5534dbf6-b3f0-4a11-978f-a43e9f39086f tempest-VolumesTransfersV357Test-677231037 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:23:06 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-5534dbf6-b3f0-4a11-978f-a43e9f39086f tempest-VolumesTransfersV357Test-677231037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-12308890-8fa8-4d11-8cb6-22db1d6d0b36 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:23:06 devstack sudo[102871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-12308890-8fa8-4d11-8cb6-22db1d6d0b36 1073741824 Apr 29 15:23:06 devstack sudo[102871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:23:06 devstack sudo[102869]: pam_unix(sudo:session): session closed for user root Apr 29 15:23:06 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-75f06e7d-8559-4595-8f4f-697f92be837c tempest-VolumesListAdminTestJSON-79163490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d7427f07-c99f-40a6-a6be-d566622a5e48" returned: 0 in 0.856s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:23:06 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-75f06e7d-8559-4595-8f4f-697f92be837c tempest-VolumesListAdminTestJSON-79163490 None] Lock "cinder-quobyte-d7427f07-c99f-40a6-a6be-d566622a5e48" released by "delete_volume" :: held 1.788s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:23:06 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-75f06e7d-8559-4595-8f4f-697f92be837c tempest-VolumesListAdminTestJSON-79163490 None] Created reservations ['375b5aff-0f88-43f6-a807-78e2d761cb22', 'f69fd0e0-53c0-4fe2-9fed-bb4f0b1055f1', '2cc9e01b-7921-468b-9092-c59443b90d2c', 'b08d8133-4cc2-4340-a336-8fac4211fcf3'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:23:07 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-75f06e7d-8559-4595-8f4f-697f92be837c tempest-VolumesListAdminTestJSON-79163490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:23:07 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-75f06e7d-8559-4595-8f4f-697f92be837c tempest-VolumesListAdminTestJSON-79163490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:23:07 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-75f06e7d-8559-4595-8f4f-697f92be837c tempest-VolumesListAdminTestJSON-79163490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:23:07 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-75f06e7d-8559-4595-8f4f-697f92be837c tempest-VolumesListAdminTestJSON-79163490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:23:07 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-75f06e7d-8559-4595-8f4f-697f92be837c tempest-VolumesListAdminTestJSON-79163490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:23:07 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-75f06e7d-8559-4595-8f4f-697f92be837c tempest-VolumesListAdminTestJSON-79163490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:23:07 devstack sudo[102877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:23:07 devstack sudo[102877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:23:07 devstack sudo[102871]: pam_unix(sudo:session): session closed for user root Apr 29 15:23:07 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-5534dbf6-b3f0-4a11-978f-a43e9f39086f tempest-VolumesTransfersV357Test-677231037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-12308890-8fa8-4d11-8cb6-22db1d6d0b36 1073741824" returned: 0 in 0.926s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:23:07 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-5534dbf6-b3f0-4a11-978f-a43e9f39086f tempest-VolumesTransfersV357Test-677231037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-12308890-8fa8-4d11-8cb6-22db1d6d0b36 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:23:07 devstack sudo[102879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-12308890-8fa8-4d11-8cb6-22db1d6d0b36 Apr 29 15:23:07 devstack sudo[102879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:23:07 devstack sudo[102877]: pam_unix(sudo:session): session closed for user root Apr 29 15:23:07 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-75f06e7d-8559-4595-8f4f-697f92be837c tempest-VolumesListAdminTestJSON-79163490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.782s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:23:07 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-75f06e7d-8559-4595-8f4f-697f92be837c tempest-VolumesListAdminTestJSON-79163490 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:23:07 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-75f06e7d-8559-4595-8f4f-697f92be837c tempest-VolumesListAdminTestJSON-79163490 None] Deleted volume successfully. Apr 29 15:23:07 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-75f06e7d-8559-4595-8f4f-697f92be837c tempest-VolumesListAdminTestJSON-79163490 None] Lock "cinder-d7427f07-c99f-40a6-a6be-d566622a5e48-delete_volume" released by "delete_volume" :: held 2.856s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:23:08 devstack sudo[102879]: pam_unix(sudo:session): session closed for user root Apr 29 15:23:08 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-5534dbf6-b3f0-4a11-978f-a43e9f39086f tempest-VolumesTransfersV357Test-677231037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-12308890-8fa8-4d11-8cb6-22db1d6d0b36" returned: 0 in 0.764s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:23:08 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-5534dbf6-b3f0-4a11-978f-a43e9f39086f tempest-VolumesTransfersV357Test-677231037 None] <== create_volume: return (1745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:23:08 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-5534dbf6-b3f0-4a11-978f-a43e9f39086f tempest-VolumesTransfersV357Test-677231037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.748s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:23:08 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-5534dbf6-b3f0-4a11-978f-a43e9f39086f tempest-VolumesTransfersV357Test-677231037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f64f11a8-cc7f-485a-bb7a-4362f8d31107) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12308890-8fa8-4d11-8cb6-22db1d6d0b36', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:23:08 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-5534dbf6-b3f0-4a11-978f-a43e9f39086f tempest-VolumesTransfersV357Test-677231037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ec14301-49e6-4fb3-b7f7-e3a4e193da0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:23:08 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-5534dbf6-b3f0-4a11-978f-a43e9f39086f tempest-VolumesTransfersV357Test-677231037 None] Volume volume-12308890-8fa8-4d11-8cb6-22db1d6d0b36 (12308890-8fa8-4d11-8cb6-22db1d6d0b36): created successfully Apr 29 15:23:08 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-5534dbf6-b3f0-4a11-978f-a43e9f39086f tempest-VolumesTransfersV357Test-677231037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ec14301-49e6-4fb3-b7f7-e3a4e193da0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:23:08 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-5534dbf6-b3f0-4a11-978f-a43e9f39086f tempest-VolumesTransfersV357Test-677231037 None] Flow 'volume_create_manager' (1b643085-35c5-414b-844e-7e5761d84244) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:23:08 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-5534dbf6-b3f0-4a11-978f-a43e9f39086f tempest-VolumesTransfersV357Test-677231037 None] Created volume successfully. Apr 29 15:23:08 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-738282c1-219d-4bd1-9cd6-559382c3d6d2 tempest-VolumesTransfersV357Test-487085452 None] Acquiring lock "cinder-12308890-8fa8-4d11-8cb6-22db1d6d0b36-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:23:08 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-738282c1-219d-4bd1-9cd6-559382c3d6d2 tempest-VolumesTransfersV357Test-487085452 None] Lock "cinder-12308890-8fa8-4d11-8cb6-22db1d6d0b36-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:23:08 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-738282c1-219d-4bd1-9cd6-559382c3d6d2 tempest-VolumesTransfersV357Test-487085452 None] Acquiring lock "cinder-quobyte-12308890-8fa8-4d11-8cb6-22db1d6d0b36" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:23:09 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-738282c1-219d-4bd1-9cd6-559382c3d6d2 tempest-VolumesTransfersV357Test-487085452 None] Lock "cinder-quobyte-12308890-8fa8-4d11-8cb6-22db1d6d0b36" acquired by "delete_volume" :: waited 0.031s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:23:09 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b8e26d-b1e6-49d8-8c9a-a9c922783b24]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:23:09 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-738282c1-219d-4bd1-9cd6-559382c3d6d2 tempest-VolumesTransfersV357Test-487085452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-12308890-8fa8-4d11-8cb6-22db1d6d0b36 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:23:09 devstack sudo[102884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-12308890-8fa8-4d11-8cb6-22db1d6d0b36 Apr 29 15:23:09 devstack sudo[102884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:23:09 devstack sudo[102884]: pam_unix(sudo:session): session closed for user root Apr 29 15:23:09 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-738282c1-219d-4bd1-9cd6-559382c3d6d2 tempest-VolumesTransfersV357Test-487085452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-12308890-8fa8-4d11-8cb6-22db1d6d0b36" returned: 0 in 0.809s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:23:09 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-738282c1-219d-4bd1-9cd6-559382c3d6d2 tempest-VolumesTransfersV357Test-487085452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-12308890-8fa8-4d11-8cb6-22db1d6d0b36 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:23:09 devstack sudo[102889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-12308890-8fa8-4d11-8cb6-22db1d6d0b36 Apr 29 15:23:09 devstack sudo[102889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:23:10 devstack sudo[102889]: pam_unix(sudo:session): session closed for user root Apr 29 15:23:10 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-738282c1-219d-4bd1-9cd6-559382c3d6d2 tempest-VolumesTransfersV357Test-487085452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-12308890-8fa8-4d11-8cb6-22db1d6d0b36" returned: 0 in 0.660s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:23:10 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-738282c1-219d-4bd1-9cd6-559382c3d6d2 tempest-VolumesTransfersV357Test-487085452 None] Lock "cinder-quobyte-12308890-8fa8-4d11-8cb6-22db1d6d0b36" released by "delete_volume" :: held 1.524s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:23:10 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-738282c1-219d-4bd1-9cd6-559382c3d6d2 tempest-VolumesTransfersV357Test-487085452 None] Created reservations ['6f9f7250-0c9d-469a-a74c-39858003dc71', 'ab346aea-7fb0-468d-b8eb-a634d84adf23', 'cf435316-193d-4abe-afc1-46b04904f6b7', '678df9f6-74c5-480f-851b-aab55bed0c53'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:23:10 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-738282c1-219d-4bd1-9cd6-559382c3d6d2 tempest-VolumesTransfersV357Test-487085452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:23:10 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-738282c1-219d-4bd1-9cd6-559382c3d6d2 tempest-VolumesTransfersV357Test-487085452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:23:10 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-738282c1-219d-4bd1-9cd6-559382c3d6d2 tempest-VolumesTransfersV357Test-487085452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:23:10 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-738282c1-219d-4bd1-9cd6-559382c3d6d2 tempest-VolumesTransfersV357Test-487085452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:23:10 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-738282c1-219d-4bd1-9cd6-559382c3d6d2 tempest-VolumesTransfersV357Test-487085452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:23:10 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-738282c1-219d-4bd1-9cd6-559382c3d6d2 tempest-VolumesTransfersV357Test-487085452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:23:10 devstack sudo[102892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:23:10 devstack sudo[102892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:23:11 devstack sudo[102892]: pam_unix(sudo:session): session closed for user root Apr 29 15:23:11 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-738282c1-219d-4bd1-9cd6-559382c3d6d2 tempest-VolumesTransfersV357Test-487085452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.766s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:23:11 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-738282c1-219d-4bd1-9cd6-559382c3d6d2 tempest-VolumesTransfersV357Test-487085452 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:23:11 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-738282c1-219d-4bd1-9cd6-559382c3d6d2 tempest-VolumesTransfersV357Test-487085452 None] Deleted volume successfully. Apr 29 15:23:11 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-738282c1-219d-4bd1-9cd6-559382c3d6d2 tempest-VolumesTransfersV357Test-487085452 None] Lock "cinder-12308890-8fa8-4d11-8cb6-22db1d6d0b36-delete_volume" released by "delete_volume" :: held 2.559s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:23:16 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4394730-3826-42a8-9546-e20f4d21ea77 tempest-VolumesDeleteCascade-398376463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:23:16 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e4394730-3826-42a8-9546-e20f4d21ea77 tempest-VolumesDeleteCascade-398376463 None] Flow 'volume_create_manager' (aec3f879-2ae9-4d91-ab03-3d586bf15eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:23:16 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e4394730-3826-42a8-9546-e20f4d21ea77 tempest-VolumesDeleteCascade-398376463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3a6c43c-3baf-4b76-b91d-d93534932e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:23:16 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e4394730-3826-42a8-9546-e20f4d21ea77 tempest-VolumesDeleteCascade-398376463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3a6c43c-3baf-4b76-b91d-d93534932e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:23:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1188490054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=623e3c53-e277-457b-89e1-21eafcaeb74d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c4f94025b594b37ba67e3a4a845b795',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:23:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:23:16Z,use_quota=True,user_id='1f4382ad45db4e10a30a8f3a76751e71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:23:16 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e4394730-3826-42a8-9546-e20f4d21ea77 tempest-VolumesDeleteCascade-398376463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c54eade9-fdbf-4998-b655-c8e4ccd2178d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:23:16 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e4394730-3826-42a8-9546-e20f4d21ea77 tempest-VolumesDeleteCascade-398376463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c54eade9-fdbf-4998-b655-c8e4ccd2178d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:23:16 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e4394730-3826-42a8-9546-e20f4d21ea77 tempest-VolumesDeleteCascade-398376463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27baecea-bb14-4a42-ad32-dabecc9ab1f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:23:16 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e4394730-3826-42a8-9546-e20f4d21ea77 tempest-VolumesDeleteCascade-398376463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27baecea-bb14-4a42-ad32-dabecc9ab1f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '623e3c53-e277-457b-89e1-21eafcaeb74d', 'volume_name': 'volume-623e3c53-e277-457b-89e1-21eafcaeb74d', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:23:16 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e4394730-3826-42a8-9546-e20f4d21ea77 tempest-VolumesDeleteCascade-398376463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d69e254d-f649-417c-b12e-c38945672825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:23:16 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e4394730-3826-42a8-9546-e20f4d21ea77 tempest-VolumesDeleteCascade-398376463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d69e254d-f649-417c-b12e-c38945672825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:23:16 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e4394730-3826-42a8-9546-e20f4d21ea77 tempest-VolumesDeleteCascade-398376463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (911bbd1d-bf7a-4370-9598-ee82288f3a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:23:16 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-e4394730-3826-42a8-9546-e20f4d21ea77 tempest-VolumesDeleteCascade-398376463 None] Volume 623e3c53-e277-457b-89e1-21eafcaeb74d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-623e3c53-e277-457b-89e1-21eafcaeb74d', 'volume_size': 1} Apr 29 15:23:16 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-e4394730-3826-42a8-9546-e20f4d21ea77 tempest-VolumesDeleteCascade-398376463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:23:16 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-e4394730-3826-42a8-9546-e20f4d21ea77 tempest-VolumesDeleteCascade-398376463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:23:16 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-e4394730-3826-42a8-9546-e20f4d21ea77 tempest-VolumesDeleteCascade-398376463 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:23:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1188490054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=623e3c53-e277-457b-89e1-21eafcaeb74d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c4f94025b594b37ba67e3a4a845b795',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:23:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:23:16Z,use_quota=True,user_id='1f4382ad45db4e10a30a8f3a76751e71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:23:16 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-e4394730-3826-42a8-9546-e20f4d21ea77 tempest-VolumesDeleteCascade-398376463 None] Creating volume 623e3c53-e277-457b-89e1-21eafcaeb74d {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:23:16 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-e4394730-3826-42a8-9546-e20f4d21ea77 tempest-VolumesDeleteCascade-398376463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:23:16 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-e4394730-3826-42a8-9546-e20f4d21ea77 tempest-VolumesDeleteCascade-398376463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:23:16 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-e4394730-3826-42a8-9546-e20f4d21ea77 tempest-VolumesDeleteCascade-398376463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:23:16 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-e4394730-3826-42a8-9546-e20f4d21ea77 tempest-VolumesDeleteCascade-398376463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:23:16 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-e4394730-3826-42a8-9546-e20f4d21ea77 tempest-VolumesDeleteCascade-398376463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:23:16 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-e4394730-3826-42a8-9546-e20f4d21ea77 tempest-VolumesDeleteCascade-398376463 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:23:16 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-e4394730-3826-42a8-9546-e20f4d21ea77 tempest-VolumesDeleteCascade-398376463 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:23:16 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-e4394730-3826-42a8-9546-e20f4d21ea77 tempest-VolumesDeleteCascade-398376463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-623e3c53-e277-457b-89e1-21eafcaeb74d 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:23:16 devstack sudo[102896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-623e3c53-e277-457b-89e1-21eafcaeb74d 1073741824 Apr 29 15:23:16 devstack sudo[102896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:23:17 devstack sudo[102896]: pam_unix(sudo:session): session closed for user root Apr 29 15:23:17 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-e4394730-3826-42a8-9546-e20f4d21ea77 tempest-VolumesDeleteCascade-398376463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-623e3c53-e277-457b-89e1-21eafcaeb74d 1073741824" returned: 0 in 0.999s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:23:17 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-e4394730-3826-42a8-9546-e20f4d21ea77 tempest-VolumesDeleteCascade-398376463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-623e3c53-e277-457b-89e1-21eafcaeb74d {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:23:17 devstack sudo[102902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-623e3c53-e277-457b-89e1-21eafcaeb74d Apr 29 15:23:17 devstack sudo[102902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:23:18 devstack sudo[102902]: pam_unix(sudo:session): session closed for user root Apr 29 15:23:18 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-e4394730-3826-42a8-9546-e20f4d21ea77 tempest-VolumesDeleteCascade-398376463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-623e3c53-e277-457b-89e1-21eafcaeb74d" returned: 0 in 0.835s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:23:18 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-e4394730-3826-42a8-9546-e20f4d21ea77 tempest-VolumesDeleteCascade-398376463 None] <== create_volume: return (1918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:23:18 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-e4394730-3826-42a8-9546-e20f4d21ea77 tempest-VolumesDeleteCascade-398376463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.920s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:23:18 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e4394730-3826-42a8-9546-e20f4d21ea77 tempest-VolumesDeleteCascade-398376463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (911bbd1d-bf7a-4370-9598-ee82288f3a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-623e3c53-e277-457b-89e1-21eafcaeb74d', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:23:18 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e4394730-3826-42a8-9546-e20f4d21ea77 tempest-VolumesDeleteCascade-398376463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (480ff75d-d62f-430d-a8b8-cfe4b478930f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:23:18 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-e4394730-3826-42a8-9546-e20f4d21ea77 tempest-VolumesDeleteCascade-398376463 None] Volume volume-623e3c53-e277-457b-89e1-21eafcaeb74d (623e3c53-e277-457b-89e1-21eafcaeb74d): created successfully Apr 29 15:23:18 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e4394730-3826-42a8-9546-e20f4d21ea77 tempest-VolumesDeleteCascade-398376463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (480ff75d-d62f-430d-a8b8-cfe4b478930f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:23:18 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e4394730-3826-42a8-9546-e20f4d21ea77 tempest-VolumesDeleteCascade-398376463 None] Flow 'volume_create_manager' (aec3f879-2ae9-4d91-ab03-3d586bf15eba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:23:18 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-e4394730-3826-42a8-9546-e20f4d21ea77 tempest-VolumesDeleteCascade-398376463 None] Created volume successfully. Apr 29 15:23:18 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec6068a5-62c6-4a0c-a474-16deec625604 tempest-VolumesCloneTest-887289948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:23:18 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-ec6068a5-62c6-4a0c-a474-16deec625604 tempest-VolumesCloneTest-887289948 None] Flow 'volume_create_manager' (4697d9ff-00f3-41df-8ebc-cf3e90a0d685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:23:18 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-ec6068a5-62c6-4a0c-a474-16deec625604 tempest-VolumesCloneTest-887289948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94e280e4-60c4-43be-9fc8-ffe6d60cff3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:23:18 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-ec6068a5-62c6-4a0c-a474-16deec625604 tempest-VolumesCloneTest-887289948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94e280e4-60c4-43be-9fc8-ffe6d60cff3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:23:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-46179785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b98636e-f0d6-4149-8cde-45362569b0a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0667c8021630455f8d75f738afd3944a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:23:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:23:18Z,use_quota=True,user_id='cd65fb598f8f45ea86fe5064f8172bff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:23:18 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-ec6068a5-62c6-4a0c-a474-16deec625604 tempest-VolumesCloneTest-887289948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9df0475f-6468-46c8-ad0c-f7ab8182c372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:23:18 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-ec6068a5-62c6-4a0c-a474-16deec625604 tempest-VolumesCloneTest-887289948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9df0475f-6468-46c8-ad0c-f7ab8182c372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:23:18 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-ec6068a5-62c6-4a0c-a474-16deec625604 tempest-VolumesCloneTest-887289948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74c450c5-0117-4c32-9249-c110abe6f8f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:23:18 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-ec6068a5-62c6-4a0c-a474-16deec625604 tempest-VolumesCloneTest-887289948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74c450c5-0117-4c32-9249-c110abe6f8f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b98636e-f0d6-4149-8cde-45362569b0a9', 'volume_name': 'volume-4b98636e-f0d6-4149-8cde-45362569b0a9', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:23:18 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-ec6068a5-62c6-4a0c-a474-16deec625604 tempest-VolumesCloneTest-887289948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (783a12a9-f353-439c-a411-ecc16c5c4879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:23:18 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-ec6068a5-62c6-4a0c-a474-16deec625604 tempest-VolumesCloneTest-887289948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (783a12a9-f353-439c-a411-ecc16c5c4879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:23:18 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-ec6068a5-62c6-4a0c-a474-16deec625604 tempest-VolumesCloneTest-887289948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07675a48-aec3-401c-9a1f-02ded3c1c738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:23:18 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-ec6068a5-62c6-4a0c-a474-16deec625604 tempest-VolumesCloneTest-887289948 None] Volume 4b98636e-f0d6-4149-8cde-45362569b0a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b98636e-f0d6-4149-8cde-45362569b0a9', 'volume_size': 1} Apr 29 15:23:18 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-ec6068a5-62c6-4a0c-a474-16deec625604 tempest-VolumesCloneTest-887289948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:23:18 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-ec6068a5-62c6-4a0c-a474-16deec625604 tempest-VolumesCloneTest-887289948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:23:18 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-ec6068a5-62c6-4a0c-a474-16deec625604 tempest-VolumesCloneTest-887289948 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:23:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-46179785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b98636e-f0d6-4149-8cde-45362569b0a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0667c8021630455f8d75f738afd3944a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:23:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:23:18Z,use_quota=True,user_id='cd65fb598f8f45ea86fe5064f8172bff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:23:18 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-ec6068a5-62c6-4a0c-a474-16deec625604 tempest-VolumesCloneTest-887289948 None] Creating volume 4b98636e-f0d6-4149-8cde-45362569b0a9 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:23:18 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-ec6068a5-62c6-4a0c-a474-16deec625604 tempest-VolumesCloneTest-887289948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:23:18 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-ec6068a5-62c6-4a0c-a474-16deec625604 tempest-VolumesCloneTest-887289948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:23:18 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-ec6068a5-62c6-4a0c-a474-16deec625604 tempest-VolumesCloneTest-887289948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:23:18 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-ec6068a5-62c6-4a0c-a474-16deec625604 tempest-VolumesCloneTest-887289948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:23:18 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-ec6068a5-62c6-4a0c-a474-16deec625604 tempest-VolumesCloneTest-887289948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:23:18 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-ec6068a5-62c6-4a0c-a474-16deec625604 tempest-VolumesCloneTest-887289948 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:23:18 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-ec6068a5-62c6-4a0c-a474-16deec625604 tempest-VolumesCloneTest-887289948 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:23:18 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ec6068a5-62c6-4a0c-a474-16deec625604 tempest-VolumesCloneTest-887289948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4b98636e-f0d6-4149-8cde-45362569b0a9 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:23:18 devstack sudo[102905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4b98636e-f0d6-4149-8cde-45362569b0a9 1073741824 Apr 29 15:23:18 devstack sudo[102905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:23:19 devstack sudo[102905]: pam_unix(sudo:session): session closed for user root Apr 29 15:23:19 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ec6068a5-62c6-4a0c-a474-16deec625604 tempest-VolumesCloneTest-887289948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4b98636e-f0d6-4149-8cde-45362569b0a9 1073741824" returned: 0 in 1.009s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:23:19 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ec6068a5-62c6-4a0c-a474-16deec625604 tempest-VolumesCloneTest-887289948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4b98636e-f0d6-4149-8cde-45362569b0a9 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:23:19 devstack sudo[102911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4b98636e-f0d6-4149-8cde-45362569b0a9 Apr 29 15:23:19 devstack sudo[102911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:23:19 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-0f7f4fe4-ce67-46f4-a9a4-10087b500924 tempest-VolumesDeleteCascade-398376463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:23:20 devstack sudo[102911]: pam_unix(sudo:session): session closed for user root Apr 29 15:23:20 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ec6068a5-62c6-4a0c-a474-16deec625604 tempest-VolumesCloneTest-887289948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4b98636e-f0d6-4149-8cde-45362569b0a9" returned: 0 in 0.700s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:23:20 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-ec6068a5-62c6-4a0c-a474-16deec625604 tempest-VolumesCloneTest-887289948 None] <== create_volume: return (1783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:23:20 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-ec6068a5-62c6-4a0c-a474-16deec625604 tempest-VolumesCloneTest-887289948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.786s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:23:20 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-0f7f4fe4-ce67-46f4-a9a4-10087b500924 tempest-VolumesDeleteCascade-398376463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.531s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:23:20 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-ec6068a5-62c6-4a0c-a474-16deec625604 tempest-VolumesCloneTest-887289948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07675a48-aec3-401c-9a1f-02ded3c1c738) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b98636e-f0d6-4149-8cde-45362569b0a9', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:23:20 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-ec6068a5-62c6-4a0c-a474-16deec625604 tempest-VolumesCloneTest-887289948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2e6911d-e049-46af-b84f-fa7e98bdf4fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:23:20 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-0f7f4fe4-ce67-46f4-a9a4-10087b500924 tempest-VolumesDeleteCascade-398376463 None] Creating offline snapshot 9ddb7a29-b53b-4417-b4c9-133e4f1501c4 of volume 623e3c53-e277-457b-89e1-21eafcaeb74d {{(pid=84448) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 15:23:20 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-ec6068a5-62c6-4a0c-a474-16deec625604 tempest-VolumesCloneTest-887289948 None] Volume volume-4b98636e-f0d6-4149-8cde-45362569b0a9 (4b98636e-f0d6-4149-8cde-45362569b0a9): created successfully Apr 29 15:23:20 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-ec6068a5-62c6-4a0c-a474-16deec625604 tempest-VolumesCloneTest-887289948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2e6911d-e049-46af-b84f-fa7e98bdf4fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:23:20 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-ec6068a5-62c6-4a0c-a474-16deec625604 tempest-VolumesCloneTest-887289948 None] Flow 'volume_create_manager' (4697d9ff-00f3-41df-8ebc-cf3e90a0d685) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:23:20 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a791a8-ca47-4359-97b2-a93c1fa1274f]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:23:20 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-0f7f4fe4-ce67-46f4-a9a4-10087b500924 tempest-VolumesDeleteCascade-398376463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-623e3c53-e277-457b-89e1-21eafcaeb74d {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:23:20 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-ec6068a5-62c6-4a0c-a474-16deec625604 tempest-VolumesCloneTest-887289948 None] Created volume successfully. Apr 29 15:23:20 devstack sudo[102914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-623e3c53-e277-457b-89e1-21eafcaeb74d Apr 29 15:23:20 devstack sudo[102914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:23:20 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-1247d15f-7d30-476c-934a-e29ea758d0f9 tempest-VolumesCloneTest-887289948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:23:21 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-1247d15f-7d30-476c-934a-e29ea758d0f9 tempest-VolumesCloneTest-887289948 None] Flow 'volume_create_manager' (7c7ac715-13ae-4d89-b747-8f2a49200b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:23:21 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-1247d15f-7d30-476c-934a-e29ea758d0f9 tempest-VolumesCloneTest-887289948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbbe3f06-3a21-4844-a469-8294e5bf0a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:23:21 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-1247d15f-7d30-476c-934a-e29ea758d0f9 tempest-VolumesCloneTest-887289948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbbe3f06-3a21-4844-a469-8294e5bf0a36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:23:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1431336898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8896024-5ced-4165-8f10-4355a31fc3d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0667c8021630455f8d75f738afd3944a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:23:21Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=4b98636e-f0d6-4149-8cde-45362569b0a9,status='creating',terminated_at=None,updated_at=2026-04-29T13:23:21Z,use_quota=True,user_id='cd65fb598f8f45ea86fe5064f8172bff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:23:21 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-1247d15f-7d30-476c-934a-e29ea758d0f9 tempest-VolumesCloneTest-887289948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fed86ab1-e014-4755-83b4-5719ef7bc149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:23:21 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-1247d15f-7d30-476c-934a-e29ea758d0f9 tempest-VolumesCloneTest-887289948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fed86ab1-e014-4755-83b4-5719ef7bc149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:23:21 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-1247d15f-7d30-476c-934a-e29ea758d0f9 tempest-VolumesCloneTest-887289948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6f11142-1866-405e-a7b8-55694d29334c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:23:21 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-1247d15f-7d30-476c-934a-e29ea758d0f9 tempest-VolumesCloneTest-887289948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6f11142-1866-405e-a7b8-55694d29334c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'f8896024-5ced-4165-8f10-4355a31fc3d0', 'volume_name': 'volume-f8896024-5ced-4165-8f10-4355a31fc3d0', 'volume_size': 2, 'source_volid': '4b98636e-f0d6-4149-8cde-45362569b0a9', 'source_volstatus': 'available'}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:23:21 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-1247d15f-7d30-476c-934a-e29ea758d0f9 tempest-VolumesCloneTest-887289948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eccf462e-1464-4c28-aa8d-135901c25443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:23:21 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-1247d15f-7d30-476c-934a-e29ea758d0f9 tempest-VolumesCloneTest-887289948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eccf462e-1464-4c28-aa8d-135901c25443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:23:21 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-1247d15f-7d30-476c-934a-e29ea758d0f9 tempest-VolumesCloneTest-887289948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87151866-c50b-4ff0-be5c-55dcd806ede3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:23:21 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-1247d15f-7d30-476c-934a-e29ea758d0f9 tempest-VolumesCloneTest-887289948 None] Volume f8896024-5ced-4165-8f10-4355a31fc3d0: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-f8896024-5ced-4165-8f10-4355a31fc3d0', 'volume_size': 2, 'source_volid': '4b98636e-f0d6-4149-8cde-45362569b0a9', 'source_volstatus': 'available'} Apr 29 15:23:21 devstack sudo[102914]: pam_unix(sudo:session): session closed for user root Apr 29 15:23:21 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-0f7f4fe4-ce67-46f4-a9a4-10087b500924 tempest-VolumesDeleteCascade-398376463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-623e3c53-e277-457b-89e1-21eafcaeb74d" returned: 0 in 0.886s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:23:21 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-0f7f4fe4-ce67-46f4-a9a4-10087b500924 tempest-VolumesDeleteCascade-398376463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-623e3c53-e277-457b-89e1-21eafcaeb74d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-623e3c53-e277-457b-89e1-21eafcaeb74d.9ddb7a29-b53b-4417-b4c9-133e4f1501c4 1G {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:23:21 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-1247d15f-7d30-476c-934a-e29ea758d0f9 tempest-VolumesCloneTest-887289948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:23:21 devstack sudo[102919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-623e3c53-e277-457b-89e1-21eafcaeb74d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-623e3c53-e277-457b-89e1-21eafcaeb74d.9ddb7a29-b53b-4417-b4c9-133e4f1501c4 1G Apr 29 15:23:21 devstack sudo[102919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:23:21 devstack sudo[102919]: pam_unix(sudo:session): session closed for user root Apr 29 15:23:22 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-0f7f4fe4-ce67-46f4-a9a4-10087b500924 tempest-VolumesDeleteCascade-398376463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-623e3c53-e277-457b-89e1-21eafcaeb74d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-623e3c53-e277-457b-89e1-21eafcaeb74d.9ddb7a29-b53b-4417-b4c9-133e4f1501c4 1G" returned: 0 in 0.825s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:23:22 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-0f7f4fe4-ce67-46f4-a9a4-10087b500924 tempest-VolumesDeleteCascade-398376463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-623e3c53-e277-457b-89e1-21eafcaeb74d -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-623e3c53-e277-457b-89e1-21eafcaeb74d.9ddb7a29-b53b-4417-b4c9-133e4f1501c4 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:23:22 devstack sudo[102925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-623e3c53-e277-457b-89e1-21eafcaeb74d -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-623e3c53-e277-457b-89e1-21eafcaeb74d.9ddb7a29-b53b-4417-b4c9-133e4f1501c4 Apr 29 15:23:22 devstack sudo[102925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:23:22 devstack sudo[102925]: pam_unix(sudo:session): session closed for user root Apr 29 15:23:22 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-0f7f4fe4-ce67-46f4-a9a4-10087b500924 tempest-VolumesDeleteCascade-398376463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-623e3c53-e277-457b-89e1-21eafcaeb74d -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-623e3c53-e277-457b-89e1-21eafcaeb74d.9ddb7a29-b53b-4417-b4c9-133e4f1501c4" returned: 0 in 0.696s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:23:22 devstack cinder-volume[84448]: WARNING cinder.volume.drivers.remotefs [None req-0f7f4fe4-ce67-46f4-a9a4-10087b500924 tempest-VolumesDeleteCascade-398376463 None] /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-623e3c53-e277-457b-89e1-21eafcaeb74d.9ddb7a29-b53b-4417-b4c9-133e4f1501c4 is being set with open permissions: ugo+rw Apr 29 15:23:22 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-0f7f4fe4-ce67-46f4-a9a4-10087b500924 tempest-VolumesDeleteCascade-398376463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-623e3c53-e277-457b-89e1-21eafcaeb74d.9ddb7a29-b53b-4417-b4c9-133e4f1501c4 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:23:22 devstack sudo[102930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-623e3c53-e277-457b-89e1-21eafcaeb74d.9ddb7a29-b53b-4417-b4c9-133e4f1501c4 Apr 29 15:23:22 devstack sudo[102930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:23:23 devstack sudo[102930]: pam_unix(sudo:session): session closed for user root Apr 29 15:23:23 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-0f7f4fe4-ce67-46f4-a9a4-10087b500924 tempest-VolumesDeleteCascade-398376463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-623e3c53-e277-457b-89e1-21eafcaeb74d.9ddb7a29-b53b-4417-b4c9-133e4f1501c4" returned: 0 in 0.628s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:23:23 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-0f7f4fe4-ce67-46f4-a9a4-10087b500924 tempest-VolumesDeleteCascade-398376463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-623e3c53-e277-457b-89e1-21eafcaeb74d.info {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:23:23 devstack sudo[102933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-623e3c53-e277-457b-89e1-21eafcaeb74d.info Apr 29 15:23:23 devstack sudo[102933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:23:24 devstack sudo[102933]: pam_unix(sudo:session): session closed for user root Apr 29 15:23:24 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-0f7f4fe4-ce67-46f4-a9a4-10087b500924 tempest-VolumesDeleteCascade-398376463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-623e3c53-e277-457b-89e1-21eafcaeb74d.info" returned: 0 in 0.670s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:23:24 devstack cinder-volume[84448]: WARNING cinder.volume.drivers.remotefs [None req-0f7f4fe4-ce67-46f4-a9a4-10087b500924 tempest-VolumesDeleteCascade-398376463 None] /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-623e3c53-e277-457b-89e1-21eafcaeb74d.info is being set with open permissions: ugo+rw Apr 29 15:23:24 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-0f7f4fe4-ce67-46f4-a9a4-10087b500924 tempest-VolumesDeleteCascade-398376463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-623e3c53-e277-457b-89e1-21eafcaeb74d.info {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:23:24 devstack sudo[102936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-623e3c53-e277-457b-89e1-21eafcaeb74d.info Apr 29 15:23:24 devstack sudo[102936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:23:24 devstack sudo[102936]: pam_unix(sudo:session): session closed for user root Apr 29 15:23:24 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-0f7f4fe4-ce67-46f4-a9a4-10087b500924 tempest-VolumesDeleteCascade-398376463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-623e3c53-e277-457b-89e1-21eafcaeb74d.info" returned: 0 in 0.628s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:23:24 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-0f7f4fe4-ce67-46f4-a9a4-10087b500924 tempest-VolumesDeleteCascade-398376463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.456s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:23:24 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-1247d15f-7d30-476c-934a-e29ea758d0f9 tempest-VolumesCloneTest-887289948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 3.492s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:23:24 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-1247d15f-7d30-476c-934a-e29ea758d0f9 tempest-VolumesCloneTest-887289948 None] Cloning volume 4b98636e-f0d6-4149-8cde-45362569b0a9 to volume f8896024-5ced-4165-8f10-4355a31fc3d0 Apr 29 15:23:24 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-0f7f4fe4-ce67-46f4-a9a4-10087b500924 tempest-VolumesDeleteCascade-398376463 None] Create snapshot completed successfully Apr 29 15:23:24 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-1247d15f-7d30-476c-934a-e29ea758d0f9 tempest-VolumesCloneTest-887289948 None] Creating offline snapshot 11bd0955-1f86-40f9-a2e4-4b7616a09a22 of volume 4b98636e-f0d6-4149-8cde-45362569b0a9 {{(pid=84448) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 15:23:24 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a35f91-7d1a-416a-bd8c-3dbcf8ef2c34]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:23:24 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1247d15f-7d30-476c-934a-e29ea758d0f9 tempest-VolumesCloneTest-887289948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4b98636e-f0d6-4149-8cde-45362569b0a9 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:23:24 devstack sudo[102939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4b98636e-f0d6-4149-8cde-45362569b0a9 Apr 29 15:23:24 devstack sudo[102939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:23:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-721fa9b0-9181-44f9-a19f-d59338081be3 tempest-VolumesDeleteCascade-398376463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:23:25 devstack sudo[102939]: pam_unix(sudo:session): session closed for user root Apr 29 15:23:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1247d15f-7d30-476c-934a-e29ea758d0f9 tempest-VolumesCloneTest-887289948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4b98636e-f0d6-4149-8cde-45362569b0a9" returned: 0 in 0.769s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:23:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1247d15f-7d30-476c-934a-e29ea758d0f9 tempest-VolumesCloneTest-887289948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4b98636e-f0d6-4149-8cde-45362569b0a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4b98636e-f0d6-4149-8cde-45362569b0a9.11bd0955-1f86-40f9-a2e4-4b7616a09a22 1G {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:23:25 devstack sudo[102944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4b98636e-f0d6-4149-8cde-45362569b0a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4b98636e-f0d6-4149-8cde-45362569b0a9.11bd0955-1f86-40f9-a2e4-4b7616a09a22 1G Apr 29 15:23:25 devstack sudo[102944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:23:26 devstack sudo[102944]: pam_unix(sudo:session): session closed for user root Apr 29 15:23:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1247d15f-7d30-476c-934a-e29ea758d0f9 tempest-VolumesCloneTest-887289948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4b98636e-f0d6-4149-8cde-45362569b0a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4b98636e-f0d6-4149-8cde-45362569b0a9.11bd0955-1f86-40f9-a2e4-4b7616a09a22 1G" returned: 0 in 0.845s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:23:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1247d15f-7d30-476c-934a-e29ea758d0f9 tempest-VolumesCloneTest-887289948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b98636e-f0d6-4149-8cde-45362569b0a9 -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4b98636e-f0d6-4149-8cde-45362569b0a9.11bd0955-1f86-40f9-a2e4-4b7616a09a22 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:23:26 devstack sudo[102951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b98636e-f0d6-4149-8cde-45362569b0a9 -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4b98636e-f0d6-4149-8cde-45362569b0a9.11bd0955-1f86-40f9-a2e4-4b7616a09a22 Apr 29 15:23:26 devstack sudo[102951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:23:27 devstack sudo[102951]: pam_unix(sudo:session): session closed for user root Apr 29 15:23:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1247d15f-7d30-476c-934a-e29ea758d0f9 tempest-VolumesCloneTest-887289948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b98636e-f0d6-4149-8cde-45362569b0a9 -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4b98636e-f0d6-4149-8cde-45362569b0a9.11bd0955-1f86-40f9-a2e4-4b7616a09a22" returned: 0 in 0.767s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:23:27 devstack cinder-volume[84448]: WARNING cinder.volume.drivers.remotefs [None req-1247d15f-7d30-476c-934a-e29ea758d0f9 tempest-VolumesCloneTest-887289948 None] /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4b98636e-f0d6-4149-8cde-45362569b0a9.11bd0955-1f86-40f9-a2e4-4b7616a09a22 is being set with open permissions: ugo+rw Apr 29 15:23:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1247d15f-7d30-476c-934a-e29ea758d0f9 tempest-VolumesCloneTest-887289948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4b98636e-f0d6-4149-8cde-45362569b0a9.11bd0955-1f86-40f9-a2e4-4b7616a09a22 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:23:27 devstack sudo[102956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4b98636e-f0d6-4149-8cde-45362569b0a9.11bd0955-1f86-40f9-a2e4-4b7616a09a22 Apr 29 15:23:27 devstack sudo[102956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:23:27 devstack sudo[102956]: pam_unix(sudo:session): session closed for user root Apr 29 15:23:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1247d15f-7d30-476c-934a-e29ea758d0f9 tempest-VolumesCloneTest-887289948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4b98636e-f0d6-4149-8cde-45362569b0a9.11bd0955-1f86-40f9-a2e4-4b7616a09a22" returned: 0 in 0.669s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:23:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1247d15f-7d30-476c-934a-e29ea758d0f9 tempest-VolumesCloneTest-887289948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4b98636e-f0d6-4149-8cde-45362569b0a9.info {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:23:27 devstack sudo[102959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4b98636e-f0d6-4149-8cde-45362569b0a9.info Apr 29 15:23:27 devstack sudo[102959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:23:28 devstack sudo[102959]: pam_unix(sudo:session): session closed for user root Apr 29 15:23:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1247d15f-7d30-476c-934a-e29ea758d0f9 tempest-VolumesCloneTest-887289948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4b98636e-f0d6-4149-8cde-45362569b0a9.info" returned: 0 in 0.703s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:23:28 devstack cinder-volume[84448]: WARNING cinder.volume.drivers.remotefs [None req-1247d15f-7d30-476c-934a-e29ea758d0f9 tempest-VolumesCloneTest-887289948 None] /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4b98636e-f0d6-4149-8cde-45362569b0a9.info is being set with open permissions: ugo+rw Apr 29 15:23:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1247d15f-7d30-476c-934a-e29ea758d0f9 tempest-VolumesCloneTest-887289948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4b98636e-f0d6-4149-8cde-45362569b0a9.info {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:23:28 devstack sudo[102962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4b98636e-f0d6-4149-8cde-45362569b0a9.info Apr 29 15:23:28 devstack sudo[102962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:23:29 devstack sudo[102962]: pam_unix(sudo:session): session closed for user root Apr 29 15:23:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1247d15f-7d30-476c-934a-e29ea758d0f9 tempest-VolumesCloneTest-887289948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4b98636e-f0d6-4149-8cde-45362569b0a9.info" returned: 0 in 0.668s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:23:29 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-1247d15f-7d30-476c-934a-e29ea758d0f9 tempest-VolumesCloneTest-887289948 None] Acquiring lock "cinder-quobyte-f8896024-5ced-4165-8f10-4355a31fc3d0" by "_copy_volume_from_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:23:29 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-1247d15f-7d30-476c-934a-e29ea758d0f9 tempest-VolumesCloneTest-887289948 None] Lock "cinder-quobyte-f8896024-5ced-4165-8f10-4355a31fc3d0" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:23:29 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-1247d15f-7d30-476c-934a-e29ea758d0f9 tempest-VolumesCloneTest-887289948 None] snapshot: 11bd0955-1f86-40f9-a2e4-4b7616a09a22, volume: f8896024-5ced-4165-8f10-4355a31fc3d0, {{(pid=84448) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 15:23:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-1247d15f-7d30-476c-934a-e29ea758d0f9 tempest-VolumesCloneTest-887289948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:23:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-1247d15f-7d30-476c-934a-e29ea758d0f9 tempest-VolumesCloneTest-887289948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:23:29 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-1247d15f-7d30-476c-934a-e29ea758d0f9 tempest-VolumesCloneTest-887289948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:23:29 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-1247d15f-7d30-476c-934a-e29ea758d0f9 tempest-VolumesCloneTest-887289948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:23:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-1247d15f-7d30-476c-934a-e29ea758d0f9 tempest-VolumesCloneTest-887289948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:23:29 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[905de148-58d0-4b1e-884d-db5bfcacd782]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:23:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1247d15f-7d30-476c-934a-e29ea758d0f9 tempest-VolumesCloneTest-887289948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4b98636e-f0d6-4149-8cde-45362569b0a9.11bd0955-1f86-40f9-a2e4-4b7616a09a22 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:23:29 devstack sudo[102965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4b98636e-f0d6-4149-8cde-45362569b0a9.11bd0955-1f86-40f9-a2e4-4b7616a09a22 Apr 29 15:23:29 devstack sudo[102965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:23:30 devstack sudo[102965]: pam_unix(sudo:session): session closed for user root Apr 29 15:23:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1247d15f-7d30-476c-934a-e29ea758d0f9 tempest-VolumesCloneTest-887289948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4b98636e-f0d6-4149-8cde-45362569b0a9.11bd0955-1f86-40f9-a2e4-4b7616a09a22" returned: 0 in 0.738s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:23:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-1247d15f-7d30-476c-934a-e29ea758d0f9 tempest-VolumesCloneTest-887289948 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b98636e-f0d6-4149-8cde-45362569b0a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84448) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 15:23:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-1247d15f-7d30-476c-934a-e29ea758d0f9 tempest-VolumesCloneTest-887289948 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4b98636e-f0d6-4149-8cde-45362569b0a9 {{(pid=84448) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 15:23:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-1247d15f-7d30-476c-934a-e29ea758d0f9 tempest-VolumesCloneTest-887289948 None] Creating direct copy from snapshot {{(pid=84448) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 15:23:30 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[dffe00ea-4047-4c4f-8a7a-1635b72daf11]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:23:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1247d15f-7d30-476c-934a-e29ea758d0f9 tempest-VolumesCloneTest-887289948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4b98636e-f0d6-4149-8cde-45362569b0a9 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:23:30 devstack sudo[102970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4b98636e-f0d6-4149-8cde-45362569b0a9 Apr 29 15:23:30 devstack sudo[102970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:23:30 devstack cinder-volume[84448]: DEBUG oslo_service.periodic_task [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84448) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 15:23:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:23:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:23:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:23:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:23:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:23:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:23:30 devstack sudo[102972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:23:30 devstack sudo[102972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:23:30 devstack sudo[102970]: pam_unix(sudo:session): session closed for user root Apr 29 15:23:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1247d15f-7d30-476c-934a-e29ea758d0f9 tempest-VolumesCloneTest-887289948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4b98636e-f0d6-4149-8cde-45362569b0a9" returned: 0 in 0.788s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:23:30 devstack cinder-volume[84448]: DEBUG cinder.utils [None req-1247d15f-7d30-476c-934a-e29ea758d0f9 tempest-VolumesCloneTest-887289948 None] Path /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f8896024-5ced-4165-8f10-4355a31fc3d0 not found in is_blk_device check {{(pid=84448) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 15:23:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1247d15f-7d30-476c-934a-e29ea758d0f9 tempest-VolumesCloneTest-887289948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4b98636e-f0d6-4149-8cde-45362569b0a9 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f8896024-5ced-4165-8f10-4355a31fc3d0 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:23:30 devstack sudo[102978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4b98636e-f0d6-4149-8cde-45362569b0a9 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f8896024-5ced-4165-8f10-4355a31fc3d0 Apr 29 15:23:30 devstack sudo[102978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:23:31 devstack sudo[102972]: pam_unix(sudo:session): session closed for user root Apr 29 15:23:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.666s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:23:31 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:23:36 devstack sudo[102978]: pam_unix(sudo:session): session closed for user root Apr 29 15:23:36 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1247d15f-7d30-476c-934a-e29ea758d0f9 tempest-VolumesCloneTest-887289948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4b98636e-f0d6-4149-8cde-45362569b0a9 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f8896024-5ced-4165-8f10-4355a31fc3d0" returned: 0 in 5.678s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:23:36 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fcc34fd-dfbe-4a89-8a66-bc5db5ef4da9]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:23:36 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1247d15f-7d30-476c-934a-e29ea758d0f9 tempest-VolumesCloneTest-887289948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4b98636e-f0d6-4149-8cde-45362569b0a9 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:23:36 devstack sudo[103036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4b98636e-f0d6-4149-8cde-45362569b0a9 Apr 29 15:23:36 devstack sudo[103036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:23:37 devstack sudo[103036]: pam_unix(sudo:session): session closed for user root Apr 29 15:23:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1247d15f-7d30-476c-934a-e29ea758d0f9 tempest-VolumesCloneTest-887289948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4b98636e-f0d6-4149-8cde-45362569b0a9" returned: 0 in 0.993s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:23:37 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [None req-1247d15f-7d30-476c-934a-e29ea758d0f9 tempest-VolumesCloneTest-887289948 None] Image conversion details: src /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4b98636e-f0d6-4149-8cde-45362569b0a9, size 1024.00 MB, duration 5.68 sec, destination /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f8896024-5ced-4165-8f10-4355a31fc3d0 {{(pid=84448) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 15:23:37 devstack cinder-volume[84448]: INFO cinder.image.image_utils [None req-1247d15f-7d30-476c-934a-e29ea758d0f9 tempest-VolumesCloneTest-887289948 None] Converted 1024.00 MB image at 180.29 MB/s Apr 29 15:23:37 devstack cinder-volume[84448]: WARNING cinder.volume.drivers.remotefs [None req-1247d15f-7d30-476c-934a-e29ea758d0f9 tempest-VolumesCloneTest-887289948 None] /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f8896024-5ced-4165-8f10-4355a31fc3d0 is being set with open permissions: ugo+rw Apr 29 15:23:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1247d15f-7d30-476c-934a-e29ea758d0f9 tempest-VolumesCloneTest-887289948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f8896024-5ced-4165-8f10-4355a31fc3d0 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:23:37 devstack sudo[103045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f8896024-5ced-4165-8f10-4355a31fc3d0 Apr 29 15:23:37 devstack sudo[103045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:23:37 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:SELECT=39,cinder:INSERT=9,cinder:UPDATE=37,cinder:DELETE=2 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:23:37 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:SELECT=27,cinder:INSERT=13,cinder:UPDATE=50,cinder:DELETE=6 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:23:37 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b1df747-5a85-4f63-aeb5-8ffefc9ba7e1 tempest-TestStampPattern-538910304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:23:37 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-3b1df747-5a85-4f63-aeb5-8ffefc9ba7e1 tempest-TestStampPattern-538910304 None] Flow 'volume_create_manager' (2ed988b1-18dc-4442-aebf-ae9f6396f5ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:23:37 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-3b1df747-5a85-4f63-aeb5-8ffefc9ba7e1 tempest-TestStampPattern-538910304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1bd45a7-3bfd-409b-934d-47f23c77c54c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:23:37 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-3b1df747-5a85-4f63-aeb5-8ffefc9ba7e1 tempest-TestStampPattern-538910304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1bd45a7-3bfd-409b-934d-47f23c77c54c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1482758823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f8608b3-7b48-4cd7-b080-07172ef4409b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb6410b29eb94132976abf0c5cd51b54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:23:38Z,use_quota=True,user_id='ba2ca1ba522d4106a3f6dbff043f36d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:23:37 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-3b1df747-5a85-4f63-aeb5-8ffefc9ba7e1 tempest-TestStampPattern-538910304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ef47626-4e4f-426a-875e-514115e17d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:23:37 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-3b1df747-5a85-4f63-aeb5-8ffefc9ba7e1 tempest-TestStampPattern-538910304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ef47626-4e4f-426a-875e-514115e17d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:23:37 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-3b1df747-5a85-4f63-aeb5-8ffefc9ba7e1 tempest-TestStampPattern-538910304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13e31ed0-9b20-4cf9-8124-fc8b86277fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:23:37 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-3b1df747-5a85-4f63-aeb5-8ffefc9ba7e1 tempest-TestStampPattern-538910304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13e31ed0-9b20-4cf9-8124-fc8b86277fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f8608b3-7b48-4cd7-b080-07172ef4409b', 'volume_name': 'volume-2f8608b3-7b48-4cd7-b080-07172ef4409b', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:23:38 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-3b1df747-5a85-4f63-aeb5-8ffefc9ba7e1 tempest-TestStampPattern-538910304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0553e514-22e2-4858-8fe5-9a2679acab39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:23:38 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-3b1df747-5a85-4f63-aeb5-8ffefc9ba7e1 tempest-TestStampPattern-538910304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0553e514-22e2-4858-8fe5-9a2679acab39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:23:38 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-3b1df747-5a85-4f63-aeb5-8ffefc9ba7e1 tempest-TestStampPattern-538910304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c7ad28c-3d00-42dc-aa65-87d27ff2d13c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:23:38 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-3b1df747-5a85-4f63-aeb5-8ffefc9ba7e1 tempest-TestStampPattern-538910304 None] Volume 2f8608b3-7b48-4cd7-b080-07172ef4409b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f8608b3-7b48-4cd7-b080-07172ef4409b', 'volume_size': 1} Apr 29 15:23:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-3b1df747-5a85-4f63-aeb5-8ffefc9ba7e1 tempest-TestStampPattern-538910304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:23:38 devstack sudo[103045]: pam_unix(sudo:session): session closed for user root Apr 29 15:23:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1247d15f-7d30-476c-934a-e29ea758d0f9 tempest-VolumesCloneTest-887289948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f8896024-5ced-4165-8f10-4355a31fc3d0" returned: 0 in 0.751s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:23:38 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-1247d15f-7d30-476c-934a-e29ea758d0f9 tempest-VolumesCloneTest-887289948 None] Lock "cinder-quobyte-f8896024-5ced-4165-8f10-4355a31fc3d0" released by "_copy_volume_from_snapshot" :: held 9.064s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:23:38 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-1247d15f-7d30-476c-934a-e29ea758d0f9 tempest-VolumesCloneTest-887289948 None] Acquiring lock "cinder-quobyte-11bd0955-1f86-40f9-a2e4-4b7616a09a22" by "_delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:23:38 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-1247d15f-7d30-476c-934a-e29ea758d0f9 tempest-VolumesCloneTest-887289948 None] Lock "cinder-quobyte-11bd0955-1f86-40f9-a2e4-4b7616a09a22" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:23:38 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-1247d15f-7d30-476c-934a-e29ea758d0f9 tempest-VolumesCloneTest-887289948 None] Deleting offline snapshot 11bd0955-1f86-40f9-a2e4-4b7616a09a22 of volume 4b98636e-f0d6-4149-8cde-45362569b0a9 {{(pid=84448) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 15:23:38 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-1247d15f-7d30-476c-934a-e29ea758d0f9 tempest-VolumesCloneTest-887289948 None] snapshot_file for this snap is: volume-4b98636e-f0d6-4149-8cde-45362569b0a9.11bd0955-1f86-40f9-a2e4-4b7616a09a22 {{(pid=84448) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 15:23:38 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[a615f729-956d-404e-a7b9-8d18ad187dc7]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:23:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1247d15f-7d30-476c-934a-e29ea758d0f9 tempest-VolumesCloneTest-887289948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4b98636e-f0d6-4149-8cde-45362569b0a9.11bd0955-1f86-40f9-a2e4-4b7616a09a22 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:23:38 devstack sudo[103067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4b98636e-f0d6-4149-8cde-45362569b0a9.11bd0955-1f86-40f9-a2e4-4b7616a09a22 Apr 29 15:23:38 devstack sudo[103067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:23:39 devstack sudo[103067]: pam_unix(sudo:session): session closed for user root Apr 29 15:23:39 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1247d15f-7d30-476c-934a-e29ea758d0f9 tempest-VolumesCloneTest-887289948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4b98636e-f0d6-4149-8cde-45362569b0a9.11bd0955-1f86-40f9-a2e4-4b7616a09a22" returned: 0 in 0.834s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:23:39 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-1247d15f-7d30-476c-934a-e29ea758d0f9 tempest-VolumesCloneTest-887289948 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b98636e-f0d6-4149-8cde-45362569b0a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84448) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 15:23:39 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[850643fe-4b1d-471a-aba8-407cdb823e17]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:23:39 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1247d15f-7d30-476c-934a-e29ea758d0f9 tempest-VolumesCloneTest-887289948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4b98636e-f0d6-4149-8cde-45362569b0a9 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:23:39 devstack sudo[103078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4b98636e-f0d6-4149-8cde-45362569b0a9 Apr 29 15:23:39 devstack sudo[103078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:23:40 devstack sudo[103078]: pam_unix(sudo:session): session closed for user root Apr 29 15:23:40 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1247d15f-7d30-476c-934a-e29ea758d0f9 tempest-VolumesCloneTest-887289948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4b98636e-f0d6-4149-8cde-45362569b0a9" returned: 0 in 0.772s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:23:40 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1247d15f-7d30-476c-934a-e29ea758d0f9 tempest-VolumesCloneTest-887289948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4b98636e-f0d6-4149-8cde-45362569b0a9.11bd0955-1f86-40f9-a2e4-4b7616a09a22 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:23:40 devstack sudo[103085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4b98636e-f0d6-4149-8cde-45362569b0a9.11bd0955-1f86-40f9-a2e4-4b7616a09a22 Apr 29 15:23:40 devstack sudo[103085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:23:40 devstack sudo[103085]: pam_unix(sudo:session): session closed for user root Apr 29 15:23:40 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1247d15f-7d30-476c-934a-e29ea758d0f9 tempest-VolumesCloneTest-887289948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4b98636e-f0d6-4149-8cde-45362569b0a9.11bd0955-1f86-40f9-a2e4-4b7616a09a22" returned: 0 in 0.739s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:23:40 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1247d15f-7d30-476c-934a-e29ea758d0f9 tempest-VolumesCloneTest-887289948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4b98636e-f0d6-4149-8cde-45362569b0a9.11bd0955-1f86-40f9-a2e4-4b7616a09a22 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:23:40 devstack sudo[103090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4b98636e-f0d6-4149-8cde-45362569b0a9.11bd0955-1f86-40f9-a2e4-4b7616a09a22 Apr 29 15:23:40 devstack sudo[103090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:23:41 devstack sudo[103090]: pam_unix(sudo:session): session closed for user root Apr 29 15:23:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1247d15f-7d30-476c-934a-e29ea758d0f9 tempest-VolumesCloneTest-887289948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4b98636e-f0d6-4149-8cde-45362569b0a9.11bd0955-1f86-40f9-a2e4-4b7616a09a22" returned: 0 in 0.619s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:23:41 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-1247d15f-7d30-476c-934a-e29ea758d0f9 tempest-VolumesCloneTest-887289948 None] Lock "cinder-quobyte-11bd0955-1f86-40f9-a2e4-4b7616a09a22" released by "_delete_snapshot" :: held 3.062s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:23:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-1247d15f-7d30-476c-934a-e29ea758d0f9 tempest-VolumesCloneTest-887289948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.764s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:23:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-721fa9b0-9181-44f9-a19f-d59338081be3 tempest-VolumesDeleteCascade-398376463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 16.345s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:23:41 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-1247d15f-7d30-476c-934a-e29ea758d0f9 tempest-VolumesCloneTest-887289948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87151866-c50b-4ff0-be5c-55dcd806ede3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8896024-5ced-4165-8f10-4355a31fc3d0', 'volume_size': 2, 'source_volid': '4b98636e-f0d6-4149-8cde-45362569b0a9', 'source_volstatus': 'available'}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:23:41 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-1247d15f-7d30-476c-934a-e29ea758d0f9 tempest-VolumesCloneTest-887289948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ab974f1-4929-414a-bbc1-5098535b0c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:23:41 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-721fa9b0-9181-44f9-a19f-d59338081be3 tempest-VolumesDeleteCascade-398376463 None] Creating offline snapshot bd15f2a7-348b-4df3-a13e-035925788068 of volume 623e3c53-e277-457b-89e1-21eafcaeb74d {{(pid=84448) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 15:23:41 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-1247d15f-7d30-476c-934a-e29ea758d0f9 tempest-VolumesCloneTest-887289948 None] Volume volume-f8896024-5ced-4165-8f10-4355a31fc3d0 (f8896024-5ced-4165-8f10-4355a31fc3d0): created successfully Apr 29 15:23:41 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-1247d15f-7d30-476c-934a-e29ea758d0f9 tempest-VolumesCloneTest-887289948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ab974f1-4929-414a-bbc1-5098535b0c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:23:41 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-1247d15f-7d30-476c-934a-e29ea758d0f9 tempest-VolumesCloneTest-887289948 None] Flow 'volume_create_manager' (7c7ac715-13ae-4d89-b747-8f2a49200b4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:23:41 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2347c0e-0263-4486-bdb9-54489e8e9cfe]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:23:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-721fa9b0-9181-44f9-a19f-d59338081be3 tempest-VolumesDeleteCascade-398376463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-623e3c53-e277-457b-89e1-21eafcaeb74d.9ddb7a29-b53b-4417-b4c9-133e4f1501c4 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:23:41 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-1247d15f-7d30-476c-934a-e29ea758d0f9 tempest-VolumesCloneTest-887289948 None] Created volume successfully. Apr 29 15:23:41 devstack sudo[103093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-623e3c53-e277-457b-89e1-21eafcaeb74d.9ddb7a29-b53b-4417-b4c9-133e4f1501c4 Apr 29 15:23:41 devstack sudo[103093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:23:42 devstack sudo[103093]: pam_unix(sudo:session): session closed for user root Apr 29 15:23:42 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-721fa9b0-9181-44f9-a19f-d59338081be3 tempest-VolumesDeleteCascade-398376463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-623e3c53-e277-457b-89e1-21eafcaeb74d.9ddb7a29-b53b-4417-b4c9-133e4f1501c4" returned: 0 in 0.738s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:23:42 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-721fa9b0-9181-44f9-a19f-d59338081be3 tempest-VolumesDeleteCascade-398376463 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-623e3c53-e277-457b-89e1-21eafcaeb74d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84448) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 15:23:42 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-721fa9b0-9181-44f9-a19f-d59338081be3 tempest-VolumesDeleteCascade-398376463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-623e3c53-e277-457b-89e1-21eafcaeb74d.9ddb7a29-b53b-4417-b4c9-133e4f1501c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-623e3c53-e277-457b-89e1-21eafcaeb74d.bd15f2a7-348b-4df3-a13e-035925788068 1G {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:23:42 devstack sudo[103100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-623e3c53-e277-457b-89e1-21eafcaeb74d.9ddb7a29-b53b-4417-b4c9-133e4f1501c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-623e3c53-e277-457b-89e1-21eafcaeb74d.bd15f2a7-348b-4df3-a13e-035925788068 1G Apr 29 15:23:42 devstack sudo[103100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:23:42 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-e44c2643-d9e0-4a2b-b516-ad0bcd642077 tempest-VolumesCloneTest-887289948 None] Acquiring lock "cinder-f8896024-5ced-4165-8f10-4355a31fc3d0-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:23:42 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-e44c2643-d9e0-4a2b-b516-ad0bcd642077 tempest-VolumesCloneTest-887289948 None] Lock "cinder-f8896024-5ced-4165-8f10-4355a31fc3d0-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:23:42 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-e44c2643-d9e0-4a2b-b516-ad0bcd642077 tempest-VolumesCloneTest-887289948 None] Acquiring lock "cinder-quobyte-f8896024-5ced-4165-8f10-4355a31fc3d0" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:23:42 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-e44c2643-d9e0-4a2b-b516-ad0bcd642077 tempest-VolumesCloneTest-887289948 None] Lock "cinder-quobyte-f8896024-5ced-4165-8f10-4355a31fc3d0" acquired by "delete_volume" :: waited 0.016s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:23:42 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba64a80-cbaa-422e-8609-e04182825a03]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:23:42 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-e44c2643-d9e0-4a2b-b516-ad0bcd642077 tempest-VolumesCloneTest-887289948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f8896024-5ced-4165-8f10-4355a31fc3d0 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:23:43 devstack sudo[103106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f8896024-5ced-4165-8f10-4355a31fc3d0 Apr 29 15:23:43 devstack sudo[103106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:23:43 devstack sudo[103100]: pam_unix(sudo:session): session closed for user root Apr 29 15:23:43 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-721fa9b0-9181-44f9-a19f-d59338081be3 tempest-VolumesDeleteCascade-398376463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-623e3c53-e277-457b-89e1-21eafcaeb74d.9ddb7a29-b53b-4417-b4c9-133e4f1501c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-623e3c53-e277-457b-89e1-21eafcaeb74d.bd15f2a7-348b-4df3-a13e-035925788068 1G" returned: 0 in 0.863s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:23:43 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-721fa9b0-9181-44f9-a19f-d59338081be3 tempest-VolumesDeleteCascade-398376463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-623e3c53-e277-457b-89e1-21eafcaeb74d.9ddb7a29-b53b-4417-b4c9-133e4f1501c4 -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-623e3c53-e277-457b-89e1-21eafcaeb74d.bd15f2a7-348b-4df3-a13e-035925788068 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:23:43 devstack sudo[103108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-623e3c53-e277-457b-89e1-21eafcaeb74d.9ddb7a29-b53b-4417-b4c9-133e4f1501c4 -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-623e3c53-e277-457b-89e1-21eafcaeb74d.bd15f2a7-348b-4df3-a13e-035925788068 Apr 29 15:23:43 devstack sudo[103108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:23:43 devstack sudo[103106]: pam_unix(sudo:session): session closed for user root Apr 29 15:23:43 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-e44c2643-d9e0-4a2b-b516-ad0bcd642077 tempest-VolumesCloneTest-887289948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f8896024-5ced-4165-8f10-4355a31fc3d0" returned: 0 in 0.749s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:23:43 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-e44c2643-d9e0-4a2b-b516-ad0bcd642077 tempest-VolumesCloneTest-887289948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f8896024-5ced-4165-8f10-4355a31fc3d0 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:23:43 devstack sudo[103113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f8896024-5ced-4165-8f10-4355a31fc3d0 Apr 29 15:23:43 devstack sudo[103113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:23:43 devstack sudo[103108]: pam_unix(sudo:session): session closed for user root Apr 29 15:23:43 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-721fa9b0-9181-44f9-a19f-d59338081be3 tempest-VolumesDeleteCascade-398376463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-623e3c53-e277-457b-89e1-21eafcaeb74d.9ddb7a29-b53b-4417-b4c9-133e4f1501c4 -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-623e3c53-e277-457b-89e1-21eafcaeb74d.bd15f2a7-348b-4df3-a13e-035925788068" returned: 0 in 0.679s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:23:43 devstack cinder-volume[84448]: WARNING cinder.volume.drivers.remotefs [None req-721fa9b0-9181-44f9-a19f-d59338081be3 tempest-VolumesDeleteCascade-398376463 None] /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-623e3c53-e277-457b-89e1-21eafcaeb74d.bd15f2a7-348b-4df3-a13e-035925788068 is being set with open permissions: ugo+rw Apr 29 15:23:43 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-721fa9b0-9181-44f9-a19f-d59338081be3 tempest-VolumesDeleteCascade-398376463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-623e3c53-e277-457b-89e1-21eafcaeb74d.bd15f2a7-348b-4df3-a13e-035925788068 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:23:43 devstack sudo[103118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-623e3c53-e277-457b-89e1-21eafcaeb74d.bd15f2a7-348b-4df3-a13e-035925788068 Apr 29 15:23:43 devstack sudo[103118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:23:44 devstack sudo[103113]: pam_unix(sudo:session): session closed for user root Apr 29 15:23:44 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-e44c2643-d9e0-4a2b-b516-ad0bcd642077 tempest-VolumesCloneTest-887289948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f8896024-5ced-4165-8f10-4355a31fc3d0" returned: 0 in 0.611s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:23:44 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-e44c2643-d9e0-4a2b-b516-ad0bcd642077 tempest-VolumesCloneTest-887289948 None] Lock "cinder-quobyte-f8896024-5ced-4165-8f10-4355a31fc3d0" released by "delete_volume" :: held 1.406s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:23:44 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-e44c2643-d9e0-4a2b-b516-ad0bcd642077 tempest-VolumesCloneTest-887289948 None] Created reservations ['3c12ab38-f39a-4e61-a696-afc2427d2bc0', 'b3bb9fa7-c474-4c41-8320-8a8a1eaf96eb', '0351eba8-ef68-414c-8521-762f69898329', '8d1a58df-2f84-4837-b569-48af3cf68fdb'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:23:44 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-e44c2643-d9e0-4a2b-b516-ad0bcd642077 tempest-VolumesCloneTest-887289948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:23:44 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-e44c2643-d9e0-4a2b-b516-ad0bcd642077 tempest-VolumesCloneTest-887289948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:23:44 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-e44c2643-d9e0-4a2b-b516-ad0bcd642077 tempest-VolumesCloneTest-887289948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:23:44 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-e44c2643-d9e0-4a2b-b516-ad0bcd642077 tempest-VolumesCloneTest-887289948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:23:44 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-e44c2643-d9e0-4a2b-b516-ad0bcd642077 tempest-VolumesCloneTest-887289948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:23:44 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-e44c2643-d9e0-4a2b-b516-ad0bcd642077 tempest-VolumesCloneTest-887289948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:23:44 devstack sudo[103122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:23:44 devstack sudo[103122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:23:44 devstack sudo[103118]: pam_unix(sudo:session): session closed for user root Apr 29 15:23:44 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-721fa9b0-9181-44f9-a19f-d59338081be3 tempest-VolumesDeleteCascade-398376463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-623e3c53-e277-457b-89e1-21eafcaeb74d.bd15f2a7-348b-4df3-a13e-035925788068" returned: 0 in 0.628s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:23:44 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-721fa9b0-9181-44f9-a19f-d59338081be3 tempest-VolumesDeleteCascade-398376463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.044s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:23:44 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-3b1df747-5a85-4f63-aeb5-8ffefc9ba7e1 tempest-TestStampPattern-538910304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.477s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:23:44 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-3b1df747-5a85-4f63-aeb5-8ffefc9ba7e1 tempest-TestStampPattern-538910304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1482758823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f8608b3-7b48-4cd7-b080-07172ef4409b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb6410b29eb94132976abf0c5cd51b54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:23:38Z,use_quota=True,user_id='ba2ca1ba522d4106a3f6dbff043f36d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:23:44 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-3b1df747-5a85-4f63-aeb5-8ffefc9ba7e1 tempest-TestStampPattern-538910304 None] Creating volume 2f8608b3-7b48-4cd7-b080-07172ef4409b {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:23:44 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-3b1df747-5a85-4f63-aeb5-8ffefc9ba7e1 tempest-TestStampPattern-538910304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:23:44 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-3b1df747-5a85-4f63-aeb5-8ffefc9ba7e1 tempest-TestStampPattern-538910304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:23:44 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-3b1df747-5a85-4f63-aeb5-8ffefc9ba7e1 tempest-TestStampPattern-538910304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:23:44 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-3b1df747-5a85-4f63-aeb5-8ffefc9ba7e1 tempest-TestStampPattern-538910304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:23:44 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-3b1df747-5a85-4f63-aeb5-8ffefc9ba7e1 tempest-TestStampPattern-538910304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:23:44 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-3b1df747-5a85-4f63-aeb5-8ffefc9ba7e1 tempest-TestStampPattern-538910304 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:23:44 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-3b1df747-5a85-4f63-aeb5-8ffefc9ba7e1 tempest-TestStampPattern-538910304 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:23:44 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-3b1df747-5a85-4f63-aeb5-8ffefc9ba7e1 tempest-TestStampPattern-538910304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2f8608b3-7b48-4cd7-b080-07172ef4409b 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:23:44 devstack sudo[103124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2f8608b3-7b48-4cd7-b080-07172ef4409b 1073741824 Apr 29 15:23:44 devstack sudo[103124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:23:44 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-721fa9b0-9181-44f9-a19f-d59338081be3 tempest-VolumesDeleteCascade-398376463 None] Create snapshot completed successfully Apr 29 15:23:45 devstack sudo[103122]: pam_unix(sudo:session): session closed for user root Apr 29 15:23:45 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-e44c2643-d9e0-4a2b-b516-ad0bcd642077 tempest-VolumesCloneTest-887289948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.686s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:23:45 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-e44c2643-d9e0-4a2b-b516-ad0bcd642077 tempest-VolumesCloneTest-887289948 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:23:45 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-e44c2643-d9e0-4a2b-b516-ad0bcd642077 tempest-VolumesCloneTest-887289948 None] Deleted volume successfully. Apr 29 15:23:45 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-462f645f-073d-4ec7-80b4-02ce7f36aea4 tempest-VolumesCloneTest-887289948 None] Acquiring lock "cinder-4b98636e-f0d6-4149-8cde-45362569b0a9-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:23:45 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-462f645f-073d-4ec7-80b4-02ce7f36aea4 tempest-VolumesCloneTest-887289948 None] Lock "cinder-4b98636e-f0d6-4149-8cde-45362569b0a9-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:23:45 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-e44c2643-d9e0-4a2b-b516-ad0bcd642077 tempest-VolumesCloneTest-887289948 None] Lock "cinder-f8896024-5ced-4165-8f10-4355a31fc3d0-delete_volume" released by "delete_volume" :: held 2.329s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:23:45 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a72a28f5-5a42-4478-872c-295d1574522c tempest-VolumesDeleteCascade-398376463 None] Acquiring lock "cinder-623e3c53-e277-457b-89e1-21eafcaeb74d-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:23:45 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-462f645f-073d-4ec7-80b4-02ce7f36aea4 tempest-VolumesCloneTest-887289948 None] Acquiring lock "cinder-quobyte-4b98636e-f0d6-4149-8cde-45362569b0a9" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:23:45 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a72a28f5-5a42-4478-872c-295d1574522c tempest-VolumesDeleteCascade-398376463 None] Lock "cinder-623e3c53-e277-457b-89e1-21eafcaeb74d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:23:45 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-462f645f-073d-4ec7-80b4-02ce7f36aea4 tempest-VolumesCloneTest-887289948 None] Lock "cinder-quobyte-4b98636e-f0d6-4149-8cde-45362569b0a9" acquired by "delete_volume" :: waited 0.028s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:23:45 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b87c391-d669-43d6-98eb-fbffeb50e0fd]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:23:45 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-462f645f-073d-4ec7-80b4-02ce7f36aea4 tempest-VolumesCloneTest-887289948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4b98636e-f0d6-4149-8cde-45362569b0a9 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:23:45 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-a72a28f5-5a42-4478-872c-295d1574522c tempest-VolumesDeleteCascade-398376463 None] Performing cascade delete. {{(pid=84448) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 29 15:23:45 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a72a28f5-5a42-4478-872c-295d1574522c tempest-VolumesDeleteCascade-398376463 None] Acquiring lock "cinder-9ddb7a29-b53b-4417-b4c9-133e4f1501c4-delete_snapshot" by "delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:23:45 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a72a28f5-5a42-4478-872c-295d1574522c tempest-VolumesDeleteCascade-398376463 None] Lock "cinder-9ddb7a29-b53b-4417-b4c9-133e4f1501c4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:23:45 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a72a28f5-5a42-4478-872c-295d1574522c tempest-VolumesDeleteCascade-398376463 None] Acquiring lock "cinder-quobyte-623e3c53-e277-457b-89e1-21eafcaeb74d" by "delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:23:45 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a72a28f5-5a42-4478-872c-295d1574522c tempest-VolumesDeleteCascade-398376463 None] Lock "cinder-quobyte-623e3c53-e277-457b-89e1-21eafcaeb74d" acquired by "delete_snapshot" :: waited 0.024s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:23:45 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a72a28f5-5a42-4478-872c-295d1574522c tempest-VolumesDeleteCascade-398376463 None] Acquiring lock "cinder-quobyte-9ddb7a29-b53b-4417-b4c9-133e4f1501c4" by "_delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:23:45 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a72a28f5-5a42-4478-872c-295d1574522c tempest-VolumesDeleteCascade-398376463 None] Lock "cinder-quobyte-9ddb7a29-b53b-4417-b4c9-133e4f1501c4" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:23:45 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-a72a28f5-5a42-4478-872c-295d1574522c tempest-VolumesDeleteCascade-398376463 None] Deleting offline snapshot 9ddb7a29-b53b-4417-b4c9-133e4f1501c4 of volume 623e3c53-e277-457b-89e1-21eafcaeb74d {{(pid=84448) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 15:23:45 devstack sudo[103131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4b98636e-f0d6-4149-8cde-45362569b0a9 Apr 29 15:23:45 devstack sudo[103131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:23:45 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-a72a28f5-5a42-4478-872c-295d1574522c tempest-VolumesDeleteCascade-398376463 None] snapshot_file for this snap is: volume-623e3c53-e277-457b-89e1-21eafcaeb74d.9ddb7a29-b53b-4417-b4c9-133e4f1501c4 {{(pid=84448) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 15:23:45 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[c74b590d-2f09-4b77-a006-f14b2b150dfa]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:23:45 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a72a28f5-5a42-4478-872c-295d1574522c tempest-VolumesDeleteCascade-398376463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-623e3c53-e277-457b-89e1-21eafcaeb74d.9ddb7a29-b53b-4417-b4c9-133e4f1501c4 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:23:45 devstack sudo[103124]: pam_unix(sudo:session): session closed for user root Apr 29 15:23:45 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-3b1df747-5a85-4f63-aeb5-8ffefc9ba7e1 tempest-TestStampPattern-538910304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2f8608b3-7b48-4cd7-b080-07172ef4409b 1073741824" returned: 0 in 0.980s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:23:45 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-3b1df747-5a85-4f63-aeb5-8ffefc9ba7e1 tempest-TestStampPattern-538910304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2f8608b3-7b48-4cd7-b080-07172ef4409b {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:23:45 devstack sudo[103135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2f8608b3-7b48-4cd7-b080-07172ef4409b Apr 29 15:23:45 devstack sudo[103135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:23:45 devstack sudo[103134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-623e3c53-e277-457b-89e1-21eafcaeb74d.9ddb7a29-b53b-4417-b4c9-133e4f1501c4 Apr 29 15:23:45 devstack sudo[103134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:23:46 devstack sudo[103135]: pam_unix(sudo:session): session closed for user root Apr 29 15:23:46 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-3b1df747-5a85-4f63-aeb5-8ffefc9ba7e1 tempest-TestStampPattern-538910304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2f8608b3-7b48-4cd7-b080-07172ef4409b" returned: 0 in 0.703s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:23:46 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-3b1df747-5a85-4f63-aeb5-8ffefc9ba7e1 tempest-TestStampPattern-538910304 None] <== create_volume: return (1732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:23:46 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-3b1df747-5a85-4f63-aeb5-8ffefc9ba7e1 tempest-TestStampPattern-538910304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.736s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:23:46 devstack sudo[103131]: pam_unix(sudo:session): session closed for user root Apr 29 15:23:46 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-462f645f-073d-4ec7-80b4-02ce7f36aea4 tempest-VolumesCloneTest-887289948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4b98636e-f0d6-4149-8cde-45362569b0a9" returned: 0 in 0.998s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:23:46 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-462f645f-073d-4ec7-80b4-02ce7f36aea4 tempest-VolumesCloneTest-887289948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4b98636e-f0d6-4149-8cde-45362569b0a9 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:23:46 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-3b1df747-5a85-4f63-aeb5-8ffefc9ba7e1 tempest-TestStampPattern-538910304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c7ad28c-3d00-42dc-aa65-87d27ff2d13c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f8608b3-7b48-4cd7-b080-07172ef4409b', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:23:46 devstack sudo[103147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4b98636e-f0d6-4149-8cde-45362569b0a9 Apr 29 15:23:46 devstack sudo[103147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:23:46 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-3b1df747-5a85-4f63-aeb5-8ffefc9ba7e1 tempest-TestStampPattern-538910304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9801dafb-145a-42ca-b4fb-686e040dfb20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:23:46 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-3b1df747-5a85-4f63-aeb5-8ffefc9ba7e1 tempest-TestStampPattern-538910304 None] Volume volume-2f8608b3-7b48-4cd7-b080-07172ef4409b (2f8608b3-7b48-4cd7-b080-07172ef4409b): created successfully Apr 29 15:23:46 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-3b1df747-5a85-4f63-aeb5-8ffefc9ba7e1 tempest-TestStampPattern-538910304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9801dafb-145a-42ca-b4fb-686e040dfb20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:23:46 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-3b1df747-5a85-4f63-aeb5-8ffefc9ba7e1 tempest-TestStampPattern-538910304 None] Flow 'volume_create_manager' (2ed988b1-18dc-4442-aebf-ae9f6396f5ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:23:46 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-3b1df747-5a85-4f63-aeb5-8ffefc9ba7e1 tempest-TestStampPattern-538910304 None] Created volume successfully. Apr 29 15:23:46 devstack sudo[103134]: pam_unix(sudo:session): session closed for user root Apr 29 15:23:46 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a72a28f5-5a42-4478-872c-295d1574522c tempest-VolumesDeleteCascade-398376463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-623e3c53-e277-457b-89e1-21eafcaeb74d.9ddb7a29-b53b-4417-b4c9-133e4f1501c4" returned: 0 in 1.069s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:23:46 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-a72a28f5-5a42-4478-872c-295d1574522c tempest-VolumesDeleteCascade-398376463 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-623e3c53-e277-457b-89e1-21eafcaeb74d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84448) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 15:23:46 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a1adc3-8f39-4b1b-a8d3-1f7387764a1e]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:23:46 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a72a28f5-5a42-4478-872c-295d1574522c tempest-VolumesDeleteCascade-398376463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-623e3c53-e277-457b-89e1-21eafcaeb74d {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:23:46 devstack sudo[103150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-623e3c53-e277-457b-89e1-21eafcaeb74d Apr 29 15:23:46 devstack sudo[103150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:23:46 devstack sudo[103147]: pam_unix(sudo:session): session closed for user root Apr 29 15:23:46 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-462f645f-073d-4ec7-80b4-02ce7f36aea4 tempest-VolumesCloneTest-887289948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4b98636e-f0d6-4149-8cde-45362569b0a9" returned: 0 in 0.714s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:23:46 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-462f645f-073d-4ec7-80b4-02ce7f36aea4 tempest-VolumesCloneTest-887289948 None] Lock "cinder-quobyte-4b98636e-f0d6-4149-8cde-45362569b0a9" released by "delete_volume" :: held 1.789s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:23:47 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-462f645f-073d-4ec7-80b4-02ce7f36aea4 tempest-VolumesCloneTest-887289948 None] Created reservations ['e5e5b3ed-fa24-4549-a68b-1372755e1180', '26936e78-a30d-41c7-a70a-284fdc8582f9', '11f02db1-5a1c-4390-a5e8-b240d5b0eb46', '7fbe5ab8-0047-484d-84b4-1ebe79b9b599'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:23:47 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-462f645f-073d-4ec7-80b4-02ce7f36aea4 tempest-VolumesCloneTest-887289948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:23:47 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-462f645f-073d-4ec7-80b4-02ce7f36aea4 tempest-VolumesCloneTest-887289948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:23:47 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-462f645f-073d-4ec7-80b4-02ce7f36aea4 tempest-VolumesCloneTest-887289948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:23:47 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-462f645f-073d-4ec7-80b4-02ce7f36aea4 tempest-VolumesCloneTest-887289948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:23:47 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-462f645f-073d-4ec7-80b4-02ce7f36aea4 tempest-VolumesCloneTest-887289948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:23:47 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-462f645f-073d-4ec7-80b4-02ce7f36aea4 tempest-VolumesCloneTest-887289948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:23:47 devstack sudo[103153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:23:47 devstack sudo[103153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:23:47 devstack sudo[103150]: pam_unix(sudo:session): session closed for user root Apr 29 15:23:47 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a72a28f5-5a42-4478-872c-295d1574522c tempest-VolumesDeleteCascade-398376463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-623e3c53-e277-457b-89e1-21eafcaeb74d" returned: 0 in 0.908s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:23:47 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea651ec-b389-4f88-8a84-3b6633d7f258]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:23:47 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a72a28f5-5a42-4478-872c-295d1574522c tempest-VolumesDeleteCascade-398376463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-623e3c53-e277-457b-89e1-21eafcaeb74d.bd15f2a7-348b-4df3-a13e-035925788068 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:23:47 devstack sudo[103161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-623e3c53-e277-457b-89e1-21eafcaeb74d.bd15f2a7-348b-4df3-a13e-035925788068 Apr 29 15:23:47 devstack sudo[103161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:23:47 devstack sudo[103153]: pam_unix(sudo:session): session closed for user root Apr 29 15:23:47 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-462f645f-073d-4ec7-80b4-02ce7f36aea4 tempest-VolumesCloneTest-887289948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.815s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:23:47 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-462f645f-073d-4ec7-80b4-02ce7f36aea4 tempest-VolumesCloneTest-887289948 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:23:47 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-462f645f-073d-4ec7-80b4-02ce7f36aea4 tempest-VolumesCloneTest-887289948 None] Deleted volume successfully. Apr 29 15:23:48 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-462f645f-073d-4ec7-80b4-02ce7f36aea4 tempest-VolumesCloneTest-887289948 None] Lock "cinder-4b98636e-f0d6-4149-8cde-45362569b0a9-delete_volume" released by "delete_volume" :: held 2.871s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:23:48 devstack sudo[103161]: pam_unix(sudo:session): session closed for user root Apr 29 15:23:48 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a72a28f5-5a42-4478-872c-295d1574522c tempest-VolumesDeleteCascade-398376463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-623e3c53-e277-457b-89e1-21eafcaeb74d.bd15f2a7-348b-4df3-a13e-035925788068" returned: 0 in 0.979s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:23:48 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-a72a28f5-5a42-4478-872c-295d1574522c tempest-VolumesDeleteCascade-398376463 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-623e3c53-e277-457b-89e1-21eafcaeb74d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84448) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 15:23:48 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[b22f5bf2-eb49-4cb4-aadd-61b4d6630128]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:23:48 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a72a28f5-5a42-4478-872c-295d1574522c tempest-VolumesDeleteCascade-398376463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-623e3c53-e277-457b-89e1-21eafcaeb74d.9ddb7a29-b53b-4417-b4c9-133e4f1501c4 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:23:48 devstack sudo[103180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-623e3c53-e277-457b-89e1-21eafcaeb74d.9ddb7a29-b53b-4417-b4c9-133e4f1501c4 Apr 29 15:23:48 devstack sudo[103180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:23:49 devstack sudo[103180]: pam_unix(sudo:session): session closed for user root Apr 29 15:23:49 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a72a28f5-5a42-4478-872c-295d1574522c tempest-VolumesDeleteCascade-398376463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-623e3c53-e277-457b-89e1-21eafcaeb74d.9ddb7a29-b53b-4417-b4c9-133e4f1501c4" returned: 0 in 0.777s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:23:49 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-a72a28f5-5a42-4478-872c-295d1574522c tempest-VolumesDeleteCascade-398376463 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-623e3c53-e277-457b-89e1-21eafcaeb74d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84448) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 15:23:49 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e3a7f98-4cf7-4c86-be21-83cd8825cd72]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:23:49 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a72a28f5-5a42-4478-872c-295d1574522c tempest-VolumesDeleteCascade-398376463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-623e3c53-e277-457b-89e1-21eafcaeb74d {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:23:49 devstack sudo[103185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-623e3c53-e277-457b-89e1-21eafcaeb74d Apr 29 15:23:49 devstack sudo[103185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:23:50 devstack sudo[103185]: pam_unix(sudo:session): session closed for user root Apr 29 15:23:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a72a28f5-5a42-4478-872c-295d1574522c tempest-VolumesDeleteCascade-398376463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-623e3c53-e277-457b-89e1-21eafcaeb74d" returned: 0 in 0.763s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:23:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a72a28f5-5a42-4478-872c-295d1574522c tempest-VolumesDeleteCascade-398376463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-623e3c53-e277-457b-89e1-21eafcaeb74d.9ddb7a29-b53b-4417-b4c9-133e4f1501c4 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:23:50 devstack sudo[103191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-623e3c53-e277-457b-89e1-21eafcaeb74d.9ddb7a29-b53b-4417-b4c9-133e4f1501c4 Apr 29 15:23:50 devstack sudo[103191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:23:50 devstack sudo[103191]: pam_unix(sudo:session): session closed for user root Apr 29 15:23:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a72a28f5-5a42-4478-872c-295d1574522c tempest-VolumesDeleteCascade-398376463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-623e3c53-e277-457b-89e1-21eafcaeb74d.9ddb7a29-b53b-4417-b4c9-133e4f1501c4" returned: 0 in 0.798s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:23:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a72a28f5-5a42-4478-872c-295d1574522c tempest-VolumesDeleteCascade-398376463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-623e3c53-e277-457b-89e1-21eafcaeb74d.9ddb7a29-b53b-4417-b4c9-133e4f1501c4 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:23:50 devstack sudo[103198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-623e3c53-e277-457b-89e1-21eafcaeb74d.9ddb7a29-b53b-4417-b4c9-133e4f1501c4 Apr 29 15:23:50 devstack sudo[103198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:23:51 devstack sudo[103198]: pam_unix(sudo:session): session closed for user root Apr 29 15:23:51 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a72a28f5-5a42-4478-872c-295d1574522c tempest-VolumesDeleteCascade-398376463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-623e3c53-e277-457b-89e1-21eafcaeb74d.9ddb7a29-b53b-4417-b4c9-133e4f1501c4" returned: 0 in 0.684s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:23:51 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a72a28f5-5a42-4478-872c-295d1574522c tempest-VolumesDeleteCascade-398376463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-623e3c53-e277-457b-89e1-21eafcaeb74d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-623e3c53-e277-457b-89e1-21eafcaeb74d.bd15f2a7-348b-4df3-a13e-035925788068 -F qcow2 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:23:51 devstack sudo[103208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-623e3c53-e277-457b-89e1-21eafcaeb74d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-623e3c53-e277-457b-89e1-21eafcaeb74d.bd15f2a7-348b-4df3-a13e-035925788068 -F qcow2 Apr 29 15:23:51 devstack sudo[103208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:23:52 devstack sudo[103208]: pam_unix(sudo:session): session closed for user root Apr 29 15:23:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a72a28f5-5a42-4478-872c-295d1574522c tempest-VolumesDeleteCascade-398376463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-623e3c53-e277-457b-89e1-21eafcaeb74d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-623e3c53-e277-457b-89e1-21eafcaeb74d.bd15f2a7-348b-4df3-a13e-035925788068 -F qcow2" returned: 0 in 0.691s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:23:52 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a72a28f5-5a42-4478-872c-295d1574522c tempest-VolumesDeleteCascade-398376463 None] Lock "cinder-quobyte-9ddb7a29-b53b-4417-b4c9-133e4f1501c4" released by "_delete_snapshot" :: held 6.878s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:23:52 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a72a28f5-5a42-4478-872c-295d1574522c tempest-VolumesDeleteCascade-398376463 None] Lock "cinder-quobyte-623e3c53-e277-457b-89e1-21eafcaeb74d" released by "delete_snapshot" :: held 6.913s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:23:52 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-a72a28f5-5a42-4478-872c-295d1574522c tempest-VolumesDeleteCascade-398376463 None] Created reservations ['9931af98-adf5-4fd3-939b-6bc3ab31aacb', 'c639acad-5613-4568-b467-5eac648b583f', '62738453-d239-45d6-ba5c-822d009c17a8', '2e2aad52-fb12-48e4-955b-9c9d9d110fad'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:23:52 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-a72a28f5-5a42-4478-872c-295d1574522c tempest-VolumesDeleteCascade-398376463 None] Delete snapshot completed successfully. Apr 29 15:23:52 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a72a28f5-5a42-4478-872c-295d1574522c tempest-VolumesDeleteCascade-398376463 None] Lock "cinder-9ddb7a29-b53b-4417-b4c9-133e4f1501c4-delete_snapshot" released by "delete_snapshot" :: held 7.080s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:23:52 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a72a28f5-5a42-4478-872c-295d1574522c tempest-VolumesDeleteCascade-398376463 None] Acquiring lock "cinder-bd15f2a7-348b-4df3-a13e-035925788068-delete_snapshot" by "delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:23:52 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a72a28f5-5a42-4478-872c-295d1574522c tempest-VolumesDeleteCascade-398376463 None] Lock "cinder-bd15f2a7-348b-4df3-a13e-035925788068-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:23:52 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a72a28f5-5a42-4478-872c-295d1574522c tempest-VolumesDeleteCascade-398376463 None] Acquiring lock "cinder-quobyte-623e3c53-e277-457b-89e1-21eafcaeb74d" by "delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:23:52 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a72a28f5-5a42-4478-872c-295d1574522c tempest-VolumesDeleteCascade-398376463 None] Lock "cinder-quobyte-623e3c53-e277-457b-89e1-21eafcaeb74d" acquired by "delete_snapshot" :: waited 0.015s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:23:52 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a72a28f5-5a42-4478-872c-295d1574522c tempest-VolumesDeleteCascade-398376463 None] Acquiring lock "cinder-quobyte-bd15f2a7-348b-4df3-a13e-035925788068" by "_delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:23:52 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a72a28f5-5a42-4478-872c-295d1574522c tempest-VolumesDeleteCascade-398376463 None] Lock "cinder-quobyte-bd15f2a7-348b-4df3-a13e-035925788068" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:23:52 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-a72a28f5-5a42-4478-872c-295d1574522c tempest-VolumesDeleteCascade-398376463 None] Deleting offline snapshot bd15f2a7-348b-4df3-a13e-035925788068 of volume 623e3c53-e277-457b-89e1-21eafcaeb74d {{(pid=84448) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 15:23:52 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-a72a28f5-5a42-4478-872c-295d1574522c tempest-VolumesDeleteCascade-398376463 None] snapshot_file for this snap is: volume-623e3c53-e277-457b-89e1-21eafcaeb74d.bd15f2a7-348b-4df3-a13e-035925788068 {{(pid=84448) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 15:23:52 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa1e8a8-af50-4d67-8b2e-ba297dceef0c]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:23:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a72a28f5-5a42-4478-872c-295d1574522c tempest-VolumesDeleteCascade-398376463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-623e3c53-e277-457b-89e1-21eafcaeb74d.bd15f2a7-348b-4df3-a13e-035925788068 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:23:52 devstack sudo[103214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-623e3c53-e277-457b-89e1-21eafcaeb74d.bd15f2a7-348b-4df3-a13e-035925788068 Apr 29 15:23:52 devstack sudo[103214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:23:53 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-7da4f5f7-19f1-4863-8537-2ca681825f06 tempest-VolumesSnapshotListTestJSON-511230180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:23:53 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-7da4f5f7-19f1-4863-8537-2ca681825f06 tempest-VolumesSnapshotListTestJSON-511230180 None] Flow 'volume_create_manager' (5cedec88-dbd3-40d2-a540-df88a8a2e7a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:23:53 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-7da4f5f7-19f1-4863-8537-2ca681825f06 tempest-VolumesSnapshotListTestJSON-511230180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dea83c5-70c4-48a0-8762-8142461515a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:23:53 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-7da4f5f7-19f1-4863-8537-2ca681825f06 tempest-VolumesSnapshotListTestJSON-511230180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dea83c5-70c4-48a0-8762-8142461515a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:23:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1641175735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13098a57-c4c1-4e2e-bcce-6ac665f383c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9e0262ec98a43be88d176a43643be0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:23:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:23:53Z,use_quota=True,user_id='9adb29ee021d4af3bfa49c5ef616e750',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:23:53 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-7da4f5f7-19f1-4863-8537-2ca681825f06 tempest-VolumesSnapshotListTestJSON-511230180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3706dcac-3030-4f69-9d93-6d3b45e318d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:23:53 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-7da4f5f7-19f1-4863-8537-2ca681825f06 tempest-VolumesSnapshotListTestJSON-511230180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3706dcac-3030-4f69-9d93-6d3b45e318d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:23:53 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-7da4f5f7-19f1-4863-8537-2ca681825f06 tempest-VolumesSnapshotListTestJSON-511230180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (947e61f9-75a4-4718-9563-822197853d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:23:53 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-7da4f5f7-19f1-4863-8537-2ca681825f06 tempest-VolumesSnapshotListTestJSON-511230180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (947e61f9-75a4-4718-9563-822197853d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13098a57-c4c1-4e2e-bcce-6ac665f383c1', 'volume_name': 'volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:23:53 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-7da4f5f7-19f1-4863-8537-2ca681825f06 tempest-VolumesSnapshotListTestJSON-511230180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bb69efd-87c5-46c5-9ce8-c95506d58f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:23:53 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-7da4f5f7-19f1-4863-8537-2ca681825f06 tempest-VolumesSnapshotListTestJSON-511230180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bb69efd-87c5-46c5-9ce8-c95506d58f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:23:53 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-7da4f5f7-19f1-4863-8537-2ca681825f06 tempest-VolumesSnapshotListTestJSON-511230180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d758e02f-7d87-4750-83bc-e4ca0cd4b267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:23:53 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-7da4f5f7-19f1-4863-8537-2ca681825f06 tempest-VolumesSnapshotListTestJSON-511230180 None] Volume 13098a57-c4c1-4e2e-bcce-6ac665f383c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1', 'volume_size': 1} Apr 29 15:23:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-7da4f5f7-19f1-4863-8537-2ca681825f06 tempest-VolumesSnapshotListTestJSON-511230180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:23:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-7da4f5f7-19f1-4863-8537-2ca681825f06 tempest-VolumesSnapshotListTestJSON-511230180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:23:53 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-7da4f5f7-19f1-4863-8537-2ca681825f06 tempest-VolumesSnapshotListTestJSON-511230180 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:23:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1641175735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13098a57-c4c1-4e2e-bcce-6ac665f383c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9e0262ec98a43be88d176a43643be0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:23:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:23:53Z,use_quota=True,user_id='9adb29ee021d4af3bfa49c5ef616e750',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:23:53 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-7da4f5f7-19f1-4863-8537-2ca681825f06 tempest-VolumesSnapshotListTestJSON-511230180 None] Creating volume 13098a57-c4c1-4e2e-bcce-6ac665f383c1 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:23:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-7da4f5f7-19f1-4863-8537-2ca681825f06 tempest-VolumesSnapshotListTestJSON-511230180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:23:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-7da4f5f7-19f1-4863-8537-2ca681825f06 tempest-VolumesSnapshotListTestJSON-511230180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:23:53 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-7da4f5f7-19f1-4863-8537-2ca681825f06 tempest-VolumesSnapshotListTestJSON-511230180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:23:53 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-7da4f5f7-19f1-4863-8537-2ca681825f06 tempest-VolumesSnapshotListTestJSON-511230180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:23:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-7da4f5f7-19f1-4863-8537-2ca681825f06 tempest-VolumesSnapshotListTestJSON-511230180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:23:53 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-7da4f5f7-19f1-4863-8537-2ca681825f06 tempest-VolumesSnapshotListTestJSON-511230180 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:23:53 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-7da4f5f7-19f1-4863-8537-2ca681825f06 tempest-VolumesSnapshotListTestJSON-511230180 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:23:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7da4f5f7-19f1-4863-8537-2ca681825f06 tempest-VolumesSnapshotListTestJSON-511230180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:23:53 devstack sudo[103287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1 1073741824 Apr 29 15:23:53 devstack sudo[103287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:23:53 devstack sudo[103214]: pam_unix(sudo:session): session closed for user root Apr 29 15:23:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a72a28f5-5a42-4478-872c-295d1574522c tempest-VolumesDeleteCascade-398376463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-623e3c53-e277-457b-89e1-21eafcaeb74d.bd15f2a7-348b-4df3-a13e-035925788068" returned: 0 in 1.175s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:23:53 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-a72a28f5-5a42-4478-872c-295d1574522c tempest-VolumesDeleteCascade-398376463 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-623e3c53-e277-457b-89e1-21eafcaeb74d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84448) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 15:23:53 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec3e880b-0265-4a99-8613-dfd500188f12]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:23:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a72a28f5-5a42-4478-872c-295d1574522c tempest-VolumesDeleteCascade-398376463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-623e3c53-e277-457b-89e1-21eafcaeb74d {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:23:53 devstack sudo[103295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-623e3c53-e277-457b-89e1-21eafcaeb74d Apr 29 15:23:53 devstack sudo[103295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:23:54 devstack sudo[103287]: pam_unix(sudo:session): session closed for user root Apr 29 15:23:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7da4f5f7-19f1-4863-8537-2ca681825f06 tempest-VolumesSnapshotListTestJSON-511230180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1 1073741824" returned: 0 in 1.219s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:23:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7da4f5f7-19f1-4863-8537-2ca681825f06 tempest-VolumesSnapshotListTestJSON-511230180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:23:54 devstack sudo[103319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1 Apr 29 15:23:54 devstack sudo[103319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:23:54 devstack sudo[103295]: pam_unix(sudo:session): session closed for user root Apr 29 15:23:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a72a28f5-5a42-4478-872c-295d1574522c tempest-VolumesDeleteCascade-398376463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-623e3c53-e277-457b-89e1-21eafcaeb74d" returned: 0 in 1.000s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:23:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a72a28f5-5a42-4478-872c-295d1574522c tempest-VolumesDeleteCascade-398376463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-623e3c53-e277-457b-89e1-21eafcaeb74d.bd15f2a7-348b-4df3-a13e-035925788068 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:23:54 devstack sudo[103321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-623e3c53-e277-457b-89e1-21eafcaeb74d.bd15f2a7-348b-4df3-a13e-035925788068 Apr 29 15:23:54 devstack sudo[103321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:23:55 devstack sudo[103319]: pam_unix(sudo:session): session closed for user root Apr 29 15:23:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7da4f5f7-19f1-4863-8537-2ca681825f06 tempest-VolumesSnapshotListTestJSON-511230180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1" returned: 0 in 0.764s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:23:55 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-7da4f5f7-19f1-4863-8537-2ca681825f06 tempest-VolumesSnapshotListTestJSON-511230180 None] <== create_volume: return (2046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:23:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-7da4f5f7-19f1-4863-8537-2ca681825f06 tempest-VolumesSnapshotListTestJSON-511230180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.050s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:23:55 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-7da4f5f7-19f1-4863-8537-2ca681825f06 tempest-VolumesSnapshotListTestJSON-511230180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d758e02f-7d87-4750-83bc-e4ca0cd4b267) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:23:55 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-7da4f5f7-19f1-4863-8537-2ca681825f06 tempest-VolumesSnapshotListTestJSON-511230180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (907f01f4-c7b0-4676-a5d7-07cd21fe8cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:23:55 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-7da4f5f7-19f1-4863-8537-2ca681825f06 tempest-VolumesSnapshotListTestJSON-511230180 None] Volume volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1 (13098a57-c4c1-4e2e-bcce-6ac665f383c1): created successfully Apr 29 15:23:55 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-7da4f5f7-19f1-4863-8537-2ca681825f06 tempest-VolumesSnapshotListTestJSON-511230180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (907f01f4-c7b0-4676-a5d7-07cd21fe8cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:23:55 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-7da4f5f7-19f1-4863-8537-2ca681825f06 tempest-VolumesSnapshotListTestJSON-511230180 None] Flow 'volume_create_manager' (5cedec88-dbd3-40d2-a540-df88a8a2e7a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:23:55 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-7da4f5f7-19f1-4863-8537-2ca681825f06 tempest-VolumesSnapshotListTestJSON-511230180 None] Created volume successfully. Apr 29 15:23:55 devstack sudo[103321]: pam_unix(sudo:session): session closed for user root Apr 29 15:23:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a72a28f5-5a42-4478-872c-295d1574522c tempest-VolumesDeleteCascade-398376463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-623e3c53-e277-457b-89e1-21eafcaeb74d.bd15f2a7-348b-4df3-a13e-035925788068" returned: 0 in 0.887s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:23:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a72a28f5-5a42-4478-872c-295d1574522c tempest-VolumesDeleteCascade-398376463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-623e3c53-e277-457b-89e1-21eafcaeb74d.bd15f2a7-348b-4df3-a13e-035925788068 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:23:55 devstack sudo[103329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-623e3c53-e277-457b-89e1-21eafcaeb74d.bd15f2a7-348b-4df3-a13e-035925788068 Apr 29 15:23:55 devstack sudo[103329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:23:56 devstack sudo[103329]: pam_unix(sudo:session): session closed for user root Apr 29 15:23:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a72a28f5-5a42-4478-872c-295d1574522c tempest-VolumesDeleteCascade-398376463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-623e3c53-e277-457b-89e1-21eafcaeb74d.bd15f2a7-348b-4df3-a13e-035925788068" returned: 0 in 0.622s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:23:56 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a72a28f5-5a42-4478-872c-295d1574522c tempest-VolumesDeleteCascade-398376463 None] Lock "cinder-quobyte-bd15f2a7-348b-4df3-a13e-035925788068" released by "_delete_snapshot" :: held 3.856s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:23:56 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a72a28f5-5a42-4478-872c-295d1574522c tempest-VolumesDeleteCascade-398376463 None] Lock "cinder-quobyte-623e3c53-e277-457b-89e1-21eafcaeb74d" released by "delete_snapshot" :: held 3.884s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:23:56 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-a72a28f5-5a42-4478-872c-295d1574522c tempest-VolumesDeleteCascade-398376463 None] Created reservations ['733e302e-135b-4bdd-b581-0faccd8fa03b', '02902250-5ecf-4313-bdbd-5a4b1fc5e713', 'ec971078-3e63-45e4-99ce-9a01fc13d3d7', '4f73fa5d-c1f9-4fc3-bf98-33c9341fd7b3'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:23:56 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-a72a28f5-5a42-4478-872c-295d1574522c tempest-VolumesDeleteCascade-398376463 None] Delete snapshot completed successfully. Apr 29 15:23:56 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a72a28f5-5a42-4478-872c-295d1574522c tempest-VolumesDeleteCascade-398376463 None] Lock "cinder-bd15f2a7-348b-4df3-a13e-035925788068-delete_snapshot" released by "delete_snapshot" :: held 4.151s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:23:56 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-a72a28f5-5a42-4478-872c-295d1574522c tempest-VolumesDeleteCascade-398376463 None] Snapshots deleted, issuing volume delete {{(pid=84448) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 29 15:23:56 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a72a28f5-5a42-4478-872c-295d1574522c tempest-VolumesDeleteCascade-398376463 None] Acquiring lock "cinder-quobyte-623e3c53-e277-457b-89e1-21eafcaeb74d" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:23:56 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a72a28f5-5a42-4478-872c-295d1574522c tempest-VolumesDeleteCascade-398376463 None] Lock "cinder-quobyte-623e3c53-e277-457b-89e1-21eafcaeb74d" acquired by "delete_volume" :: waited 0.028s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:23:56 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d197275-930f-4a6b-bc10-420a48cb1c69]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:23:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a72a28f5-5a42-4478-872c-295d1574522c tempest-VolumesDeleteCascade-398376463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-623e3c53-e277-457b-89e1-21eafcaeb74d {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:23:56 devstack sudo[103332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-623e3c53-e277-457b-89e1-21eafcaeb74d Apr 29 15:23:56 devstack sudo[103332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:23:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-ed727054-8ef7-4664-bbb0-953e7a25e0ce tempest-VolumesSnapshotListTestJSON-511230180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:23:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-ed727054-8ef7-4664-bbb0-953e7a25e0ce tempest-VolumesSnapshotListTestJSON-511230180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:23:56 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-ed727054-8ef7-4664-bbb0-953e7a25e0ce tempest-VolumesSnapshotListTestJSON-511230180 None] Creating offline snapshot 29277b97-2cf4-40a7-a4b3-a17da0e8f7cd of volume 13098a57-c4c1-4e2e-bcce-6ac665f383c1 {{(pid=84448) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 15:23:56 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d03946a-bece-4ccd-8cd9-4aada11ad7aa]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:23:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ed727054-8ef7-4664-bbb0-953e7a25e0ce tempest-VolumesSnapshotListTestJSON-511230180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:23:57 devstack sudo[103334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1 Apr 29 15:23:57 devstack sudo[103334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:23:57 devstack sudo[103332]: pam_unix(sudo:session): session closed for user root Apr 29 15:23:57 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a72a28f5-5a42-4478-872c-295d1574522c tempest-VolumesDeleteCascade-398376463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-623e3c53-e277-457b-89e1-21eafcaeb74d" returned: 0 in 0.833s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:23:57 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a72a28f5-5a42-4478-872c-295d1574522c tempest-VolumesDeleteCascade-398376463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-623e3c53-e277-457b-89e1-21eafcaeb74d {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:23:57 devstack sudo[103339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-623e3c53-e277-457b-89e1-21eafcaeb74d Apr 29 15:23:57 devstack sudo[103339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:23:57 devstack sudo[103334]: pam_unix(sudo:session): session closed for user root Apr 29 15:23:57 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ed727054-8ef7-4664-bbb0-953e7a25e0ce tempest-VolumesSnapshotListTestJSON-511230180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1" returned: 0 in 0.964s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:23:57 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ed727054-8ef7-4664-bbb0-953e7a25e0ce tempest-VolumesSnapshotListTestJSON-511230180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.29277b97-2cf4-40a7-a4b3-a17da0e8f7cd 1G {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:23:57 devstack sudo[103344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.29277b97-2cf4-40a7-a4b3-a17da0e8f7cd 1G Apr 29 15:23:57 devstack sudo[103344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:23:58 devstack sudo[103339]: pam_unix(sudo:session): session closed for user root Apr 29 15:23:58 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a72a28f5-5a42-4478-872c-295d1574522c tempest-VolumesDeleteCascade-398376463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-623e3c53-e277-457b-89e1-21eafcaeb74d" returned: 0 in 0.804s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:23:58 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a72a28f5-5a42-4478-872c-295d1574522c tempest-VolumesDeleteCascade-398376463 None] Lock "cinder-quobyte-623e3c53-e277-457b-89e1-21eafcaeb74d" released by "delete_volume" :: held 1.740s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:23:58 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-a72a28f5-5a42-4478-872c-295d1574522c tempest-VolumesDeleteCascade-398376463 None] Created reservations ['6caec308-44b4-4acf-928a-ef59c7add73e', 'a3df7b21-4602-4e72-9fcd-251197887cff', '4635cf1d-a749-41cb-8b96-47aabcc08b73', '42f576eb-5e73-4ba9-959a-fe846c91ac29'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:23:58 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-a72a28f5-5a42-4478-872c-295d1574522c tempest-VolumesDeleteCascade-398376463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:23:58 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-a72a28f5-5a42-4478-872c-295d1574522c tempest-VolumesDeleteCascade-398376463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:23:58 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-a72a28f5-5a42-4478-872c-295d1574522c tempest-VolumesDeleteCascade-398376463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:23:58 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-a72a28f5-5a42-4478-872c-295d1574522c tempest-VolumesDeleteCascade-398376463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:23:58 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-a72a28f5-5a42-4478-872c-295d1574522c tempest-VolumesDeleteCascade-398376463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:23:58 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a72a28f5-5a42-4478-872c-295d1574522c tempest-VolumesDeleteCascade-398376463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:23:58 devstack sudo[103348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:23:58 devstack sudo[103348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:23:58 devstack sudo[103344]: pam_unix(sudo:session): session closed for user root Apr 29 15:23:58 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ed727054-8ef7-4664-bbb0-953e7a25e0ce tempest-VolumesSnapshotListTestJSON-511230180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.29277b97-2cf4-40a7-a4b3-a17da0e8f7cd 1G" returned: 0 in 0.989s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:23:58 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ed727054-8ef7-4664-bbb0-953e7a25e0ce tempest-VolumesSnapshotListTestJSON-511230180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1 -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.29277b97-2cf4-40a7-a4b3-a17da0e8f7cd {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:23:58 devstack sudo[103353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1 -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.29277b97-2cf4-40a7-a4b3-a17da0e8f7cd Apr 29 15:23:58 devstack sudo[103353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:23:59 devstack sudo[103348]: pam_unix(sudo:session): session closed for user root Apr 29 15:23:59 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a72a28f5-5a42-4478-872c-295d1574522c tempest-VolumesDeleteCascade-398376463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.778s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:23:59 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-a72a28f5-5a42-4478-872c-295d1574522c tempest-VolumesDeleteCascade-398376463 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:23:59 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-a72a28f5-5a42-4478-872c-295d1574522c tempest-VolumesDeleteCascade-398376463 None] Deleted volume successfully. Apr 29 15:23:59 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a72a28f5-5a42-4478-872c-295d1574522c tempest-VolumesDeleteCascade-398376463 None] Lock "cinder-623e3c53-e277-457b-89e1-21eafcaeb74d-delete_volume" released by "delete_volume" :: held 14.127s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:23:59 devstack sudo[103353]: pam_unix(sudo:session): session closed for user root Apr 29 15:23:59 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ed727054-8ef7-4664-bbb0-953e7a25e0ce tempest-VolumesSnapshotListTestJSON-511230180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1 -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.29277b97-2cf4-40a7-a4b3-a17da0e8f7cd" returned: 0 in 1.039s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:23:59 devstack cinder-volume[84448]: WARNING cinder.volume.drivers.remotefs [None req-ed727054-8ef7-4664-bbb0-953e7a25e0ce tempest-VolumesSnapshotListTestJSON-511230180 None] /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.29277b97-2cf4-40a7-a4b3-a17da0e8f7cd is being set with open permissions: ugo+rw Apr 29 15:23:59 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ed727054-8ef7-4664-bbb0-953e7a25e0ce tempest-VolumesSnapshotListTestJSON-511230180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.29277b97-2cf4-40a7-a4b3-a17da0e8f7cd {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:23:59 devstack sudo[103362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.29277b97-2cf4-40a7-a4b3-a17da0e8f7cd Apr 29 15:23:59 devstack sudo[103362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:24:00 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6707033-fd48-4991-97ac-e00e2e95a76d tempest-VolumesDeleteCascade-398376463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:24:00 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b6707033-fd48-4991-97ac-e00e2e95a76d tempest-VolumesDeleteCascade-398376463 None] Flow 'volume_create_manager' (a0787d14-1b69-4ed5-b4f4-12c8ac97ae98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:24:00 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b6707033-fd48-4991-97ac-e00e2e95a76d tempest-VolumesDeleteCascade-398376463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2e1a0f0-dee4-40a1-9446-1e6153f73bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:24:00 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b6707033-fd48-4991-97ac-e00e2e95a76d tempest-VolumesDeleteCascade-398376463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2e1a0f0-dee4-40a1-9446-1e6153f73bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:24:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-67487063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=619e814d-be58-4683-a0f4-44f374d91e8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c4f94025b594b37ba67e3a4a845b795',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:24:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:24:00Z,use_quota=True,user_id='1f4382ad45db4e10a30a8f3a76751e71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:24:00 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b6707033-fd48-4991-97ac-e00e2e95a76d tempest-VolumesDeleteCascade-398376463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e1a7a1b-3b5a-4a55-8285-201004980550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:24:00 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b6707033-fd48-4991-97ac-e00e2e95a76d tempest-VolumesDeleteCascade-398376463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e1a7a1b-3b5a-4a55-8285-201004980550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:24:00 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b6707033-fd48-4991-97ac-e00e2e95a76d tempest-VolumesDeleteCascade-398376463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c961723-f917-414c-b17d-3b473f57801c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:24:00 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b6707033-fd48-4991-97ac-e00e2e95a76d tempest-VolumesDeleteCascade-398376463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c961723-f917-414c-b17d-3b473f57801c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '619e814d-be58-4683-a0f4-44f374d91e8a', 'volume_name': 'volume-619e814d-be58-4683-a0f4-44f374d91e8a', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:24:00 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b6707033-fd48-4991-97ac-e00e2e95a76d tempest-VolumesDeleteCascade-398376463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53df2f46-8807-4e64-b217-8e9aeddf8e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:24:00 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b6707033-fd48-4991-97ac-e00e2e95a76d tempest-VolumesDeleteCascade-398376463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53df2f46-8807-4e64-b217-8e9aeddf8e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:24:00 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b6707033-fd48-4991-97ac-e00e2e95a76d tempest-VolumesDeleteCascade-398376463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fa7f63b-d8f5-40d3-894d-d6097f2c9d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:24:00 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-b6707033-fd48-4991-97ac-e00e2e95a76d tempest-VolumesDeleteCascade-398376463 None] Volume 619e814d-be58-4683-a0f4-44f374d91e8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-619e814d-be58-4683-a0f4-44f374d91e8a', 'volume_size': 1} Apr 29 15:24:00 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-b6707033-fd48-4991-97ac-e00e2e95a76d tempest-VolumesDeleteCascade-398376463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:24:00 devstack sudo[103362]: pam_unix(sudo:session): session closed for user root Apr 29 15:24:00 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ed727054-8ef7-4664-bbb0-953e7a25e0ce tempest-VolumesSnapshotListTestJSON-511230180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.29277b97-2cf4-40a7-a4b3-a17da0e8f7cd" returned: 0 in 0.739s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:24:00 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ed727054-8ef7-4664-bbb0-953e7a25e0ce tempest-VolumesSnapshotListTestJSON-511230180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.info {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:24:00 devstack sudo[103365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.info Apr 29 15:24:00 devstack sudo[103365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:24:01 devstack sudo[103365]: pam_unix(sudo:session): session closed for user root Apr 29 15:24:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ed727054-8ef7-4664-bbb0-953e7a25e0ce tempest-VolumesSnapshotListTestJSON-511230180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.info" returned: 0 in 0.630s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:24:01 devstack cinder-volume[84448]: WARNING cinder.volume.drivers.remotefs [None req-ed727054-8ef7-4664-bbb0-953e7a25e0ce tempest-VolumesSnapshotListTestJSON-511230180 None] /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.info is being set with open permissions: ugo+rw Apr 29 15:24:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ed727054-8ef7-4664-bbb0-953e7a25e0ce tempest-VolumesSnapshotListTestJSON-511230180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.info {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:24:01 devstack sudo[103368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.info Apr 29 15:24:01 devstack sudo[103368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:24:01 devstack sudo[103368]: pam_unix(sudo:session): session closed for user root Apr 29 15:24:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ed727054-8ef7-4664-bbb0-953e7a25e0ce tempest-VolumesSnapshotListTestJSON-511230180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.info" returned: 0 in 0.652s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:24:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-ed727054-8ef7-4664-bbb0-953e7a25e0ce tempest-VolumesSnapshotListTestJSON-511230180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.135s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:24:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-b6707033-fd48-4991-97ac-e00e2e95a76d tempest-VolumesDeleteCascade-398376463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.645s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:24:01 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-b6707033-fd48-4991-97ac-e00e2e95a76d tempest-VolumesDeleteCascade-398376463 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:24:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-67487063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=619e814d-be58-4683-a0f4-44f374d91e8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c4f94025b594b37ba67e3a4a845b795',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:24:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:24:00Z,use_quota=True,user_id='1f4382ad45db4e10a30a8f3a76751e71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:24:01 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-b6707033-fd48-4991-97ac-e00e2e95a76d tempest-VolumesDeleteCascade-398376463 None] Creating volume 619e814d-be58-4683-a0f4-44f374d91e8a {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:24:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-b6707033-fd48-4991-97ac-e00e2e95a76d tempest-VolumesDeleteCascade-398376463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:24:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-b6707033-fd48-4991-97ac-e00e2e95a76d tempest-VolumesDeleteCascade-398376463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:24:01 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-b6707033-fd48-4991-97ac-e00e2e95a76d tempest-VolumesDeleteCascade-398376463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:24:01 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-b6707033-fd48-4991-97ac-e00e2e95a76d tempest-VolumesDeleteCascade-398376463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:24:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-b6707033-fd48-4991-97ac-e00e2e95a76d tempest-VolumesDeleteCascade-398376463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:24:01 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-b6707033-fd48-4991-97ac-e00e2e95a76d tempest-VolumesDeleteCascade-398376463 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:24:01 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-b6707033-fd48-4991-97ac-e00e2e95a76d tempest-VolumesDeleteCascade-398376463 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:24:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-b6707033-fd48-4991-97ac-e00e2e95a76d tempest-VolumesDeleteCascade-398376463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-619e814d-be58-4683-a0f4-44f374d91e8a 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:24:01 devstack sudo[103371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-619e814d-be58-4683-a0f4-44f374d91e8a 1073741824 Apr 29 15:24:02 devstack sudo[103371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:24:02 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-ed727054-8ef7-4664-bbb0-953e7a25e0ce tempest-VolumesSnapshotListTestJSON-511230180 None] Create snapshot completed successfully Apr 29 15:24:02 devstack sudo[103371]: pam_unix(sudo:session): session closed for user root Apr 29 15:24:02 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-b6707033-fd48-4991-97ac-e00e2e95a76d tempest-VolumesDeleteCascade-398376463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-619e814d-be58-4683-a0f4-44f374d91e8a 1073741824" returned: 0 in 0.827s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:24:02 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-b6707033-fd48-4991-97ac-e00e2e95a76d tempest-VolumesDeleteCascade-398376463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-619e814d-be58-4683-a0f4-44f374d91e8a {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:24:02 devstack sudo[103377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-619e814d-be58-4683-a0f4-44f374d91e8a Apr 29 15:24:02 devstack sudo[103377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:24:03 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-d16c0322-54dd-42cb-bea3-d7c79861164c tempest-VolumesSnapshotListTestJSON-511230180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:24:03 devstack sudo[103377]: pam_unix(sudo:session): session closed for user root Apr 29 15:24:03 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-b6707033-fd48-4991-97ac-e00e2e95a76d tempest-VolumesDeleteCascade-398376463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-619e814d-be58-4683-a0f4-44f374d91e8a" returned: 0 in 0.633s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:24:03 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-b6707033-fd48-4991-97ac-e00e2e95a76d tempest-VolumesDeleteCascade-398376463 None] <== create_volume: return (1517ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:24:03 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-b6707033-fd48-4991-97ac-e00e2e95a76d tempest-VolumesDeleteCascade-398376463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.521s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:24:03 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-d16c0322-54dd-42cb-bea3-d7c79861164c tempest-VolumesSnapshotListTestJSON-511230180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.145s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:24:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b6707033-fd48-4991-97ac-e00e2e95a76d tempest-VolumesDeleteCascade-398376463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fa7f63b-d8f5-40d3-894d-d6097f2c9d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-619e814d-be58-4683-a0f4-44f374d91e8a', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:24:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b6707033-fd48-4991-97ac-e00e2e95a76d tempest-VolumesDeleteCascade-398376463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f00bcd10-d1e7-4754-a1b8-fb64642921d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:24:03 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-d16c0322-54dd-42cb-bea3-d7c79861164c tempest-VolumesSnapshotListTestJSON-511230180 None] Creating offline snapshot bea47dcd-12eb-442a-9f4c-48cfa9db3370 of volume 13098a57-c4c1-4e2e-bcce-6ac665f383c1 {{(pid=84448) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 15:24:03 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-b6707033-fd48-4991-97ac-e00e2e95a76d tempest-VolumesDeleteCascade-398376463 None] Volume volume-619e814d-be58-4683-a0f4-44f374d91e8a (619e814d-be58-4683-a0f4-44f374d91e8a): created successfully Apr 29 15:24:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b6707033-fd48-4991-97ac-e00e2e95a76d tempest-VolumesDeleteCascade-398376463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f00bcd10-d1e7-4754-a1b8-fb64642921d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:24:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b6707033-fd48-4991-97ac-e00e2e95a76d tempest-VolumesDeleteCascade-398376463 None] Flow 'volume_create_manager' (a0787d14-1b69-4ed5-b4f4-12c8ac97ae98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:24:03 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b123a3-0375-42e6-b398-c436f0e614bc]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:24:03 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-d16c0322-54dd-42cb-bea3-d7c79861164c tempest-VolumesSnapshotListTestJSON-511230180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.29277b97-2cf4-40a7-a4b3-a17da0e8f7cd {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:24:03 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-b6707033-fd48-4991-97ac-e00e2e95a76d tempest-VolumesDeleteCascade-398376463 None] Created volume successfully. Apr 29 15:24:03 devstack sudo[103380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.29277b97-2cf4-40a7-a4b3-a17da0e8f7cd Apr 29 15:24:03 devstack sudo[103380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:24:04 devstack sudo[103380]: pam_unix(sudo:session): session closed for user root Apr 29 15:24:04 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-d16c0322-54dd-42cb-bea3-d7c79861164c tempest-VolumesSnapshotListTestJSON-511230180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.29277b97-2cf4-40a7-a4b3-a17da0e8f7cd" returned: 0 in 0.725s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:24:04 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-d16c0322-54dd-42cb-bea3-d7c79861164c tempest-VolumesSnapshotListTestJSON-511230180 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84448) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 15:24:04 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-d16c0322-54dd-42cb-bea3-d7c79861164c tempest-VolumesSnapshotListTestJSON-511230180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.29277b97-2cf4-40a7-a4b3-a17da0e8f7cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.bea47dcd-12eb-442a-9f4c-48cfa9db3370 1G {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:24:04 devstack sudo[103385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.29277b97-2cf4-40a7-a4b3-a17da0e8f7cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.bea47dcd-12eb-442a-9f4c-48cfa9db3370 1G Apr 29 15:24:04 devstack sudo[103385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:24:04 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-017cb43d-e165-4a6c-adb4-691a82674e1a tempest-VolumesDeleteCascade-398376463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:24:05 devstack sudo[103385]: pam_unix(sudo:session): session closed for user root Apr 29 15:24:05 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-d16c0322-54dd-42cb-bea3-d7c79861164c tempest-VolumesSnapshotListTestJSON-511230180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.29277b97-2cf4-40a7-a4b3-a17da0e8f7cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.bea47dcd-12eb-442a-9f4c-48cfa9db3370 1G" returned: 0 in 0.793s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:24:05 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-d16c0322-54dd-42cb-bea3-d7c79861164c tempest-VolumesSnapshotListTestJSON-511230180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.29277b97-2cf4-40a7-a4b3-a17da0e8f7cd -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.bea47dcd-12eb-442a-9f4c-48cfa9db3370 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:24:05 devstack sudo[103390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.29277b97-2cf4-40a7-a4b3-a17da0e8f7cd -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.bea47dcd-12eb-442a-9f4c-48cfa9db3370 Apr 29 15:24:05 devstack sudo[103390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:24:05 devstack sudo[103390]: pam_unix(sudo:session): session closed for user root Apr 29 15:24:05 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-d16c0322-54dd-42cb-bea3-d7c79861164c tempest-VolumesSnapshotListTestJSON-511230180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.29277b97-2cf4-40a7-a4b3-a17da0e8f7cd -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.bea47dcd-12eb-442a-9f4c-48cfa9db3370" returned: 0 in 0.661s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:24:05 devstack cinder-volume[84448]: WARNING cinder.volume.drivers.remotefs [None req-d16c0322-54dd-42cb-bea3-d7c79861164c tempest-VolumesSnapshotListTestJSON-511230180 None] /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.bea47dcd-12eb-442a-9f4c-48cfa9db3370 is being set with open permissions: ugo+rw Apr 29 15:24:05 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-d16c0322-54dd-42cb-bea3-d7c79861164c tempest-VolumesSnapshotListTestJSON-511230180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.bea47dcd-12eb-442a-9f4c-48cfa9db3370 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:24:05 devstack sudo[103396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.bea47dcd-12eb-442a-9f4c-48cfa9db3370 Apr 29 15:24:05 devstack sudo[103396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:24:06 devstack sudo[103396]: pam_unix(sudo:session): session closed for user root Apr 29 15:24:06 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-d16c0322-54dd-42cb-bea3-d7c79861164c tempest-VolumesSnapshotListTestJSON-511230180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.bea47dcd-12eb-442a-9f4c-48cfa9db3370" returned: 0 in 0.617s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:24:06 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-d16c0322-54dd-42cb-bea3-d7c79861164c tempest-VolumesSnapshotListTestJSON-511230180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.940s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:24:06 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-017cb43d-e165-4a6c-adb4-691a82674e1a tempest-VolumesDeleteCascade-398376463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.715s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:24:06 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-017cb43d-e165-4a6c-adb4-691a82674e1a tempest-VolumesDeleteCascade-398376463 None] Creating offline snapshot 3ac39fb1-a671-4f6f-8695-d6736c1d27b5 of volume 619e814d-be58-4683-a0f4-44f374d91e8a {{(pid=84448) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 15:24:06 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c38d7e1-df21-4078-bca9-493496a99f76]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:24:06 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-017cb43d-e165-4a6c-adb4-691a82674e1a tempest-VolumesDeleteCascade-398376463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-619e814d-be58-4683-a0f4-44f374d91e8a {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:24:06 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-d16c0322-54dd-42cb-bea3-d7c79861164c tempest-VolumesSnapshotListTestJSON-511230180 None] Create snapshot completed successfully Apr 29 15:24:06 devstack sudo[103414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-619e814d-be58-4683-a0f4-44f374d91e8a Apr 29 15:24:06 devstack sudo[103414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:24:07 devstack sudo[103414]: pam_unix(sudo:session): session closed for user root Apr 29 15:24:07 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-017cb43d-e165-4a6c-adb4-691a82674e1a tempest-VolumesDeleteCascade-398376463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-619e814d-be58-4683-a0f4-44f374d91e8a" returned: 0 in 0.751s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:24:07 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-017cb43d-e165-4a6c-adb4-691a82674e1a tempest-VolumesDeleteCascade-398376463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-619e814d-be58-4683-a0f4-44f374d91e8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-619e814d-be58-4683-a0f4-44f374d91e8a.3ac39fb1-a671-4f6f-8695-d6736c1d27b5 1G {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:24:07 devstack sudo[103421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-619e814d-be58-4683-a0f4-44f374d91e8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-619e814d-be58-4683-a0f4-44f374d91e8a.3ac39fb1-a671-4f6f-8695-d6736c1d27b5 1G Apr 29 15:24:07 devstack sudo[103421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:24:07 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-adbb141f-8473-48cb-b01d-656e8c6bd8e7 tempest-VolumesSnapshotListTestJSON-511230180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:24:07 devstack sudo[103421]: pam_unix(sudo:session): session closed for user root Apr 29 15:24:07 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-017cb43d-e165-4a6c-adb4-691a82674e1a tempest-VolumesDeleteCascade-398376463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-619e814d-be58-4683-a0f4-44f374d91e8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-619e814d-be58-4683-a0f4-44f374d91e8a.3ac39fb1-a671-4f6f-8695-d6736c1d27b5 1G" returned: 0 in 0.756s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:24:07 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-017cb43d-e165-4a6c-adb4-691a82674e1a tempest-VolumesDeleteCascade-398376463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-619e814d-be58-4683-a0f4-44f374d91e8a -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-619e814d-be58-4683-a0f4-44f374d91e8a.3ac39fb1-a671-4f6f-8695-d6736c1d27b5 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:24:08 devstack sudo[103426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-619e814d-be58-4683-a0f4-44f374d91e8a -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-619e814d-be58-4683-a0f4-44f374d91e8a.3ac39fb1-a671-4f6f-8695-d6736c1d27b5 Apr 29 15:24:08 devstack sudo[103426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:24:08 devstack sudo[103426]: pam_unix(sudo:session): session closed for user root Apr 29 15:24:08 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-017cb43d-e165-4a6c-adb4-691a82674e1a tempest-VolumesDeleteCascade-398376463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-619e814d-be58-4683-a0f4-44f374d91e8a -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-619e814d-be58-4683-a0f4-44f374d91e8a.3ac39fb1-a671-4f6f-8695-d6736c1d27b5" returned: 0 in 0.626s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:24:08 devstack cinder-volume[84448]: WARNING cinder.volume.drivers.remotefs [None req-017cb43d-e165-4a6c-adb4-691a82674e1a tempest-VolumesDeleteCascade-398376463 None] /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-619e814d-be58-4683-a0f4-44f374d91e8a.3ac39fb1-a671-4f6f-8695-d6736c1d27b5 is being set with open permissions: ugo+rw Apr 29 15:24:08 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-017cb43d-e165-4a6c-adb4-691a82674e1a tempest-VolumesDeleteCascade-398376463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-619e814d-be58-4683-a0f4-44f374d91e8a.3ac39fb1-a671-4f6f-8695-d6736c1d27b5 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:24:08 devstack sudo[103431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-619e814d-be58-4683-a0f4-44f374d91e8a.3ac39fb1-a671-4f6f-8695-d6736c1d27b5 Apr 29 15:24:08 devstack sudo[103431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:24:09 devstack sudo[103431]: pam_unix(sudo:session): session closed for user root Apr 29 15:24:09 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-017cb43d-e165-4a6c-adb4-691a82674e1a tempest-VolumesDeleteCascade-398376463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-619e814d-be58-4683-a0f4-44f374d91e8a.3ac39fb1-a671-4f6f-8695-d6736c1d27b5" returned: 0 in 0.579s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:24:09 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-017cb43d-e165-4a6c-adb4-691a82674e1a tempest-VolumesDeleteCascade-398376463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-619e814d-be58-4683-a0f4-44f374d91e8a.info {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:24:09 devstack sudo[103434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-619e814d-be58-4683-a0f4-44f374d91e8a.info Apr 29 15:24:09 devstack sudo[103434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:24:09 devstack sudo[103434]: pam_unix(sudo:session): session closed for user root Apr 29 15:24:09 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-017cb43d-e165-4a6c-adb4-691a82674e1a tempest-VolumesDeleteCascade-398376463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-619e814d-be58-4683-a0f4-44f374d91e8a.info" returned: 0 in 0.575s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:24:09 devstack cinder-volume[84448]: WARNING cinder.volume.drivers.remotefs [None req-017cb43d-e165-4a6c-adb4-691a82674e1a tempest-VolumesDeleteCascade-398376463 None] /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-619e814d-be58-4683-a0f4-44f374d91e8a.info is being set with open permissions: ugo+rw Apr 29 15:24:09 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-017cb43d-e165-4a6c-adb4-691a82674e1a tempest-VolumesDeleteCascade-398376463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-619e814d-be58-4683-a0f4-44f374d91e8a.info {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:24:09 devstack sudo[103437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-619e814d-be58-4683-a0f4-44f374d91e8a.info Apr 29 15:24:09 devstack sudo[103437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:24:10 devstack sudo[103437]: pam_unix(sudo:session): session closed for user root Apr 29 15:24:10 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-017cb43d-e165-4a6c-adb4-691a82674e1a tempest-VolumesDeleteCascade-398376463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-619e814d-be58-4683-a0f4-44f374d91e8a.info" returned: 0 in 0.572s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:24:10 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-017cb43d-e165-4a6c-adb4-691a82674e1a tempest-VolumesDeleteCascade-398376463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.963s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:24:10 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-adbb141f-8473-48cb-b01d-656e8c6bd8e7 tempest-VolumesSnapshotListTestJSON-511230180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.713s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:24:10 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-adbb141f-8473-48cb-b01d-656e8c6bd8e7 tempest-VolumesSnapshotListTestJSON-511230180 None] Creating offline snapshot 691ab62c-913c-424a-9b9f-71eee60bd4b1 of volume 13098a57-c4c1-4e2e-bcce-6ac665f383c1 {{(pid=84448) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 15:24:10 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-017cb43d-e165-4a6c-adb4-691a82674e1a tempest-VolumesDeleteCascade-398376463 None] Create snapshot completed successfully Apr 29 15:24:10 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[d08f0002-594f-494a-a13b-5523771fc106]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:24:10 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-adbb141f-8473-48cb-b01d-656e8c6bd8e7 tempest-VolumesSnapshotListTestJSON-511230180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.bea47dcd-12eb-442a-9f4c-48cfa9db3370 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:24:10 devstack sudo[103440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.bea47dcd-12eb-442a-9f4c-48cfa9db3370 Apr 29 15:24:10 devstack sudo[103440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:24:11 devstack sudo[103440]: pam_unix(sudo:session): session closed for user root Apr 29 15:24:11 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-adbb141f-8473-48cb-b01d-656e8c6bd8e7 tempest-VolumesSnapshotListTestJSON-511230180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.bea47dcd-12eb-442a-9f4c-48cfa9db3370" returned: 0 in 0.705s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:24:11 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-adbb141f-8473-48cb-b01d-656e8c6bd8e7 tempest-VolumesSnapshotListTestJSON-511230180 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84448) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 15:24:11 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-adbb141f-8473-48cb-b01d-656e8c6bd8e7 tempest-VolumesSnapshotListTestJSON-511230180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.bea47dcd-12eb-442a-9f4c-48cfa9db3370,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.691ab62c-913c-424a-9b9f-71eee60bd4b1 1G {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:24:11 devstack sudo[103445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.bea47dcd-12eb-442a-9f4c-48cfa9db3370,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.691ab62c-913c-424a-9b9f-71eee60bd4b1 1G Apr 29 15:24:11 devstack sudo[103445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:24:11 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c84bf10-5e3c-4467-b8c9-459b8b2e6b17 tempest-VolumesDeleteCascade-398376463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:24:11 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-9c84bf10-5e3c-4467-b8c9-459b8b2e6b17 tempest-VolumesDeleteCascade-398376463 None] Flow 'volume_create_manager' (85e528f4-1e60-41f5-9d2d-b38c040dc30f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:24:11 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-9c84bf10-5e3c-4467-b8c9-459b8b2e6b17 tempest-VolumesDeleteCascade-398376463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e41b8f62-0286-4fe3-8df7-35fb251b095d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:24:11 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-9c84bf10-5e3c-4467-b8c9-459b8b2e6b17 tempest-VolumesDeleteCascade-398376463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e41b8f62-0286-4fe3-8df7-35fb251b095d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:24:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1824746687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bfad901-b84f-4e66-8e24-1ba0fb9a4c5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c4f94025b594b37ba67e3a4a845b795',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:24:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3ac39fb1-a671-4f6f-8695-d6736c1d27b5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:24:11Z,use_quota=True,user_id='1f4382ad45db4e10a30a8f3a76751e71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:24:11 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-9c84bf10-5e3c-4467-b8c9-459b8b2e6b17 tempest-VolumesDeleteCascade-398376463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94e4916a-9888-4778-8cc5-ac820d037069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:24:11 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-9c84bf10-5e3c-4467-b8c9-459b8b2e6b17 tempest-VolumesDeleteCascade-398376463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94e4916a-9888-4778-8cc5-ac820d037069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:24:11 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-9c84bf10-5e3c-4467-b8c9-459b8b2e6b17 tempest-VolumesDeleteCascade-398376463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b8d5fda-ae26-474c-bdcd-92a4851fc40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:24:11 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-9c84bf10-5e3c-4467-b8c9-459b8b2e6b17 tempest-VolumesDeleteCascade-398376463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b8d5fda-ae26-474c-bdcd-92a4851fc40b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0bfad901-b84f-4e66-8e24-1ba0fb9a4c5b', 'volume_name': 'volume-0bfad901-b84f-4e66-8e24-1ba0fb9a4c5b', 'volume_size': 1, 'snapshot_id': '3ac39fb1-a671-4f6f-8695-d6736c1d27b5'}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:24:11 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-9c84bf10-5e3c-4467-b8c9-459b8b2e6b17 tempest-VolumesDeleteCascade-398376463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9da0247d-4e72-4ce3-a767-50318b9f386e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:24:11 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-9c84bf10-5e3c-4467-b8c9-459b8b2e6b17 tempest-VolumesDeleteCascade-398376463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9da0247d-4e72-4ce3-a767-50318b9f386e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:24:11 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-9c84bf10-5e3c-4467-b8c9-459b8b2e6b17 tempest-VolumesDeleteCascade-398376463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c78841e4-68e5-481c-ae36-e5e9ceef6fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:24:11 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-9c84bf10-5e3c-4467-b8c9-459b8b2e6b17 tempest-VolumesDeleteCascade-398376463 None] Volume 0bfad901-b84f-4e66-8e24-1ba0fb9a4c5b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0bfad901-b84f-4e66-8e24-1ba0fb9a4c5b', 'volume_size': 1, 'snapshot_id': '3ac39fb1-a671-4f6f-8695-d6736c1d27b5'} Apr 29 15:24:11 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-9c84bf10-5e3c-4467-b8c9-459b8b2e6b17 tempest-VolumesDeleteCascade-398376463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:24:11 devstack sudo[103445]: pam_unix(sudo:session): session closed for user root Apr 29 15:24:11 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-adbb141f-8473-48cb-b01d-656e8c6bd8e7 tempest-VolumesSnapshotListTestJSON-511230180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.bea47dcd-12eb-442a-9f4c-48cfa9db3370,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.691ab62c-913c-424a-9b9f-71eee60bd4b1 1G" returned: 0 in 0.828s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:24:11 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-adbb141f-8473-48cb-b01d-656e8c6bd8e7 tempest-VolumesSnapshotListTestJSON-511230180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.bea47dcd-12eb-442a-9f4c-48cfa9db3370 -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.691ab62c-913c-424a-9b9f-71eee60bd4b1 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:24:12 devstack sudo[103450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.bea47dcd-12eb-442a-9f4c-48cfa9db3370 -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.691ab62c-913c-424a-9b9f-71eee60bd4b1 Apr 29 15:24:12 devstack sudo[103450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:24:12 devstack sudo[103450]: pam_unix(sudo:session): session closed for user root Apr 29 15:24:12 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-adbb141f-8473-48cb-b01d-656e8c6bd8e7 tempest-VolumesSnapshotListTestJSON-511230180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.bea47dcd-12eb-442a-9f4c-48cfa9db3370 -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.691ab62c-913c-424a-9b9f-71eee60bd4b1" returned: 0 in 0.668s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:24:12 devstack cinder-volume[84448]: WARNING cinder.volume.drivers.remotefs [None req-adbb141f-8473-48cb-b01d-656e8c6bd8e7 tempest-VolumesSnapshotListTestJSON-511230180 None] /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.691ab62c-913c-424a-9b9f-71eee60bd4b1 is being set with open permissions: ugo+rw Apr 29 15:24:12 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-adbb141f-8473-48cb-b01d-656e8c6bd8e7 tempest-VolumesSnapshotListTestJSON-511230180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.691ab62c-913c-424a-9b9f-71eee60bd4b1 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:24:12 devstack sudo[103455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.691ab62c-913c-424a-9b9f-71eee60bd4b1 Apr 29 15:24:12 devstack sudo[103455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:24:13 devstack sudo[103455]: pam_unix(sudo:session): session closed for user root Apr 29 15:24:13 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-adbb141f-8473-48cb-b01d-656e8c6bd8e7 tempest-VolumesSnapshotListTestJSON-511230180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.691ab62c-913c-424a-9b9f-71eee60bd4b1" returned: 0 in 0.616s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:24:13 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-adbb141f-8473-48cb-b01d-656e8c6bd8e7 tempest-VolumesSnapshotListTestJSON-511230180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.916s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:24:13 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-9c84bf10-5e3c-4467-b8c9-459b8b2e6b17 tempest-VolumesDeleteCascade-398376463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.812s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:24:13 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-9c84bf10-5e3c-4467-b8c9-459b8b2e6b17 tempest-VolumesDeleteCascade-398376463 None] Acquiring lock "cinder-quobyte-3ac39fb1-a671-4f6f-8695-d6736c1d27b5-0bfad901-b84f-4e66-8e24-1ba0fb9a4c5b" by "_create_volume_from_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:24:13 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-9c84bf10-5e3c-4467-b8c9-459b8b2e6b17 tempest-VolumesDeleteCascade-398376463 None] Lock "cinder-quobyte-3ac39fb1-a671-4f6f-8695-d6736c1d27b5-0bfad901-b84f-4e66-8e24-1ba0fb9a4c5b" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:24:13 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-9c84bf10-5e3c-4467-b8c9-459b8b2e6b17 tempest-VolumesDeleteCascade-398376463 None] Creating volume 0bfad901-b84f-4e66-8e24-1ba0fb9a4c5b from snapshot 3ac39fb1-a671-4f6f-8695-d6736c1d27b5 {{(pid=84448) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 15:24:13 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-9c84bf10-5e3c-4467-b8c9-459b8b2e6b17 tempest-VolumesDeleteCascade-398376463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:24:13 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-9c84bf10-5e3c-4467-b8c9-459b8b2e6b17 tempest-VolumesDeleteCascade-398376463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:24:13 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-9c84bf10-5e3c-4467-b8c9-459b8b2e6b17 tempest-VolumesDeleteCascade-398376463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:24:13 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-9c84bf10-5e3c-4467-b8c9-459b8b2e6b17 tempest-VolumesDeleteCascade-398376463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:24:13 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-9c84bf10-5e3c-4467-b8c9-459b8b2e6b17 tempest-VolumesDeleteCascade-398376463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:24:13 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-9c84bf10-5e3c-4467-b8c9-459b8b2e6b17 tempest-VolumesDeleteCascade-398376463 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:24:13 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-9c84bf10-5e3c-4467-b8c9-459b8b2e6b17 tempest-VolumesDeleteCascade-398376463 None] Acquiring lock "cinder-quobyte-0bfad901-b84f-4e66-8e24-1ba0fb9a4c5b" by "_copy_volume_from_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:24:13 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-adbb141f-8473-48cb-b01d-656e8c6bd8e7 tempest-VolumesSnapshotListTestJSON-511230180 None] Create snapshot completed successfully Apr 29 15:24:13 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-9c84bf10-5e3c-4467-b8c9-459b8b2e6b17 tempest-VolumesDeleteCascade-398376463 None] Lock "cinder-quobyte-0bfad901-b84f-4e66-8e24-1ba0fb9a4c5b" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:24:13 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-9c84bf10-5e3c-4467-b8c9-459b8b2e6b17 tempest-VolumesDeleteCascade-398376463 None] snapshot: 3ac39fb1-a671-4f6f-8695-d6736c1d27b5, volume: 0bfad901-b84f-4e66-8e24-1ba0fb9a4c5b, {{(pid=84448) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 15:24:13 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-9c84bf10-5e3c-4467-b8c9-459b8b2e6b17 tempest-VolumesDeleteCascade-398376463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:24:13 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-9c84bf10-5e3c-4467-b8c9-459b8b2e6b17 tempest-VolumesDeleteCascade-398376463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:24:13 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-9c84bf10-5e3c-4467-b8c9-459b8b2e6b17 tempest-VolumesDeleteCascade-398376463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:24:13 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-9c84bf10-5e3c-4467-b8c9-459b8b2e6b17 tempest-VolumesDeleteCascade-398376463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:24:13 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-9c84bf10-5e3c-4467-b8c9-459b8b2e6b17 tempest-VolumesDeleteCascade-398376463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:24:13 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[6975f1da-3052-462a-9d9e-d63134bc53e0]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:24:13 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-9c84bf10-5e3c-4467-b8c9-459b8b2e6b17 tempest-VolumesDeleteCascade-398376463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-619e814d-be58-4683-a0f4-44f374d91e8a.3ac39fb1-a671-4f6f-8695-d6736c1d27b5 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:24:13 devstack sudo[103458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-619e814d-be58-4683-a0f4-44f374d91e8a.3ac39fb1-a671-4f6f-8695-d6736c1d27b5 Apr 29 15:24:13 devstack sudo[103458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:24:14 devstack sudo[103458]: pam_unix(sudo:session): session closed for user root Apr 29 15:24:14 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-9c84bf10-5e3c-4467-b8c9-459b8b2e6b17 tempest-VolumesDeleteCascade-398376463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-619e814d-be58-4683-a0f4-44f374d91e8a.3ac39fb1-a671-4f6f-8695-d6736c1d27b5" returned: 0 in 0.773s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:24:14 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-9c84bf10-5e3c-4467-b8c9-459b8b2e6b17 tempest-VolumesDeleteCascade-398376463 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-619e814d-be58-4683-a0f4-44f374d91e8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84448) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 15:24:14 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-9c84bf10-5e3c-4467-b8c9-459b8b2e6b17 tempest-VolumesDeleteCascade-398376463 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-619e814d-be58-4683-a0f4-44f374d91e8a {{(pid=84448) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 15:24:14 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-9c84bf10-5e3c-4467-b8c9-459b8b2e6b17 tempest-VolumesDeleteCascade-398376463 None] Creating direct copy from snapshot {{(pid=84448) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 15:24:14 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e3949a-2612-478e-b384-459ff96d9ef0]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:24:14 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-9c84bf10-5e3c-4467-b8c9-459b8b2e6b17 tempest-VolumesDeleteCascade-398376463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-619e814d-be58-4683-a0f4-44f374d91e8a {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:24:14 devstack sudo[103463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-619e814d-be58-4683-a0f4-44f374d91e8a Apr 29 15:24:14 devstack sudo[103463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:24:14 devstack sudo[103463]: pam_unix(sudo:session): session closed for user root Apr 29 15:24:14 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-5816083b-e060-4918-8372-126dae23b681 tempest-VolumesSnapshotListTestJSON-511230180 None] Acquiring lock "cinder-691ab62c-913c-424a-9b9f-71eee60bd4b1-delete_snapshot" by "delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:24:14 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-9c84bf10-5e3c-4467-b8c9-459b8b2e6b17 tempest-VolumesDeleteCascade-398376463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-619e814d-be58-4683-a0f4-44f374d91e8a" returned: 0 in 0.739s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:24:14 devstack cinder-volume[84448]: DEBUG cinder.utils [None req-9c84bf10-5e3c-4467-b8c9-459b8b2e6b17 tempest-VolumesDeleteCascade-398376463 None] Path /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0bfad901-b84f-4e66-8e24-1ba0fb9a4c5b not found in is_blk_device check {{(pid=84448) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 15:24:14 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-9c84bf10-5e3c-4467-b8c9-459b8b2e6b17 tempest-VolumesDeleteCascade-398376463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-619e814d-be58-4683-a0f4-44f374d91e8a /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0bfad901-b84f-4e66-8e24-1ba0fb9a4c5b {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:24:14 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-5816083b-e060-4918-8372-126dae23b681 tempest-VolumesSnapshotListTestJSON-511230180 None] Lock "cinder-691ab62c-913c-424a-9b9f-71eee60bd4b1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:24:14 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-5816083b-e060-4918-8372-126dae23b681 tempest-VolumesSnapshotListTestJSON-511230180 None] Acquiring lock "cinder-quobyte-13098a57-c4c1-4e2e-bcce-6ac665f383c1" by "delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:24:14 devstack sudo[103468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-619e814d-be58-4683-a0f4-44f374d91e8a /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0bfad901-b84f-4e66-8e24-1ba0fb9a4c5b Apr 29 15:24:14 devstack sudo[103468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:24:14 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-5816083b-e060-4918-8372-126dae23b681 tempest-VolumesSnapshotListTestJSON-511230180 None] Lock "cinder-quobyte-13098a57-c4c1-4e2e-bcce-6ac665f383c1" acquired by "delete_snapshot" :: waited 0.016s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:24:14 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-5816083b-e060-4918-8372-126dae23b681 tempest-VolumesSnapshotListTestJSON-511230180 None] Acquiring lock "cinder-quobyte-691ab62c-913c-424a-9b9f-71eee60bd4b1" by "_delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:24:15 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-5816083b-e060-4918-8372-126dae23b681 tempest-VolumesSnapshotListTestJSON-511230180 None] Lock "cinder-quobyte-691ab62c-913c-424a-9b9f-71eee60bd4b1" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:24:15 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-5816083b-e060-4918-8372-126dae23b681 tempest-VolumesSnapshotListTestJSON-511230180 None] Deleting offline snapshot 691ab62c-913c-424a-9b9f-71eee60bd4b1 of volume 13098a57-c4c1-4e2e-bcce-6ac665f383c1 {{(pid=84448) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 15:24:15 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-5816083b-e060-4918-8372-126dae23b681 tempest-VolumesSnapshotListTestJSON-511230180 None] snapshot_file for this snap is: volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.691ab62c-913c-424a-9b9f-71eee60bd4b1 {{(pid=84448) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 15:24:15 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7437447-9b04-4822-bdd9-fb4b77fdac3c]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:24:15 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-5816083b-e060-4918-8372-126dae23b681 tempest-VolumesSnapshotListTestJSON-511230180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.691ab62c-913c-424a-9b9f-71eee60bd4b1 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:24:15 devstack sudo[103470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.691ab62c-913c-424a-9b9f-71eee60bd4b1 Apr 29 15:24:15 devstack sudo[103470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:24:15 devstack sudo[103470]: pam_unix(sudo:session): session closed for user root Apr 29 15:24:15 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-5816083b-e060-4918-8372-126dae23b681 tempest-VolumesSnapshotListTestJSON-511230180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.691ab62c-913c-424a-9b9f-71eee60bd4b1" returned: 0 in 0.715s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:24:15 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-5816083b-e060-4918-8372-126dae23b681 tempest-VolumesSnapshotListTestJSON-511230180 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84448) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 15:24:15 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd6496c6-fcd3-4322-9a83-aac32744606b]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:24:15 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-5816083b-e060-4918-8372-126dae23b681 tempest-VolumesSnapshotListTestJSON-511230180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.bea47dcd-12eb-442a-9f4c-48cfa9db3370 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:24:15 devstack sudo[103486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.bea47dcd-12eb-442a-9f4c-48cfa9db3370 Apr 29 15:24:15 devstack sudo[103486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:24:16 devstack sudo[103486]: pam_unix(sudo:session): session closed for user root Apr 29 15:24:16 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-5816083b-e060-4918-8372-126dae23b681 tempest-VolumesSnapshotListTestJSON-511230180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.bea47dcd-12eb-442a-9f4c-48cfa9db3370" returned: 0 in 1.107s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:24:16 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-5816083b-e060-4918-8372-126dae23b681 tempest-VolumesSnapshotListTestJSON-511230180 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84448) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 15:24:16 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-5816083b-e060-4918-8372-126dae23b681 tempest-VolumesSnapshotListTestJSON-511230180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.691ab62c-913c-424a-9b9f-71eee60bd4b1 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:24:17 devstack sudo[103493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.691ab62c-913c-424a-9b9f-71eee60bd4b1 Apr 29 15:24:17 devstack sudo[103493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:24:18 devstack sudo[103493]: pam_unix(sudo:session): session closed for user root Apr 29 15:24:18 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-5816083b-e060-4918-8372-126dae23b681 tempest-VolumesSnapshotListTestJSON-511230180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.691ab62c-913c-424a-9b9f-71eee60bd4b1" returned: 0 in 1.592s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:24:18 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-5816083b-e060-4918-8372-126dae23b681 tempest-VolumesSnapshotListTestJSON-511230180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.691ab62c-913c-424a-9b9f-71eee60bd4b1 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:24:18 devstack sudo[103500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.691ab62c-913c-424a-9b9f-71eee60bd4b1 Apr 29 15:24:18 devstack sudo[103500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:24:19 devstack sudo[103500]: pam_unix(sudo:session): session closed for user root Apr 29 15:24:19 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-5816083b-e060-4918-8372-126dae23b681 tempest-VolumesSnapshotListTestJSON-511230180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.691ab62c-913c-424a-9b9f-71eee60bd4b1" returned: 0 in 1.187s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:24:19 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-5816083b-e060-4918-8372-126dae23b681 tempest-VolumesSnapshotListTestJSON-511230180 None] Lock "cinder-quobyte-691ab62c-913c-424a-9b9f-71eee60bd4b1" released by "_delete_snapshot" :: held 4.773s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:24:19 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-5816083b-e060-4918-8372-126dae23b681 tempest-VolumesSnapshotListTestJSON-511230180 None] Lock "cinder-quobyte-13098a57-c4c1-4e2e-bcce-6ac665f383c1" released by "delete_snapshot" :: held 4.814s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:24:19 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-5816083b-e060-4918-8372-126dae23b681 tempest-VolumesSnapshotListTestJSON-511230180 None] Created reservations ['d994f652-a8f5-4a0a-aca0-f859a8353ec8', '55530c8d-c4eb-4e0c-9814-b1a72f28a6ff', '85da16f2-550c-4888-80cb-7079ebd0d514', 'c88aaa3c-5b15-4e37-aee1-20d10a657d4f'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:24:20 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-5816083b-e060-4918-8372-126dae23b681 tempest-VolumesSnapshotListTestJSON-511230180 None] Delete snapshot completed successfully. Apr 29 15:24:20 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-5816083b-e060-4918-8372-126dae23b681 tempest-VolumesSnapshotListTestJSON-511230180 None] Lock "cinder-691ab62c-913c-424a-9b9f-71eee60bd4b1-delete_snapshot" released by "delete_snapshot" :: held 5.121s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:24:20 devstack sudo[103468]: pam_unix(sudo:session): session closed for user root Apr 29 15:24:20 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-9c84bf10-5e3c-4467-b8c9-459b8b2e6b17 tempest-VolumesDeleteCascade-398376463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-619e814d-be58-4683-a0f4-44f374d91e8a /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0bfad901-b84f-4e66-8e24-1ba0fb9a4c5b" returned: 0 in 5.316s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:24:20 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[205e9adc-b233-40b5-917c-02ba9a8b80ea]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:24:20 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-9c84bf10-5e3c-4467-b8c9-459b8b2e6b17 tempest-VolumesDeleteCascade-398376463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-619e814d-be58-4683-a0f4-44f374d91e8a {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:24:20 devstack sudo[103507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-619e814d-be58-4683-a0f4-44f374d91e8a Apr 29 15:24:20 devstack sudo[103507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:24:20 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-3afd45f0-177c-4c00-9251-b20ecfd9c516 tempest-VolumesSnapshotListTestJSON-511230180 None] Acquiring lock "cinder-bea47dcd-12eb-442a-9f4c-48cfa9db3370-delete_snapshot" by "delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:24:20 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-3afd45f0-177c-4c00-9251-b20ecfd9c516 tempest-VolumesSnapshotListTestJSON-511230180 None] Lock "cinder-bea47dcd-12eb-442a-9f4c-48cfa9db3370-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:24:20 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-3afd45f0-177c-4c00-9251-b20ecfd9c516 tempest-VolumesSnapshotListTestJSON-511230180 None] Acquiring lock "cinder-quobyte-13098a57-c4c1-4e2e-bcce-6ac665f383c1" by "delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:24:20 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-3afd45f0-177c-4c00-9251-b20ecfd9c516 tempest-VolumesSnapshotListTestJSON-511230180 None] Lock "cinder-quobyte-13098a57-c4c1-4e2e-bcce-6ac665f383c1" acquired by "delete_snapshot" :: waited 0.016s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:24:20 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-3afd45f0-177c-4c00-9251-b20ecfd9c516 tempest-VolumesSnapshotListTestJSON-511230180 None] Acquiring lock "cinder-quobyte-bea47dcd-12eb-442a-9f4c-48cfa9db3370" by "_delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:24:20 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-3afd45f0-177c-4c00-9251-b20ecfd9c516 tempest-VolumesSnapshotListTestJSON-511230180 None] Lock "cinder-quobyte-bea47dcd-12eb-442a-9f4c-48cfa9db3370" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:24:20 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-3afd45f0-177c-4c00-9251-b20ecfd9c516 tempest-VolumesSnapshotListTestJSON-511230180 None] Deleting offline snapshot bea47dcd-12eb-442a-9f4c-48cfa9db3370 of volume 13098a57-c4c1-4e2e-bcce-6ac665f383c1 {{(pid=84448) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 15:24:20 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-3afd45f0-177c-4c00-9251-b20ecfd9c516 tempest-VolumesSnapshotListTestJSON-511230180 None] snapshot_file for this snap is: volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.bea47dcd-12eb-442a-9f4c-48cfa9db3370 {{(pid=84448) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 15:24:20 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f6f712-ff79-448e-a423-45de64195980]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:24:20 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-3afd45f0-177c-4c00-9251-b20ecfd9c516 tempest-VolumesSnapshotListTestJSON-511230180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.bea47dcd-12eb-442a-9f4c-48cfa9db3370 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:24:20 devstack sudo[103509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.bea47dcd-12eb-442a-9f4c-48cfa9db3370 Apr 29 15:24:20 devstack sudo[103509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:24:21 devstack sudo[103507]: pam_unix(sudo:session): session closed for user root Apr 29 15:24:21 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-9c84bf10-5e3c-4467-b8c9-459b8b2e6b17 tempest-VolumesDeleteCascade-398376463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-619e814d-be58-4683-a0f4-44f374d91e8a" returned: 0 in 0.959s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:24:21 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [None req-9c84bf10-5e3c-4467-b8c9-459b8b2e6b17 tempest-VolumesDeleteCascade-398376463 None] Image conversion details: src /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-619e814d-be58-4683-a0f4-44f374d91e8a, size 1024.00 MB, duration 5.32 sec, destination /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0bfad901-b84f-4e66-8e24-1ba0fb9a4c5b {{(pid=84448) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 15:24:21 devstack cinder-volume[84448]: INFO cinder.image.image_utils [None req-9c84bf10-5e3c-4467-b8c9-459b8b2e6b17 tempest-VolumesDeleteCascade-398376463 None] Converted 1024.00 MB image at 192.61 MB/s Apr 29 15:24:21 devstack cinder-volume[84448]: WARNING cinder.volume.drivers.remotefs [None req-9c84bf10-5e3c-4467-b8c9-459b8b2e6b17 tempest-VolumesDeleteCascade-398376463 None] /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0bfad901-b84f-4e66-8e24-1ba0fb9a4c5b is being set with open permissions: ugo+rw Apr 29 15:24:21 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-9c84bf10-5e3c-4467-b8c9-459b8b2e6b17 tempest-VolumesDeleteCascade-398376463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0bfad901-b84f-4e66-8e24-1ba0fb9a4c5b {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:24:21 devstack sudo[103509]: pam_unix(sudo:session): session closed for user root Apr 29 15:24:21 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-3afd45f0-177c-4c00-9251-b20ecfd9c516 tempest-VolumesSnapshotListTestJSON-511230180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.bea47dcd-12eb-442a-9f4c-48cfa9db3370" returned: 0 in 0.753s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:24:21 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-3afd45f0-177c-4c00-9251-b20ecfd9c516 tempest-VolumesSnapshotListTestJSON-511230180 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84448) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 15:24:21 devstack sudo[103517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0bfad901-b84f-4e66-8e24-1ba0fb9a4c5b Apr 29 15:24:21 devstack sudo[103517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:24:21 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[affc924d-be67-4112-bc80-40ffe05854f3]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:24:21 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-3afd45f0-177c-4c00-9251-b20ecfd9c516 tempest-VolumesSnapshotListTestJSON-511230180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.29277b97-2cf4-40a7-a4b3-a17da0e8f7cd {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:24:21 devstack sudo[103519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.29277b97-2cf4-40a7-a4b3-a17da0e8f7cd Apr 29 15:24:21 devstack sudo[103519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:24:21 devstack sudo[103517]: pam_unix(sudo:session): session closed for user root Apr 29 15:24:21 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-9c84bf10-5e3c-4467-b8c9-459b8b2e6b17 tempest-VolumesDeleteCascade-398376463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0bfad901-b84f-4e66-8e24-1ba0fb9a4c5b" returned: 0 in 0.672s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:24:21 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-9c84bf10-5e3c-4467-b8c9-459b8b2e6b17 tempest-VolumesDeleteCascade-398376463 None] Lock "cinder-quobyte-0bfad901-b84f-4e66-8e24-1ba0fb9a4c5b" released by "_copy_volume_from_snapshot" :: held 8.557s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:24:21 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-9c84bf10-5e3c-4467-b8c9-459b8b2e6b17 tempest-VolumesDeleteCascade-398376463 None] Lock "cinder-quobyte-3ac39fb1-a671-4f6f-8695-d6736c1d27b5-0bfad901-b84f-4e66-8e24-1ba0fb9a4c5b" released by "_create_volume_from_snapshot" :: held 8.594s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:24:21 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-9c84bf10-5e3c-4467-b8c9-459b8b2e6b17 tempest-VolumesDeleteCascade-398376463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.622s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:24:21 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-9c84bf10-5e3c-4467-b8c9-459b8b2e6b17 tempest-VolumesDeleteCascade-398376463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c78841e4-68e5-481c-ae36-e5e9ceef6fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bfad901-b84f-4e66-8e24-1ba0fb9a4c5b', 'volume_size': 1, 'snapshot_id': '3ac39fb1-a671-4f6f-8695-d6736c1d27b5'}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:24:21 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-9c84bf10-5e3c-4467-b8c9-459b8b2e6b17 tempest-VolumesDeleteCascade-398376463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (644bb4a8-b62c-478d-b51f-bc6c8f3d3839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:24:21 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-9c84bf10-5e3c-4467-b8c9-459b8b2e6b17 tempest-VolumesDeleteCascade-398376463 None] Volume volume-0bfad901-b84f-4e66-8e24-1ba0fb9a4c5b (0bfad901-b84f-4e66-8e24-1ba0fb9a4c5b): created successfully Apr 29 15:24:21 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-9c84bf10-5e3c-4467-b8c9-459b8b2e6b17 tempest-VolumesDeleteCascade-398376463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (644bb4a8-b62c-478d-b51f-bc6c8f3d3839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:24:22 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-9c84bf10-5e3c-4467-b8c9-459b8b2e6b17 tempest-VolumesDeleteCascade-398376463 None] Flow 'volume_create_manager' (85e528f4-1e60-41f5-9d2d-b38c040dc30f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:24:22 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-9c84bf10-5e3c-4467-b8c9-459b8b2e6b17 tempest-VolumesDeleteCascade-398376463 None] Created volume successfully. Apr 29 15:24:22 devstack sudo[103519]: pam_unix(sudo:session): session closed for user root Apr 29 15:24:22 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-3afd45f0-177c-4c00-9251-b20ecfd9c516 tempest-VolumesSnapshotListTestJSON-511230180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.29277b97-2cf4-40a7-a4b3-a17da0e8f7cd" returned: 0 in 0.744s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:24:22 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-3afd45f0-177c-4c00-9251-b20ecfd9c516 tempest-VolumesSnapshotListTestJSON-511230180 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84448) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 15:24:22 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-3afd45f0-177c-4c00-9251-b20ecfd9c516 tempest-VolumesSnapshotListTestJSON-511230180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.bea47dcd-12eb-442a-9f4c-48cfa9db3370 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:24:22 devstack sudo[103525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.bea47dcd-12eb-442a-9f4c-48cfa9db3370 Apr 29 15:24:22 devstack sudo[103525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:24:22 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-13265eca-92a4-40e0-a4a7-f9246c910a34 tempest-VolumesDeleteCascade-398376463 None] Acquiring lock "cinder-619e814d-be58-4683-a0f4-44f374d91e8a-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:24:22 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-13265eca-92a4-40e0-a4a7-f9246c910a34 tempest-VolumesDeleteCascade-398376463 None] Lock "cinder-619e814d-be58-4683-a0f4-44f374d91e8a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:24:22 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-13265eca-92a4-40e0-a4a7-f9246c910a34 tempest-VolumesDeleteCascade-398376463 None] Performing cascade delete. {{(pid=84448) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 29 15:24:22 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-13265eca-92a4-40e0-a4a7-f9246c910a34 tempest-VolumesDeleteCascade-398376463 None] Acquiring lock "cinder-3ac39fb1-a671-4f6f-8695-d6736c1d27b5-delete_snapshot" by "delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:24:22 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-13265eca-92a4-40e0-a4a7-f9246c910a34 tempest-VolumesDeleteCascade-398376463 None] Lock "cinder-3ac39fb1-a671-4f6f-8695-d6736c1d27b5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:24:22 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-13265eca-92a4-40e0-a4a7-f9246c910a34 tempest-VolumesDeleteCascade-398376463 None] Acquiring lock "cinder-quobyte-619e814d-be58-4683-a0f4-44f374d91e8a" by "delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:24:22 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-13265eca-92a4-40e0-a4a7-f9246c910a34 tempest-VolumesDeleteCascade-398376463 None] Lock "cinder-quobyte-619e814d-be58-4683-a0f4-44f374d91e8a" acquired by "delete_snapshot" :: waited 0.016s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:24:22 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-13265eca-92a4-40e0-a4a7-f9246c910a34 tempest-VolumesDeleteCascade-398376463 None] Acquiring lock "cinder-quobyte-3ac39fb1-a671-4f6f-8695-d6736c1d27b5" by "_delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:24:22 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-13265eca-92a4-40e0-a4a7-f9246c910a34 tempest-VolumesDeleteCascade-398376463 None] Lock "cinder-quobyte-3ac39fb1-a671-4f6f-8695-d6736c1d27b5" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:24:22 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-13265eca-92a4-40e0-a4a7-f9246c910a34 tempest-VolumesDeleteCascade-398376463 None] Deleting offline snapshot 3ac39fb1-a671-4f6f-8695-d6736c1d27b5 of volume 619e814d-be58-4683-a0f4-44f374d91e8a {{(pid=84448) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 15:24:22 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-13265eca-92a4-40e0-a4a7-f9246c910a34 tempest-VolumesDeleteCascade-398376463 None] snapshot_file for this snap is: volume-619e814d-be58-4683-a0f4-44f374d91e8a.3ac39fb1-a671-4f6f-8695-d6736c1d27b5 {{(pid=84448) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 15:24:22 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e05370c-135b-4cfb-9c26-05cea196bb0f]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:24:22 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-13265eca-92a4-40e0-a4a7-f9246c910a34 tempest-VolumesDeleteCascade-398376463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-619e814d-be58-4683-a0f4-44f374d91e8a.3ac39fb1-a671-4f6f-8695-d6736c1d27b5 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:24:22 devstack sudo[103530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-619e814d-be58-4683-a0f4-44f374d91e8a.3ac39fb1-a671-4f6f-8695-d6736c1d27b5 Apr 29 15:24:22 devstack sudo[103530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:24:22 devstack sudo[103525]: pam_unix(sudo:session): session closed for user root Apr 29 15:24:22 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-3afd45f0-177c-4c00-9251-b20ecfd9c516 tempest-VolumesSnapshotListTestJSON-511230180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.bea47dcd-12eb-442a-9f4c-48cfa9db3370" returned: 0 in 0.811s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:24:22 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-3afd45f0-177c-4c00-9251-b20ecfd9c516 tempest-VolumesSnapshotListTestJSON-511230180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.bea47dcd-12eb-442a-9f4c-48cfa9db3370 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:24:22 devstack sudo[103532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.bea47dcd-12eb-442a-9f4c-48cfa9db3370 Apr 29 15:24:22 devstack sudo[103532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:24:23 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-ea461c78-b26d-4626-82e0-42bd8d4d7743 req-97737a31-b324-44d8-8ee1-234a3c0e62d3 tempest-TestStampPattern-538910304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:24:23 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-ea461c78-b26d-4626-82e0-42bd8d4d7743 req-97737a31-b324-44d8-8ee1-234a3c0e62d3 tempest-TestStampPattern-538910304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:24:23 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7812079-bd96-4c53-a971-e1fe82af0963]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:24:23 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-ea461c78-b26d-4626-82e0-42bd8d4d7743 req-97737a31-b324-44d8-8ee1-234a3c0e62d3 tempest-TestStampPattern-538910304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2f8608b3-7b48-4cd7-b080-07172ef4409b {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:24:23 devstack sudo[103542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2f8608b3-7b48-4cd7-b080-07172ef4409b Apr 29 15:24:23 devstack sudo[103542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:24:23 devstack sudo[103532]: pam_unix(sudo:session): session closed for user root Apr 29 15:24:23 devstack sudo[103530]: pam_unix(sudo:session): session closed for user root Apr 29 15:24:23 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-13265eca-92a4-40e0-a4a7-f9246c910a34 tempest-VolumesDeleteCascade-398376463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-619e814d-be58-4683-a0f4-44f374d91e8a.3ac39fb1-a671-4f6f-8695-d6736c1d27b5" returned: 0 in 0.789s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:24:23 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-13265eca-92a4-40e0-a4a7-f9246c910a34 tempest-VolumesDeleteCascade-398376463 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-619e814d-be58-4683-a0f4-44f374d91e8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84448) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 15:24:23 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-3afd45f0-177c-4c00-9251-b20ecfd9c516 tempest-VolumesSnapshotListTestJSON-511230180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.bea47dcd-12eb-442a-9f4c-48cfa9db3370" returned: 0 in 0.647s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:24:23 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5aca14e-1b7e-4615-bffb-8b53d1ffb6a4]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:24:23 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-13265eca-92a4-40e0-a4a7-f9246c910a34 tempest-VolumesDeleteCascade-398376463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-619e814d-be58-4683-a0f4-44f374d91e8a {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:24:23 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-3afd45f0-177c-4c00-9251-b20ecfd9c516 tempest-VolumesSnapshotListTestJSON-511230180 None] Lock "cinder-quobyte-bea47dcd-12eb-442a-9f4c-48cfa9db3370" released by "_delete_snapshot" :: held 3.077s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:24:23 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-3afd45f0-177c-4c00-9251-b20ecfd9c516 tempest-VolumesSnapshotListTestJSON-511230180 None] Lock "cinder-quobyte-13098a57-c4c1-4e2e-bcce-6ac665f383c1" released by "delete_snapshot" :: held 3.105s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:24:23 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-3afd45f0-177c-4c00-9251-b20ecfd9c516 tempest-VolumesSnapshotListTestJSON-511230180 None] Created reservations ['54cc1022-874e-477d-b181-758c8e00211a', '829a2ace-125d-4aa8-8814-674c4f2b532a', 'a9aeaea9-71b4-44a5-9b15-2aa0d7cb1521', '189d2e35-5f0e-4a11-8155-0a3e68d21b73'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:24:23 devstack sudo[103548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-619e814d-be58-4683-a0f4-44f374d91e8a Apr 29 15:24:23 devstack sudo[103548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:24:23 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-3afd45f0-177c-4c00-9251-b20ecfd9c516 tempest-VolumesSnapshotListTestJSON-511230180 None] Delete snapshot completed successfully. Apr 29 15:24:23 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-3afd45f0-177c-4c00-9251-b20ecfd9c516 tempest-VolumesSnapshotListTestJSON-511230180 None] Lock "cinder-bea47dcd-12eb-442a-9f4c-48cfa9db3370-delete_snapshot" released by "delete_snapshot" :: held 3.255s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:24:23 devstack sudo[103542]: pam_unix(sudo:session): session closed for user root Apr 29 15:24:23 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-ea461c78-b26d-4626-82e0-42bd8d4d7743 req-97737a31-b324-44d8-8ee1-234a3c0e62d3 tempest-TestStampPattern-538910304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2f8608b3-7b48-4cd7-b080-07172ef4409b" returned: 0 in 0.801s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:24:23 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-ea461c78-b26d-4626-82e0-42bd8d4d7743 req-97737a31-b324-44d8-8ee1-234a3c0e62d3 tempest-TestStampPattern-538910304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.820s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:24:24 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-ea461c78-b26d-4626-82e0-42bd8d4d7743 req-97737a31-b324-44d8-8ee1-234a3c0e62d3 tempest-TestStampPattern-538910304 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a', 'name': 'volume-2f8608b3-7b48-4cd7-b080-07172ef4409b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a50aec17-ad16-4853-a528-58f0c574daa9', 'enforce_multipath': True} {{(pid=84448) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 15:24:24 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-ea461c78-b26d-4626-82e0-42bd8d4d7743 req-97737a31-b324-44d8-8ee1-234a3c0e62d3 tempest-TestStampPattern-538910304 None] attachment_update completed successfully. Apr 29 15:24:24 devstack sudo[103548]: pam_unix(sudo:session): session closed for user root Apr 29 15:24:24 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-13265eca-92a4-40e0-a4a7-f9246c910a34 tempest-VolumesDeleteCascade-398376463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-619e814d-be58-4683-a0f4-44f374d91e8a" returned: 0 in 0.726s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:24:24 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-13265eca-92a4-40e0-a4a7-f9246c910a34 tempest-VolumesDeleteCascade-398376463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-619e814d-be58-4683-a0f4-44f374d91e8a.3ac39fb1-a671-4f6f-8695-d6736c1d27b5 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:24:24 devstack sudo[103580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-619e814d-be58-4683-a0f4-44f374d91e8a.3ac39fb1-a671-4f6f-8695-d6736c1d27b5 Apr 29 15:24:24 devstack sudo[103580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:24:24 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-f2675128-1fff-46e2-a266-90278c86c8b7 tempest-VolumesSnapshotListTestJSON-511230180 None] Acquiring lock "cinder-29277b97-2cf4-40a7-a4b3-a17da0e8f7cd-delete_snapshot" by "delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:24:24 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-f2675128-1fff-46e2-a266-90278c86c8b7 tempest-VolumesSnapshotListTestJSON-511230180 None] Lock "cinder-29277b97-2cf4-40a7-a4b3-a17da0e8f7cd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:24:24 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-f2675128-1fff-46e2-a266-90278c86c8b7 tempest-VolumesSnapshotListTestJSON-511230180 None] Acquiring lock "cinder-quobyte-13098a57-c4c1-4e2e-bcce-6ac665f383c1" by "delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:24:24 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-f2675128-1fff-46e2-a266-90278c86c8b7 tempest-VolumesSnapshotListTestJSON-511230180 None] Lock "cinder-quobyte-13098a57-c4c1-4e2e-bcce-6ac665f383c1" acquired by "delete_snapshot" :: waited 0.021s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:24:24 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-f2675128-1fff-46e2-a266-90278c86c8b7 tempest-VolumesSnapshotListTestJSON-511230180 None] Acquiring lock "cinder-quobyte-29277b97-2cf4-40a7-a4b3-a17da0e8f7cd" by "_delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:24:24 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-f2675128-1fff-46e2-a266-90278c86c8b7 tempest-VolumesSnapshotListTestJSON-511230180 None] Lock "cinder-quobyte-29277b97-2cf4-40a7-a4b3-a17da0e8f7cd" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:24:24 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-f2675128-1fff-46e2-a266-90278c86c8b7 tempest-VolumesSnapshotListTestJSON-511230180 None] Deleting offline snapshot 29277b97-2cf4-40a7-a4b3-a17da0e8f7cd of volume 13098a57-c4c1-4e2e-bcce-6ac665f383c1 {{(pid=84448) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 15:24:24 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-f2675128-1fff-46e2-a266-90278c86c8b7 tempest-VolumesSnapshotListTestJSON-511230180 None] snapshot_file for this snap is: volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.29277b97-2cf4-40a7-a4b3-a17da0e8f7cd {{(pid=84448) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 15:24:24 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[887abbba-a220-43b2-be95-d46e24a1b4c6]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:24:24 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f2675128-1fff-46e2-a266-90278c86c8b7 tempest-VolumesSnapshotListTestJSON-511230180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.29277b97-2cf4-40a7-a4b3-a17da0e8f7cd {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:24:24 devstack sudo[103627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.29277b97-2cf4-40a7-a4b3-a17da0e8f7cd Apr 29 15:24:24 devstack sudo[103627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:24:25 devstack sudo[103580]: pam_unix(sudo:session): session closed for user root Apr 29 15:24:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-13265eca-92a4-40e0-a4a7-f9246c910a34 tempest-VolumesDeleteCascade-398376463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-619e814d-be58-4683-a0f4-44f374d91e8a.3ac39fb1-a671-4f6f-8695-d6736c1d27b5" returned: 0 in 0.757s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:24:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-13265eca-92a4-40e0-a4a7-f9246c910a34 tempest-VolumesDeleteCascade-398376463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-619e814d-be58-4683-a0f4-44f374d91e8a.3ac39fb1-a671-4f6f-8695-d6736c1d27b5 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:24:25 devstack sudo[103948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-619e814d-be58-4683-a0f4-44f374d91e8a.3ac39fb1-a671-4f6f-8695-d6736c1d27b5 Apr 29 15:24:25 devstack sudo[103948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:24:25 devstack sudo[103627]: pam_unix(sudo:session): session closed for user root Apr 29 15:24:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f2675128-1fff-46e2-a266-90278c86c8b7 tempest-VolumesSnapshotListTestJSON-511230180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.29277b97-2cf4-40a7-a4b3-a17da0e8f7cd" returned: 0 in 0.734s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:24:25 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-f2675128-1fff-46e2-a266-90278c86c8b7 tempest-VolumesSnapshotListTestJSON-511230180 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84448) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 15:24:25 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b294f2-a852-48a8-8f8c-715e0107e615]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:24:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f2675128-1fff-46e2-a266-90278c86c8b7 tempest-VolumesSnapshotListTestJSON-511230180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:24:25 devstack sudo[103948]: pam_unix(sudo:session): session closed for user root Apr 29 15:24:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-13265eca-92a4-40e0-a4a7-f9246c910a34 tempest-VolumesDeleteCascade-398376463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-619e814d-be58-4683-a0f4-44f374d91e8a.3ac39fb1-a671-4f6f-8695-d6736c1d27b5" returned: 0 in 0.611s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:24:25 devstack sudo[103954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1 Apr 29 15:24:25 devstack sudo[103954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:24:25 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-13265eca-92a4-40e0-a4a7-f9246c910a34 tempest-VolumesDeleteCascade-398376463 None] Lock "cinder-quobyte-3ac39fb1-a671-4f6f-8695-d6736c1d27b5" released by "_delete_snapshot" :: held 2.990s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:24:25 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-13265eca-92a4-40e0-a4a7-f9246c910a34 tempest-VolumesDeleteCascade-398376463 None] Lock "cinder-quobyte-619e814d-be58-4683-a0f4-44f374d91e8a" released by "delete_snapshot" :: held 3.015s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:24:25 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-13265eca-92a4-40e0-a4a7-f9246c910a34 tempest-VolumesDeleteCascade-398376463 None] Created reservations ['8515fcbf-486d-4fed-b36a-b757ab43bfdb', '70c73c54-b426-4dec-ab4c-a83d7feff6d0', 'df9d3437-2bdd-4344-a4c6-01a7183dcff4', 'fd24c71d-4112-4e58-b260-88c290f71c0a'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:24:25 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-13265eca-92a4-40e0-a4a7-f9246c910a34 tempest-VolumesDeleteCascade-398376463 None] Delete snapshot completed successfully. Apr 29 15:24:25 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-13265eca-92a4-40e0-a4a7-f9246c910a34 tempest-VolumesDeleteCascade-398376463 None] Lock "cinder-3ac39fb1-a671-4f6f-8695-d6736c1d27b5-delete_snapshot" released by "delete_snapshot" :: held 3.176s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:24:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-13265eca-92a4-40e0-a4a7-f9246c910a34 tempest-VolumesDeleteCascade-398376463 None] Snapshots deleted, issuing volume delete {{(pid=84448) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 29 15:24:25 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-13265eca-92a4-40e0-a4a7-f9246c910a34 tempest-VolumesDeleteCascade-398376463 None] Acquiring lock "cinder-quobyte-619e814d-be58-4683-a0f4-44f374d91e8a" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:24:25 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-13265eca-92a4-40e0-a4a7-f9246c910a34 tempest-VolumesDeleteCascade-398376463 None] Lock "cinder-quobyte-619e814d-be58-4683-a0f4-44f374d91e8a" acquired by "delete_volume" :: waited 0.013s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:24:25 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5df8a1-8a3f-4fd6-975f-0d3e4dc50370]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:24:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-13265eca-92a4-40e0-a4a7-f9246c910a34 tempest-VolumesDeleteCascade-398376463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-619e814d-be58-4683-a0f4-44f374d91e8a {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:24:25 devstack sudo[103957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-619e814d-be58-4683-a0f4-44f374d91e8a Apr 29 15:24:25 devstack sudo[103957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:24:26 devstack sudo[103954]: pam_unix(sudo:session): session closed for user root Apr 29 15:24:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f2675128-1fff-46e2-a266-90278c86c8b7 tempest-VolumesSnapshotListTestJSON-511230180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1" returned: 0 in 0.728s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:24:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f2675128-1fff-46e2-a266-90278c86c8b7 tempest-VolumesSnapshotListTestJSON-511230180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.29277b97-2cf4-40a7-a4b3-a17da0e8f7cd {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:24:26 devstack sudo[103962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.29277b97-2cf4-40a7-a4b3-a17da0e8f7cd Apr 29 15:24:26 devstack sudo[103962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:24:26 devstack sudo[103957]: pam_unix(sudo:session): session closed for user root Apr 29 15:24:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-13265eca-92a4-40e0-a4a7-f9246c910a34 tempest-VolumesDeleteCascade-398376463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-619e814d-be58-4683-a0f4-44f374d91e8a" returned: 0 in 0.730s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:24:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-13265eca-92a4-40e0-a4a7-f9246c910a34 tempest-VolumesDeleteCascade-398376463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-619e814d-be58-4683-a0f4-44f374d91e8a {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:24:26 devstack sudo[103967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-619e814d-be58-4683-a0f4-44f374d91e8a Apr 29 15:24:26 devstack sudo[103967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:24:26 devstack sudo[103962]: pam_unix(sudo:session): session closed for user root Apr 29 15:24:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f2675128-1fff-46e2-a266-90278c86c8b7 tempest-VolumesSnapshotListTestJSON-511230180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.29277b97-2cf4-40a7-a4b3-a17da0e8f7cd" returned: 0 in 0.699s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:24:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f2675128-1fff-46e2-a266-90278c86c8b7 tempest-VolumesSnapshotListTestJSON-511230180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.29277b97-2cf4-40a7-a4b3-a17da0e8f7cd {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:24:26 devstack sudo[103972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.29277b97-2cf4-40a7-a4b3-a17da0e8f7cd Apr 29 15:24:26 devstack sudo[103972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:24:27 devstack sudo[103967]: pam_unix(sudo:session): session closed for user root Apr 29 15:24:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-13265eca-92a4-40e0-a4a7-f9246c910a34 tempest-VolumesDeleteCascade-398376463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-619e814d-be58-4683-a0f4-44f374d91e8a" returned: 0 in 0.639s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:24:27 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-13265eca-92a4-40e0-a4a7-f9246c910a34 tempest-VolumesDeleteCascade-398376463 None] Lock "cinder-quobyte-619e814d-be58-4683-a0f4-44f374d91e8a" released by "delete_volume" :: held 1.430s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:24:27 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-13265eca-92a4-40e0-a4a7-f9246c910a34 tempest-VolumesDeleteCascade-398376463 None] Created reservations ['8012e31d-63dd-49bc-ada9-f4250b3db151', 'caa93164-ada0-4954-a768-c6d8edc3cc96', '48403d69-754b-4e6a-b2ba-2160cfec17a8', '63dc9cde-2368-415f-bd7f-1f949dca9e44'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:24:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-13265eca-92a4-40e0-a4a7-f9246c910a34 tempest-VolumesDeleteCascade-398376463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:24:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-13265eca-92a4-40e0-a4a7-f9246c910a34 tempest-VolumesDeleteCascade-398376463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:24:27 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-13265eca-92a4-40e0-a4a7-f9246c910a34 tempest-VolumesDeleteCascade-398376463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:24:27 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-13265eca-92a4-40e0-a4a7-f9246c910a34 tempest-VolumesDeleteCascade-398376463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:24:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-13265eca-92a4-40e0-a4a7-f9246c910a34 tempest-VolumesDeleteCascade-398376463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:24:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-13265eca-92a4-40e0-a4a7-f9246c910a34 tempest-VolumesDeleteCascade-398376463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:24:27 devstack sudo[103975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:24:27 devstack sudo[103975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:24:27 devstack sudo[103972]: pam_unix(sudo:session): session closed for user root Apr 29 15:24:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f2675128-1fff-46e2-a266-90278c86c8b7 tempest-VolumesSnapshotListTestJSON-511230180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1.29277b97-2cf4-40a7-a4b3-a17da0e8f7cd" returned: 0 in 0.620s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:24:27 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-f2675128-1fff-46e2-a266-90278c86c8b7 tempest-VolumesSnapshotListTestJSON-511230180 None] Lock "cinder-quobyte-29277b97-2cf4-40a7-a4b3-a17da0e8f7cd" released by "_delete_snapshot" :: held 2.899s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:24:27 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-f2675128-1fff-46e2-a266-90278c86c8b7 tempest-VolumesSnapshotListTestJSON-511230180 None] Lock "cinder-quobyte-13098a57-c4c1-4e2e-bcce-6ac665f383c1" released by "delete_snapshot" :: held 2.928s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:24:27 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-f2675128-1fff-46e2-a266-90278c86c8b7 tempest-VolumesSnapshotListTestJSON-511230180 None] Created reservations ['8e310170-3422-40e0-815b-b92c0812a1fa', '20c60915-c5b2-4d6d-a4e5-3cd324c4c2d1', '9a67b6d6-fea2-4e08-a205-8065a6fad2b7', '2e81bec6-26cd-41e4-b921-c02db24db50c'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:24:27 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-f2675128-1fff-46e2-a266-90278c86c8b7 tempest-VolumesSnapshotListTestJSON-511230180 None] Delete snapshot completed successfully. Apr 29 15:24:27 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-f2675128-1fff-46e2-a266-90278c86c8b7 tempest-VolumesSnapshotListTestJSON-511230180 None] Lock "cinder-29277b97-2cf4-40a7-a4b3-a17da0e8f7cd-delete_snapshot" released by "delete_snapshot" :: held 3.118s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:24:27 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a7ff66f9-b3fc-49ba-a901-00eab7b40f43 tempest-VolumesSnapshotListTestJSON-511230180 None] Acquiring lock "cinder-13098a57-c4c1-4e2e-bcce-6ac665f383c1-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:24:27 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a7ff66f9-b3fc-49ba-a901-00eab7b40f43 tempest-VolumesSnapshotListTestJSON-511230180 None] Lock "cinder-13098a57-c4c1-4e2e-bcce-6ac665f383c1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:24:28 devstack sudo[103975]: pam_unix(sudo:session): session closed for user root Apr 29 15:24:28 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a7ff66f9-b3fc-49ba-a901-00eab7b40f43 tempest-VolumesSnapshotListTestJSON-511230180 None] Acquiring lock "cinder-quobyte-13098a57-c4c1-4e2e-bcce-6ac665f383c1" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:24:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-13265eca-92a4-40e0-a4a7-f9246c910a34 tempest-VolumesDeleteCascade-398376463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.655s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:24:28 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-13265eca-92a4-40e0-a4a7-f9246c910a34 tempest-VolumesDeleteCascade-398376463 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:24:28 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-13265eca-92a4-40e0-a4a7-f9246c910a34 tempest-VolumesDeleteCascade-398376463 None] Deleted volume successfully. Apr 29 15:24:28 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a7ff66f9-b3fc-49ba-a901-00eab7b40f43 tempest-VolumesSnapshotListTestJSON-511230180 None] Lock "cinder-quobyte-13098a57-c4c1-4e2e-bcce-6ac665f383c1" acquired by "delete_volume" :: waited 0.026s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:24:28 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-13265eca-92a4-40e0-a4a7-f9246c910a34 tempest-VolumesDeleteCascade-398376463 None] Lock "cinder-619e814d-be58-4683-a0f4-44f374d91e8a-delete_volume" released by "delete_volume" :: held 5.549s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:24:28 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d8e222f-9d94-4373-9c9a-a8a1d72d414b]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:24:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a7ff66f9-b3fc-49ba-a901-00eab7b40f43 tempest-VolumesSnapshotListTestJSON-511230180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:24:28 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-f583d144-ad31-421c-8cf3-42ef43d1127b tempest-VolumesDeleteCascade-398376463 None] Acquiring lock "cinder-0bfad901-b84f-4e66-8e24-1ba0fb9a4c5b-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:24:28 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-f583d144-ad31-421c-8cf3-42ef43d1127b tempest-VolumesDeleteCascade-398376463 None] Lock "cinder-0bfad901-b84f-4e66-8e24-1ba0fb9a4c5b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:24:28 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-f583d144-ad31-421c-8cf3-42ef43d1127b tempest-VolumesDeleteCascade-398376463 None] Acquiring lock "cinder-quobyte-0bfad901-b84f-4e66-8e24-1ba0fb9a4c5b" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:24:28 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-f583d144-ad31-421c-8cf3-42ef43d1127b tempest-VolumesDeleteCascade-398376463 None] Lock "cinder-quobyte-0bfad901-b84f-4e66-8e24-1ba0fb9a4c5b" acquired by "delete_volume" :: waited 0.014s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:24:28 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c577a88-0d21-4625-bc54-e657fef4ecdf]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:24:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f583d144-ad31-421c-8cf3-42ef43d1127b tempest-VolumesDeleteCascade-398376463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0bfad901-b84f-4e66-8e24-1ba0fb9a4c5b {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:24:28 devstack sudo[103979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1 Apr 29 15:24:28 devstack sudo[103979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:24:28 devstack sudo[103984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0bfad901-b84f-4e66-8e24-1ba0fb9a4c5b Apr 29 15:24:28 devstack sudo[103984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:24:28 devstack sudo[103979]: pam_unix(sudo:session): session closed for user root Apr 29 15:24:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a7ff66f9-b3fc-49ba-a901-00eab7b40f43 tempest-VolumesSnapshotListTestJSON-511230180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1" returned: 0 in 0.787s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:24:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a7ff66f9-b3fc-49ba-a901-00eab7b40f43 tempest-VolumesSnapshotListTestJSON-511230180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:24:28 devstack sudo[103999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1 Apr 29 15:24:28 devstack sudo[103999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:24:28 devstack sudo[103984]: pam_unix(sudo:session): session closed for user root Apr 29 15:24:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f583d144-ad31-421c-8cf3-42ef43d1127b tempest-VolumesDeleteCascade-398376463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0bfad901-b84f-4e66-8e24-1ba0fb9a4c5b" returned: 0 in 0.729s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:24:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f583d144-ad31-421c-8cf3-42ef43d1127b tempest-VolumesDeleteCascade-398376463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0bfad901-b84f-4e66-8e24-1ba0fb9a4c5b {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:24:29 devstack sudo[104001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0bfad901-b84f-4e66-8e24-1ba0fb9a4c5b Apr 29 15:24:29 devstack sudo[104001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:24:29 devstack sudo[103999]: pam_unix(sudo:session): session closed for user root Apr 29 15:24:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a7ff66f9-b3fc-49ba-a901-00eab7b40f43 tempest-VolumesSnapshotListTestJSON-511230180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13098a57-c4c1-4e2e-bcce-6ac665f383c1" returned: 0 in 0.625s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:24:29 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a7ff66f9-b3fc-49ba-a901-00eab7b40f43 tempest-VolumesSnapshotListTestJSON-511230180 None] Lock "cinder-quobyte-13098a57-c4c1-4e2e-bcce-6ac665f383c1" released by "delete_volume" :: held 1.499s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:24:29 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-a7ff66f9-b3fc-49ba-a901-00eab7b40f43 tempest-VolumesSnapshotListTestJSON-511230180 None] Created reservations ['f2f96638-eefd-41f3-b526-8c1e6b74d46b', '6e0549b0-2c1a-4010-a26d-e560ffbb0164', 'db60daca-4204-4526-abf3-4d5e610f7f20', 'aeee0b37-3e88-4251-913e-166cdda81c0b'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:24:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-a7ff66f9-b3fc-49ba-a901-00eab7b40f43 tempest-VolumesSnapshotListTestJSON-511230180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:24:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-a7ff66f9-b3fc-49ba-a901-00eab7b40f43 tempest-VolumesSnapshotListTestJSON-511230180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:24:29 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-a7ff66f9-b3fc-49ba-a901-00eab7b40f43 tempest-VolumesSnapshotListTestJSON-511230180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:24:29 devstack sudo[104001]: pam_unix(sudo:session): session closed for user root Apr 29 15:24:29 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-a7ff66f9-b3fc-49ba-a901-00eab7b40f43 tempest-VolumesSnapshotListTestJSON-511230180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:24:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-a7ff66f9-b3fc-49ba-a901-00eab7b40f43 tempest-VolumesSnapshotListTestJSON-511230180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:24:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a7ff66f9-b3fc-49ba-a901-00eab7b40f43 tempest-VolumesSnapshotListTestJSON-511230180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:24:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f583d144-ad31-421c-8cf3-42ef43d1127b tempest-VolumesDeleteCascade-398376463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-0bfad901-b84f-4e66-8e24-1ba0fb9a4c5b" returned: 0 in 0.688s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:24:29 devstack sudo[104005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:24:29 devstack sudo[104005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:24:29 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-f583d144-ad31-421c-8cf3-42ef43d1127b tempest-VolumesDeleteCascade-398376463 None] Lock "cinder-quobyte-0bfad901-b84f-4e66-8e24-1ba0fb9a4c5b" released by "delete_volume" :: held 1.462s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:24:29 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-f583d144-ad31-421c-8cf3-42ef43d1127b tempest-VolumesDeleteCascade-398376463 None] Created reservations ['c2104151-4b2c-4088-bdde-462431e212f9', '285e59b3-d8c2-44cc-9f20-64491bb1b74a', 'ffac55f9-a6da-4146-b1e0-ad23ad9a908b', '30f576f4-97de-486e-b6c6-fa4e521aeff6'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:24:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-f583d144-ad31-421c-8cf3-42ef43d1127b tempest-VolumesDeleteCascade-398376463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:24:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-f583d144-ad31-421c-8cf3-42ef43d1127b tempest-VolumesDeleteCascade-398376463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:24:29 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-f583d144-ad31-421c-8cf3-42ef43d1127b tempest-VolumesDeleteCascade-398376463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:24:29 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-f583d144-ad31-421c-8cf3-42ef43d1127b tempest-VolumesDeleteCascade-398376463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:24:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-f583d144-ad31-421c-8cf3-42ef43d1127b tempest-VolumesDeleteCascade-398376463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:24:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f583d144-ad31-421c-8cf3-42ef43d1127b tempest-VolumesDeleteCascade-398376463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:24:29 devstack sudo[104007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:24:29 devstack sudo[104007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:24:30 devstack sudo[104005]: pam_unix(sudo:session): session closed for user root Apr 29 15:24:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a7ff66f9-b3fc-49ba-a901-00eab7b40f43 tempest-VolumesSnapshotListTestJSON-511230180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.618s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:24:30 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-a7ff66f9-b3fc-49ba-a901-00eab7b40f43 tempest-VolumesSnapshotListTestJSON-511230180 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:24:30 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-a7ff66f9-b3fc-49ba-a901-00eab7b40f43 tempest-VolumesSnapshotListTestJSON-511230180 None] Deleted volume successfully. Apr 29 15:24:30 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a7ff66f9-b3fc-49ba-a901-00eab7b40f43 tempest-VolumesSnapshotListTestJSON-511230180 None] Lock "cinder-13098a57-c4c1-4e2e-bcce-6ac665f383c1-delete_volume" released by "delete_volume" :: held 2.347s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:24:30 devstack cinder-volume[84448]: DEBUG oslo_service.periodic_task [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84448) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 15:24:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:24:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:24:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:24:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:24:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:24:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:24:30 devstack sudo[104014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:24:30 devstack sudo[104014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:24:30 devstack sudo[104007]: pam_unix(sudo:session): session closed for user root Apr 29 15:24:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f583d144-ad31-421c-8cf3-42ef43d1127b tempest-VolumesDeleteCascade-398376463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.756s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:24:30 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-f583d144-ad31-421c-8cf3-42ef43d1127b tempest-VolumesDeleteCascade-398376463 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:24:30 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-f583d144-ad31-421c-8cf3-42ef43d1127b tempest-VolumesDeleteCascade-398376463 None] Deleted volume successfully. Apr 29 15:24:30 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-f583d144-ad31-421c-8cf3-42ef43d1127b tempest-VolumesDeleteCascade-398376463 None] Lock "cinder-0bfad901-b84f-4e66-8e24-1ba0fb9a4c5b-delete_volume" released by "delete_volume" :: held 2.420s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:24:31 devstack sudo[104014]: pam_unix(sudo:session): session closed for user root Apr 29 15:24:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.864s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:24:31 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:24:32 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-dbd91d23-7d32-4767-beb4-bc56e287ad05 req-28797ccc-c05d-4e7c-8bd7-0de11a3240ed tempest-TestStampPattern-538910304 None] Terminate volume connection completed successfully. Apr 29 15:24:32 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-dbd91d23-7d32-4767-beb4-bc56e287ad05 req-28797ccc-c05d-4e7c-8bd7-0de11a3240ed tempest-TestStampPattern-538910304 None] Deleting attachment a50aec17-ad16-4853-a528-58f0c574daa9. {{(pid=84448) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 15:24:34 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5de354d-3aa6-46cd-ac73-b91bad0ece5f tempest-VolumesExtendTest-1443083602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:24:34 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-f5de354d-3aa6-46cd-ac73-b91bad0ece5f tempest-VolumesExtendTest-1443083602 None] Flow 'volume_create_manager' (8f06de22-95a9-4173-b2d4-4dcb58e12ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:24:34 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-f5de354d-3aa6-46cd-ac73-b91bad0ece5f tempest-VolumesExtendTest-1443083602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03368a09-2b61-4599-b7d3-fe37565b0ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:24:34 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-f5de354d-3aa6-46cd-ac73-b91bad0ece5f tempest-VolumesExtendTest-1443083602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03368a09-2b61-4599-b7d3-fe37565b0ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:24:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-184965183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c556a6f2-c616-452c-b807-13f86dec6195,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96ebabd973414507bdc3adc8d2a05a09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:24:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:24:34Z,use_quota=True,user_id='06908ea582014412b6cdebc368643b01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:24:34 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-f5de354d-3aa6-46cd-ac73-b91bad0ece5f tempest-VolumesExtendTest-1443083602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8a58185-de7c-4575-be7a-59f9699a6332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:24:34 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-f5de354d-3aa6-46cd-ac73-b91bad0ece5f tempest-VolumesExtendTest-1443083602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8a58185-de7c-4575-be7a-59f9699a6332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:24:34 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-f5de354d-3aa6-46cd-ac73-b91bad0ece5f tempest-VolumesExtendTest-1443083602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a5b0c32-558e-4ef3-8f8a-91b1a382e582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:24:34 devstack cinder-volume[84448]: DEBUG cinder.image.glance [None req-f5de354d-3aa6-46cd-ac73-b91bad0ece5f tempest-VolumesExtendTest-1443083602 None] Creating Keystone auth plugin from conf {{(pid=84448) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 29 15:24:34 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-f5de354d-3aa6-46cd-ac73-b91bad0ece5f tempest-VolumesExtendTest-1443083602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a5b0c32-558e-4ef3-8f8a-91b1a382e582) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c556a6f2-c616-452c-b807-13f86dec6195', 'volume_name': 'volume-c556a6f2-c616-452c-b807-13f86dec6195', 'volume_size': 1, 'image_id': 'ad86f424-7d2a-4f3b-9577-890075e7dc72', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ad86f424-7d2a-4f3b-9577-890075e7dc72', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '33db0ca5091747b1a3438d70bf53390c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ad86f424-7d2a-4f3b-9577-890075e7dc72', 'created_at': datetime.datetime(2026, 4, 29, 13, 0, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 13, 0, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ad86f424-7d2a-4f3b-9577-890075e7dc72/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:24:34 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-f5de354d-3aa6-46cd-ac73-b91bad0ece5f tempest-VolumesExtendTest-1443083602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72ff98af-4b44-4d7a-8b7f-13ed6def2f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:24:34 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-f5de354d-3aa6-46cd-ac73-b91bad0ece5f tempest-VolumesExtendTest-1443083602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72ff98af-4b44-4d7a-8b7f-13ed6def2f75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:24:34 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-f5de354d-3aa6-46cd-ac73-b91bad0ece5f tempest-VolumesExtendTest-1443083602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e43c54e4-3154-4383-bd1f-0bdc0d1a05ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:24:34 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-f5de354d-3aa6-46cd-ac73-b91bad0ece5f tempest-VolumesExtendTest-1443083602 None] Volume c556a6f2-c616-452c-b807-13f86dec6195: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c556a6f2-c616-452c-b807-13f86dec6195', 'volume_size': 1, 'image_id': 'ad86f424-7d2a-4f3b-9577-890075e7dc72', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ad86f424-7d2a-4f3b-9577-890075e7dc72', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '33db0ca5091747b1a3438d70bf53390c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ad86f424-7d2a-4f3b-9577-890075e7dc72', 'created_at': datetime.datetime(2026, 4, 29, 13, 0, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 13, 0, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ad86f424-7d2a-4f3b-9577-890075e7dc72/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 29 15:24:34 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5de354d-3aa6-46cd-ac73-b91bad0ece5f tempest-VolumesExtendTest-1443083602 None] Trying to clone c556a6f2-c616-452c-b807-13f86dec6195 from image ad86f424-7d2a-4f3b-9577-890075e7dc72 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ad86f424-7d2a-4f3b-9577-890075e7dc72', 'metadata': {}}]). {{(pid=84448) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 29 15:24:35 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [None req-f5de354d-3aa6-46cd-ac73-b91bad0ece5f tempest-VolumesExtendTest-1443083602 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_1dux_kzcdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84448) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 29 15:24:35 devstack cinder-volume[84448]: INFO cinder.image.image_utils [None req-f5de354d-3aa6-46cd-ac73-b91bad0ece5f tempest-VolumesExtendTest-1443083602 None] Image download 20.69 MB at 20.69 MB/s Apr 29 15:24:35 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-341debc4-e5cf-401b-b86a-d539cb58448e tempest-TestStampPattern-538910304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:24:35 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-341debc4-e5cf-401b-b86a-d539cb58448e tempest-TestStampPattern-538910304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:24:35 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-341debc4-e5cf-401b-b86a-d539cb58448e tempest-TestStampPattern-538910304 None] Creating offline snapshot e3afcf32-738d-4ee3-b193-7303a7e0b0ab of volume 2f8608b3-7b48-4cd7-b080-07172ef4409b {{(pid=84448) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 15:24:35 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[438c93e0-e68c-486f-b1bc-5000f4c09223]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:24:35 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-341debc4-e5cf-401b-b86a-d539cb58448e tempest-TestStampPattern-538910304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2f8608b3-7b48-4cd7-b080-07172ef4409b {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:24:35 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[74eab529-7c5a-46bc-948c-a0d427d48423]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:24:35 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f5de354d-3aa6-46cd-ac73-b91bad0ece5f tempest-VolumesExtendTest-1443083602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_1dux_kzcdevstack@QuobyteHD {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:24:35 devstack sudo[104096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2f8608b3-7b48-4cd7-b080-07172ef4409b Apr 29 15:24:35 devstack sudo[104096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:24:35 devstack sudo[104097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_1dux_kzcdevstack@QuobyteHD Apr 29 15:24:35 devstack sudo[104097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:24:35 devstack sudo[104097]: pam_unix(sudo:session): session closed for user root Apr 29 15:24:35 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f5de354d-3aa6-46cd-ac73-b91bad0ece5f tempest-VolumesExtendTest-1443083602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_1dux_kzcdevstack@QuobyteHD" returned: 0 in 0.753s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:24:35 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [None req-f5de354d-3aa6-46cd-ac73-b91bad0ece5f tempest-VolumesExtendTest-1443083602 None] Temporary image ad86f424-7d2a-4f3b-9577-890075e7dc72 is fetched for user 06908ea582014412b6cdebc368643b01. {{(pid=84448) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 29 15:24:35 devstack sudo[104096]: pam_unix(sudo:session): session closed for user root Apr 29 15:24:35 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-341debc4-e5cf-401b-b86a-d539cb58448e tempest-TestStampPattern-538910304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2f8608b3-7b48-4cd7-b080-07172ef4409b" returned: 0 in 0.796s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:24:35 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-341debc4-e5cf-401b-b86a-d539cb58448e tempest-TestStampPattern-538910304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2f8608b3-7b48-4cd7-b080-07172ef4409b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2f8608b3-7b48-4cd7-b080-07172ef4409b.e3afcf32-738d-4ee3-b193-7303a7e0b0ab 1G {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:24:35 devstack sudo[104108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2f8608b3-7b48-4cd7-b080-07172ef4409b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2f8608b3-7b48-4cd7-b080-07172ef4409b.e3afcf32-738d-4ee3-b193-7303a7e0b0ab 1G Apr 29 15:24:35 devstack sudo[104108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:24:35 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[4348eccf-de60-4a25-bdee-a3d451384dc6]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:24:35 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f5de354d-3aa6-46cd-ac73-b91bad0ece5f tempest-VolumesExtendTest-1443083602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_1dux_kzcdevstack@QuobyteHD {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:24:36 devstack sudo[104110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_1dux_kzcdevstack@QuobyteHD Apr 29 15:24:36 devstack sudo[104110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:24:36 devstack sudo[104110]: pam_unix(sudo:session): session closed for user root Apr 29 15:24:36 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f5de354d-3aa6-46cd-ac73-b91bad0ece5f tempest-VolumesExtendTest-1443083602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_1dux_kzcdevstack@QuobyteHD" returned: 0 in 0.710s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:24:36 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-f5de354d-3aa6-46cd-ac73-b91bad0ece5f tempest-VolumesExtendTest-1443083602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:24:36 devstack sudo[104108]: pam_unix(sudo:session): session closed for user root Apr 29 15:24:36 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-341debc4-e5cf-401b-b86a-d539cb58448e tempest-TestStampPattern-538910304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2f8608b3-7b48-4cd7-b080-07172ef4409b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2f8608b3-7b48-4cd7-b080-07172ef4409b.e3afcf32-738d-4ee3-b193-7303a7e0b0ab 1G" returned: 0 in 0.909s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:24:36 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-341debc4-e5cf-401b-b86a-d539cb58448e tempest-TestStampPattern-538910304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f8608b3-7b48-4cd7-b080-07172ef4409b -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2f8608b3-7b48-4cd7-b080-07172ef4409b.e3afcf32-738d-4ee3-b193-7303a7e0b0ab {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:24:36 devstack sudo[104120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f8608b3-7b48-4cd7-b080-07172ef4409b -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2f8608b3-7b48-4cd7-b080-07172ef4409b.e3afcf32-738d-4ee3-b193-7303a7e0b0ab Apr 29 15:24:36 devstack sudo[104120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:24:37 devstack sudo[104120]: pam_unix(sudo:session): session closed for user root Apr 29 15:24:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-341debc4-e5cf-401b-b86a-d539cb58448e tempest-TestStampPattern-538910304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f8608b3-7b48-4cd7-b080-07172ef4409b -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2f8608b3-7b48-4cd7-b080-07172ef4409b.e3afcf32-738d-4ee3-b193-7303a7e0b0ab" returned: 0 in 0.707s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:24:37 devstack cinder-volume[84448]: WARNING cinder.volume.drivers.remotefs [None req-341debc4-e5cf-401b-b86a-d539cb58448e tempest-TestStampPattern-538910304 None] /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2f8608b3-7b48-4cd7-b080-07172ef4409b.e3afcf32-738d-4ee3-b193-7303a7e0b0ab is being set with open permissions: ugo+rw Apr 29 15:24:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-341debc4-e5cf-401b-b86a-d539cb58448e tempest-TestStampPattern-538910304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2f8608b3-7b48-4cd7-b080-07172ef4409b.e3afcf32-738d-4ee3-b193-7303a7e0b0ab {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:24:37 devstack sudo[104134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2f8608b3-7b48-4cd7-b080-07172ef4409b.e3afcf32-738d-4ee3-b193-7303a7e0b0ab Apr 29 15:24:37 devstack sudo[104134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:24:38 devstack sudo[104134]: pam_unix(sudo:session): session closed for user root Apr 29 15:24:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-341debc4-e5cf-401b-b86a-d539cb58448e tempest-TestStampPattern-538910304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2f8608b3-7b48-4cd7-b080-07172ef4409b.e3afcf32-738d-4ee3-b193-7303a7e0b0ab" returned: 0 in 0.677s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:24:38 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:SELECT=92,cinder:UPDATE=100,cinder:DELETE=12,cinder:INSERT=31 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:24:38 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:SELECT=97,cinder:UPDATE=107,cinder:INSERT=24,cinder:DELETE=4 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:24:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-341debc4-e5cf-401b-b86a-d539cb58448e tempest-TestStampPattern-538910304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2f8608b3-7b48-4cd7-b080-07172ef4409b.info {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:24:38 devstack sudo[104156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2f8608b3-7b48-4cd7-b080-07172ef4409b.info Apr 29 15:24:38 devstack sudo[104156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:24:39 devstack sudo[104156]: pam_unix(sudo:session): session closed for user root Apr 29 15:24:39 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-341debc4-e5cf-401b-b86a-d539cb58448e tempest-TestStampPattern-538910304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2f8608b3-7b48-4cd7-b080-07172ef4409b.info" returned: 0 in 0.763s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:24:39 devstack cinder-volume[84448]: WARNING cinder.volume.drivers.remotefs [None req-341debc4-e5cf-401b-b86a-d539cb58448e tempest-TestStampPattern-538910304 None] /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2f8608b3-7b48-4cd7-b080-07172ef4409b.info is being set with open permissions: ugo+rw Apr 29 15:24:39 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-341debc4-e5cf-401b-b86a-d539cb58448e tempest-TestStampPattern-538910304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2f8608b3-7b48-4cd7-b080-07172ef4409b.info {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:24:39 devstack sudo[104164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2f8608b3-7b48-4cd7-b080-07172ef4409b.info Apr 29 15:24:39 devstack sudo[104164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:24:39 devstack sudo[104164]: pam_unix(sudo:session): session closed for user root Apr 29 15:24:39 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-341debc4-e5cf-401b-b86a-d539cb58448e tempest-TestStampPattern-538910304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2f8608b3-7b48-4cd7-b080-07172ef4409b.info" returned: 0 in 0.867s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:24:39 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-341debc4-e5cf-401b-b86a-d539cb58448e tempest-TestStampPattern-538910304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.871s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:24:39 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-f5de354d-3aa6-46cd-ac73-b91bad0ece5f tempest-VolumesExtendTest-1443083602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.275s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:24:39 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-f5de354d-3aa6-46cd-ac73-b91bad0ece5f tempest-VolumesExtendTest-1443083602 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:24:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-184965183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c556a6f2-c616-452c-b807-13f86dec6195,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96ebabd973414507bdc3adc8d2a05a09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:24:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:24:34Z,use_quota=True,user_id='06908ea582014412b6cdebc368643b01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:24:39 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-f5de354d-3aa6-46cd-ac73-b91bad0ece5f tempest-VolumesExtendTest-1443083602 None] Creating volume c556a6f2-c616-452c-b807-13f86dec6195 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:24:39 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-f5de354d-3aa6-46cd-ac73-b91bad0ece5f tempest-VolumesExtendTest-1443083602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:24:39 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-f5de354d-3aa6-46cd-ac73-b91bad0ece5f tempest-VolumesExtendTest-1443083602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:24:39 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-f5de354d-3aa6-46cd-ac73-b91bad0ece5f tempest-VolumesExtendTest-1443083602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:24:40 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-f5de354d-3aa6-46cd-ac73-b91bad0ece5f tempest-VolumesExtendTest-1443083602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:24:40 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-f5de354d-3aa6-46cd-ac73-b91bad0ece5f tempest-VolumesExtendTest-1443083602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:24:40 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-f5de354d-3aa6-46cd-ac73-b91bad0ece5f tempest-VolumesExtendTest-1443083602 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:24:40 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-f5de354d-3aa6-46cd-ac73-b91bad0ece5f tempest-VolumesExtendTest-1443083602 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:24:40 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f5de354d-3aa6-46cd-ac73-b91bad0ece5f tempest-VolumesExtendTest-1443083602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c556a6f2-c616-452c-b807-13f86dec6195 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:24:40 devstack sudo[104169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c556a6f2-c616-452c-b807-13f86dec6195 1073741824 Apr 29 15:24:40 devstack sudo[104169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:24:40 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-341debc4-e5cf-401b-b86a-d539cb58448e tempest-TestStampPattern-538910304 None] Create snapshot completed successfully Apr 29 15:24:41 devstack sudo[104169]: pam_unix(sudo:session): session closed for user root Apr 29 15:24:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f5de354d-3aa6-46cd-ac73-b91bad0ece5f tempest-VolumesExtendTest-1443083602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c556a6f2-c616-452c-b807-13f86dec6195 1073741824" returned: 0 in 1.062s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:24:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f5de354d-3aa6-46cd-ac73-b91bad0ece5f tempest-VolumesExtendTest-1443083602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c556a6f2-c616-452c-b807-13f86dec6195 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:24:41 devstack sudo[104176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c556a6f2-c616-452c-b807-13f86dec6195 Apr 29 15:24:41 devstack sudo[104176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:24:41 devstack sudo[104176]: pam_unix(sudo:session): session closed for user root Apr 29 15:24:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f5de354d-3aa6-46cd-ac73-b91bad0ece5f tempest-VolumesExtendTest-1443083602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c556a6f2-c616-452c-b807-13f86dec6195" returned: 0 in 0.735s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:24:41 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-f5de354d-3aa6-46cd-ac73-b91bad0ece5f tempest-VolumesExtendTest-1443083602 None] <== create_volume: return (1854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:24:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-f5de354d-3aa6-46cd-ac73-b91bad0ece5f tempest-VolumesExtendTest-1443083602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.864s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:24:41 devstack cinder-volume[84448]: DEBUG cinder.volume.volume_utils [None req-f5de354d-3aa6-46cd-ac73-b91bad0ece5f tempest-VolumesExtendTest-1443083602 None] Attempting download of ad86f424-7d2a-4f3b-9577-890075e7dc72 ((None, [{'url': 'file:///opt/stack/data/glance/images/ad86f424-7d2a-4f3b-9577-890075e7dc72', 'metadata': {}}])) to volume c556a6f2-c616-452c-b807-13f86dec6195. {{(pid=84448) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 29 15:24:42 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab6d0bd-8a53-4e92-9a33-0cdd9140e4d0]: (4, 'raw') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:24:42 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f5de354d-3aa6-46cd-ac73-b91bad0ece5f tempest-VolumesExtendTest-1443083602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ad86f424-7d2a-4f3b-9577-890075e7dc72_sdvsasit {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:24:42 devstack sudo[104179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ad86f424-7d2a-4f3b-9577-890075e7dc72_sdvsasit Apr 29 15:24:42 devstack sudo[104179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:24:42 devstack sudo[104179]: pam_unix(sudo:session): session closed for user root Apr 29 15:24:42 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f5de354d-3aa6-46cd-ac73-b91bad0ece5f tempest-VolumesExtendTest-1443083602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ad86f424-7d2a-4f3b-9577-890075e7dc72_sdvsasit" returned: 0 in 0.748s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:24:42 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f5de354d-3aa6-46cd-ac73-b91bad0ece5f tempest-VolumesExtendTest-1443083602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ad86f424-7d2a-4f3b-9577-890075e7dc72_sdvsasit {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:24:42 devstack sudo[104185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ad86f424-7d2a-4f3b-9577-890075e7dc72_sdvsasit Apr 29 15:24:42 devstack sudo[104185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:24:43 devstack sudo[104185]: pam_unix(sudo:session): session closed for user root Apr 29 15:24:43 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f5de354d-3aa6-46cd-ac73-b91bad0ece5f tempest-VolumesExtendTest-1443083602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ad86f424-7d2a-4f3b-9577-890075e7dc72_sdvsasit" returned: 1 in 0.752s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:24:43 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f5de354d-3aa6-46cd-ac73-b91bad0ece5f tempest-VolumesExtendTest-1443083602 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ad86f424-7d2a-4f3b-9577-890075e7dc72_sdvsasit' failed. Not Retrying. {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 15:24:43 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d6228bb-2937-4e26-bd53-11fcb6bfa35a]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:24:43 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f5de354d-3aa6-46cd-ac73-b91bad0ece5f tempest-VolumesExtendTest-1443083602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_1dux_kzcdevstack@QuobyteHD {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:24:43 devstack sudo[104189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_1dux_kzcdevstack@QuobyteHD Apr 29 15:24:43 devstack sudo[104189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:24:44 devstack sudo[104189]: pam_unix(sudo:session): session closed for user root Apr 29 15:24:44 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f5de354d-3aa6-46cd-ac73-b91bad0ece5f tempest-VolumesExtendTest-1443083602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_1dux_kzcdevstack@QuobyteHD" returned: 0 in 0.747s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:24:44 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [None req-f5de354d-3aa6-46cd-ac73-b91bad0ece5f tempest-VolumesExtendTest-1443083602 None] ad86f424-7d2a-4f3b-9577-890075e7dc72 was qcow2, converting to raw {{(pid=84448) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 29 15:24:44 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f5de354d-3aa6-46cd-ac73-b91bad0ece5f tempest-VolumesExtendTest-1443083602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_1dux_kzcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c556a6f2-c616-452c-b807-13f86dec6195 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:24:44 devstack sudo[104194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_1dux_kzcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c556a6f2-c616-452c-b807-13f86dec6195 Apr 29 15:24:44 devstack sudo[104194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:24:46 devstack sudo[104194]: pam_unix(sudo:session): session closed for user root Apr 29 15:24:46 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f5de354d-3aa6-46cd-ac73-b91bad0ece5f tempest-VolumesExtendTest-1443083602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_1dux_kzcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c556a6f2-c616-452c-b807-13f86dec6195" returned: 0 in 2.210s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:24:46 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [None req-f5de354d-3aa6-46cd-ac73-b91bad0ece5f tempest-VolumesExtendTest-1443083602 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_1dux_kzcdevstack@QuobyteHD, size 112.00 MB, duration 2.21 sec, destination /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c556a6f2-c616-452c-b807-13f86dec6195 {{(pid=84448) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 15:24:46 devstack cinder-volume[84448]: INFO cinder.image.image_utils [None req-f5de354d-3aa6-46cd-ac73-b91bad0ece5f tempest-VolumesExtendTest-1443083602 None] Converted 112.00 MB image at 50.64 MB/s Apr 29 15:24:46 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f5de354d-3aa6-46cd-ac73-b91bad0ece5f tempest-VolumesExtendTest-1443083602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c556a6f2-c616-452c-b807-13f86dec6195 1G {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:24:46 devstack sudo[104240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c556a6f2-c616-452c-b807-13f86dec6195 1G Apr 29 15:24:46 devstack sudo[104240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:24:47 devstack sudo[104240]: pam_unix(sudo:session): session closed for user root Apr 29 15:24:47 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f5de354d-3aa6-46cd-ac73-b91bad0ece5f tempest-VolumesExtendTest-1443083602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c556a6f2-c616-452c-b807-13f86dec6195 1G" returned: 0 in 0.699s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:24:47 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d49d154-9bab-42a0-888d-dad9d1ab92d0]: (4, 'raw') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:24:47 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f5de354d-3aa6-46cd-ac73-b91bad0ece5f tempest-VolumesExtendTest-1443083602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c556a6f2-c616-452c-b807-13f86dec6195 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:24:47 devstack sudo[104245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c556a6f2-c616-452c-b807-13f86dec6195 Apr 29 15:24:47 devstack sudo[104245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:24:48 devstack sudo[104245]: pam_unix(sudo:session): session closed for user root Apr 29 15:24:48 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f5de354d-3aa6-46cd-ac73-b91bad0ece5f tempest-VolumesExtendTest-1443083602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c556a6f2-c616-452c-b807-13f86dec6195" returned: 0 in 0.938s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:24:48 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f5de354d-3aa6-46cd-ac73-b91bad0ece5f tempest-VolumesExtendTest-1443083602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c556a6f2-c616-452c-b807-13f86dec6195 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:24:48 devstack sudo[104249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c556a6f2-c616-452c-b807-13f86dec6195 Apr 29 15:24:48 devstack sudo[104249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:24:49 devstack sudo[104249]: pam_unix(sudo:session): session closed for user root Apr 29 15:24:49 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f5de354d-3aa6-46cd-ac73-b91bad0ece5f tempest-VolumesExtendTest-1443083602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c556a6f2-c616-452c-b807-13f86dec6195" returned: 1 in 0.878s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:24:49 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f5de354d-3aa6-46cd-ac73-b91bad0ece5f tempest-VolumesExtendTest-1443083602 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c556a6f2-c616-452c-b807-13f86dec6195' failed. Not Retrying. {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 15:24:49 devstack cinder-volume[84448]: DEBUG cinder.volume.volume_utils [None req-f5de354d-3aa6-46cd-ac73-b91bad0ece5f tempest-VolumesExtendTest-1443083602 None] Downloaded image ad86f424-7d2a-4f3b-9577-890075e7dc72 ((None, [{'url': 'file:///opt/stack/data/glance/images/ad86f424-7d2a-4f3b-9577-890075e7dc72', 'metadata': {}}])) to volume c556a6f2-c616-452c-b807-13f86dec6195 successfully. {{(pid=84448) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 29 15:24:49 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [None req-f5de354d-3aa6-46cd-ac73-b91bad0ece5f tempest-VolumesExtendTest-1443083602 None] Temporary image ad86f424-7d2a-4f3b-9577-890075e7dc72 for user 06908ea582014412b6cdebc368643b01 is deleted. {{(pid=84448) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 29 15:24:49 devstack cinder-volume[84448]: DEBUG cinder.volume.volume_utils [None req-f5de354d-3aa6-46cd-ac73-b91bad0ece5f tempest-VolumesExtendTest-1443083602 None] Marking volume c556a6f2-c616-452c-b807-13f86dec6195 as bootable. {{(pid=84448) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 29 15:24:49 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5de354d-3aa6-46cd-ac73-b91bad0ece5f tempest-VolumesExtendTest-1443083602 None] Copying metadata from image ad86f424-7d2a-4f3b-9577-890075e7dc72 to c556a6f2-c616-452c-b807-13f86dec6195. {{(pid=84448) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 29 15:24:49 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5de354d-3aa6-46cd-ac73-b91bad0ece5f tempest-VolumesExtendTest-1443083602 None] Creating volume glance metadata for volume c556a6f2-c616-452c-b807-13f86dec6195 backed by image ad86f424-7d2a-4f3b-9577-890075e7dc72 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'ad86f424-7d2a-4f3b-9577-890075e7dc72', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84448) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 29 15:24:49 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-f5de354d-3aa6-46cd-ac73-b91bad0ece5f tempest-VolumesExtendTest-1443083602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e43c54e4-3154-4383-bd1f-0bdc0d1a05ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c556a6f2-c616-452c-b807-13f86dec6195', 'volume_size': 1, 'image_id': 'ad86f424-7d2a-4f3b-9577-890075e7dc72', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ad86f424-7d2a-4f3b-9577-890075e7dc72', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '33db0ca5091747b1a3438d70bf53390c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ad86f424-7d2a-4f3b-9577-890075e7dc72', 'created_at': datetime.datetime(2026, 4, 29, 13, 0, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 13, 0, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ad86f424-7d2a-4f3b-9577-890075e7dc72/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:24:49 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-f5de354d-3aa6-46cd-ac73-b91bad0ece5f tempest-VolumesExtendTest-1443083602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8918a07b-1ad4-4165-bfaf-7f834419042f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:24:49 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-f5de354d-3aa6-46cd-ac73-b91bad0ece5f tempest-VolumesExtendTest-1443083602 None] Volume volume-c556a6f2-c616-452c-b807-13f86dec6195 (c556a6f2-c616-452c-b807-13f86dec6195): created successfully Apr 29 15:24:49 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-f5de354d-3aa6-46cd-ac73-b91bad0ece5f tempest-VolumesExtendTest-1443083602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8918a07b-1ad4-4165-bfaf-7f834419042f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:24:49 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-f5de354d-3aa6-46cd-ac73-b91bad0ece5f tempest-VolumesExtendTest-1443083602 None] Flow 'volume_create_manager' (8f06de22-95a9-4173-b2d4-4dcb58e12ebf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:24:49 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-f5de354d-3aa6-46cd-ac73-b91bad0ece5f tempest-VolumesExtendTest-1443083602 None] Created volume successfully. Apr 29 15:24:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-0fb5011c-c3b6-44c1-aee2-eea402a8ae43 tempest-VolumesExtendTest-1443083602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:24:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-0fb5011c-c3b6-44c1-aee2-eea402a8ae43 tempest-VolumesExtendTest-1443083602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:24:50 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[0acaee42-6140-49c3-b224-3944ec382cb6]: (4, 'raw') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:24:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-0fb5011c-c3b6-44c1-aee2-eea402a8ae43 tempest-VolumesExtendTest-1443083602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c556a6f2-c616-452c-b807-13f86dec6195 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:24:50 devstack sudo[104255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c556a6f2-c616-452c-b807-13f86dec6195 Apr 29 15:24:50 devstack sudo[104255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:24:51 devstack sudo[104255]: pam_unix(sudo:session): session closed for user root Apr 29 15:24:51 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-0fb5011c-c3b6-44c1-aee2-eea402a8ae43 tempest-VolumesExtendTest-1443083602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c556a6f2-c616-452c-b807-13f86dec6195" returned: 0 in 0.810s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:24:51 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-0fb5011c-c3b6-44c1-aee2-eea402a8ae43 tempest-VolumesExtendTest-1443083602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c556a6f2-c616-452c-b807-13f86dec6195 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:24:51 devstack sudo[104259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c556a6f2-c616-452c-b807-13f86dec6195 Apr 29 15:24:51 devstack sudo[104259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:24:51 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-0782f188-e486-4919-894c-b34691c952d9 tempest-TestStampPattern-538910304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:24:51 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-0782f188-e486-4919-894c-b34691c952d9 tempest-TestStampPattern-538910304 None] Flow 'volume_create_manager' (5c2d146f-eb6b-4797-8f94-ae089d437949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:24:51 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-0782f188-e486-4919-894c-b34691c952d9 tempest-TestStampPattern-538910304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dec65f58-1ff8-492d-bd80-1912cd947694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:24:51 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-0782f188-e486-4919-894c-b34691c952d9 tempest-TestStampPattern-538910304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dec65f58-1ff8-492d-bd80-1912cd947694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:24:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1021210603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b062e17a-3235-47de-b7de-4fbbb10abfb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb6410b29eb94132976abf0c5cd51b54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:24:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e3afcf32-738d-4ee3-b193-7303a7e0b0ab,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:24:52Z,use_quota=True,user_id='ba2ca1ba522d4106a3f6dbff043f36d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:24:51 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-0782f188-e486-4919-894c-b34691c952d9 tempest-TestStampPattern-538910304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b23c3ed-eef9-46c8-8d0b-589f6cffdcfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:24:51 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-0782f188-e486-4919-894c-b34691c952d9 tempest-TestStampPattern-538910304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b23c3ed-eef9-46c8-8d0b-589f6cffdcfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:24:51 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-0782f188-e486-4919-894c-b34691c952d9 tempest-TestStampPattern-538910304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66e59649-5100-4b23-919c-7a7bebc479f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:24:51 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-0782f188-e486-4919-894c-b34691c952d9 tempest-TestStampPattern-538910304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66e59649-5100-4b23-919c-7a7bebc479f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b062e17a-3235-47de-b7de-4fbbb10abfb7', 'volume_name': 'volume-b062e17a-3235-47de-b7de-4fbbb10abfb7', 'volume_size': 1, 'snapshot_id': 'e3afcf32-738d-4ee3-b193-7303a7e0b0ab'}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:24:51 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-0782f188-e486-4919-894c-b34691c952d9 tempest-TestStampPattern-538910304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ed42a6b-c9db-4b6a-9dad-dc300465c3ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:24:51 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-0782f188-e486-4919-894c-b34691c952d9 tempest-TestStampPattern-538910304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ed42a6b-c9db-4b6a-9dad-dc300465c3ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:24:51 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-0782f188-e486-4919-894c-b34691c952d9 tempest-TestStampPattern-538910304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35b6675a-f6a7-4593-995c-7d3a556c7394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:24:51 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-0782f188-e486-4919-894c-b34691c952d9 tempest-TestStampPattern-538910304 None] Volume b062e17a-3235-47de-b7de-4fbbb10abfb7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b062e17a-3235-47de-b7de-4fbbb10abfb7', 'volume_size': 1, 'snapshot_id': 'e3afcf32-738d-4ee3-b193-7303a7e0b0ab'} Apr 29 15:24:51 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-0782f188-e486-4919-894c-b34691c952d9 tempest-TestStampPattern-538910304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:24:52 devstack sudo[104259]: pam_unix(sudo:session): session closed for user root Apr 29 15:24:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-0fb5011c-c3b6-44c1-aee2-eea402a8ae43 tempest-VolumesExtendTest-1443083602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c556a6f2-c616-452c-b807-13f86dec6195" returned: 1 in 0.918s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:24:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-0fb5011c-c3b6-44c1-aee2-eea402a8ae43 tempest-VolumesExtendTest-1443083602 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c556a6f2-c616-452c-b807-13f86dec6195' failed. Not Retrying. {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 15:24:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-0fb5011c-c3b6-44c1-aee2-eea402a8ae43 tempest-VolumesExtendTest-1443083602 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c556a6f2-c616-452c-b807-13f86dec6195 2G {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:24:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-0fb5011c-c3b6-44c1-aee2-eea402a8ae43 tempest-VolumesExtendTest-1443083602 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c556a6f2-c616-452c-b807-13f86dec6195 2G" returned: 0 in 0.105s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:24:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-0fb5011c-c3b6-44c1-aee2-eea402a8ae43 tempest-VolumesExtendTest-1443083602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.904s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:24:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-0782f188-e486-4919-894c-b34691c952d9 tempest-TestStampPattern-538910304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.726s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:24:52 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-0782f188-e486-4919-894c-b34691c952d9 tempest-TestStampPattern-538910304 None] Acquiring lock "cinder-quobyte-e3afcf32-738d-4ee3-b193-7303a7e0b0ab-b062e17a-3235-47de-b7de-4fbbb10abfb7" by "_create_volume_from_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:24:52 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-0782f188-e486-4919-894c-b34691c952d9 tempest-TestStampPattern-538910304 None] Lock "cinder-quobyte-e3afcf32-738d-4ee3-b193-7303a7e0b0ab-b062e17a-3235-47de-b7de-4fbbb10abfb7" acquired by "_create_volume_from_snapshot" :: waited 0.040s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:24:52 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-0782f188-e486-4919-894c-b34691c952d9 tempest-TestStampPattern-538910304 None] Creating volume b062e17a-3235-47de-b7de-4fbbb10abfb7 from snapshot e3afcf32-738d-4ee3-b193-7303a7e0b0ab {{(pid=84448) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 15:24:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-0782f188-e486-4919-894c-b34691c952d9 tempest-TestStampPattern-538910304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:24:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-0782f188-e486-4919-894c-b34691c952d9 tempest-TestStampPattern-538910304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:24:52 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-0782f188-e486-4919-894c-b34691c952d9 tempest-TestStampPattern-538910304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:24:52 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-0782f188-e486-4919-894c-b34691c952d9 tempest-TestStampPattern-538910304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:24:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-0782f188-e486-4919-894c-b34691c952d9 tempest-TestStampPattern-538910304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:24:52 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-0782f188-e486-4919-894c-b34691c952d9 tempest-TestStampPattern-538910304 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:24:52 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-0782f188-e486-4919-894c-b34691c952d9 tempest-TestStampPattern-538910304 None] Acquiring lock "cinder-quobyte-b062e17a-3235-47de-b7de-4fbbb10abfb7" by "_copy_volume_from_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:24:52 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-0782f188-e486-4919-894c-b34691c952d9 tempest-TestStampPattern-538910304 None] Lock "cinder-quobyte-b062e17a-3235-47de-b7de-4fbbb10abfb7" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:24:52 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-0782f188-e486-4919-894c-b34691c952d9 tempest-TestStampPattern-538910304 None] snapshot: e3afcf32-738d-4ee3-b193-7303a7e0b0ab, volume: b062e17a-3235-47de-b7de-4fbbb10abfb7, {{(pid=84448) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 15:24:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-0782f188-e486-4919-894c-b34691c952d9 tempest-TestStampPattern-538910304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:24:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-0782f188-e486-4919-894c-b34691c952d9 tempest-TestStampPattern-538910304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:24:52 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-0782f188-e486-4919-894c-b34691c952d9 tempest-TestStampPattern-538910304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:24:52 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-0782f188-e486-4919-894c-b34691c952d9 tempest-TestStampPattern-538910304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:24:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-0782f188-e486-4919-894c-b34691c952d9 tempest-TestStampPattern-538910304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:24:52 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-0fb5011c-c3b6-44c1-aee2-eea402a8ae43 tempest-VolumesExtendTest-1443083602 None] Extend volume completed successfully. Apr 29 15:24:52 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd410760-0abd-4185-b029-9ca4f2b5513a]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:24:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-0782f188-e486-4919-894c-b34691c952d9 tempest-TestStampPattern-538910304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2f8608b3-7b48-4cd7-b080-07172ef4409b.e3afcf32-738d-4ee3-b193-7303a7e0b0ab {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:24:52 devstack sudo[104267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2f8608b3-7b48-4cd7-b080-07172ef4409b.e3afcf32-738d-4ee3-b193-7303a7e0b0ab Apr 29 15:24:52 devstack sudo[104267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:24:53 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-de16efa4-ec52-44e9-86bb-34e80b22eea1 tempest-VolumesExtendTest-1443083602 None] Acquiring lock "cinder-c556a6f2-c616-452c-b807-13f86dec6195-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:24:53 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-de16efa4-ec52-44e9-86bb-34e80b22eea1 tempest-VolumesExtendTest-1443083602 None] Lock "cinder-c556a6f2-c616-452c-b807-13f86dec6195-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:24:53 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-de16efa4-ec52-44e9-86bb-34e80b22eea1 tempest-VolumesExtendTest-1443083602 None] Acquiring lock "cinder-quobyte-c556a6f2-c616-452c-b807-13f86dec6195" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:24:53 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-de16efa4-ec52-44e9-86bb-34e80b22eea1 tempest-VolumesExtendTest-1443083602 None] Lock "cinder-quobyte-c556a6f2-c616-452c-b807-13f86dec6195" acquired by "delete_volume" :: waited 0.026s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:24:53 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[983a66f7-247b-4f79-b3cb-2db7a97bd0f7]: (4, 'raw') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:24:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-de16efa4-ec52-44e9-86bb-34e80b22eea1 tempest-VolumesExtendTest-1443083602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c556a6f2-c616-452c-b807-13f86dec6195 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:24:53 devstack sudo[104271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c556a6f2-c616-452c-b807-13f86dec6195 Apr 29 15:24:53 devstack sudo[104271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:24:53 devstack sudo[104267]: pam_unix(sudo:session): session closed for user root Apr 29 15:24:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-0782f188-e486-4919-894c-b34691c952d9 tempest-TestStampPattern-538910304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2f8608b3-7b48-4cd7-b080-07172ef4409b.e3afcf32-738d-4ee3-b193-7303a7e0b0ab" returned: 0 in 1.000s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:24:53 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-0782f188-e486-4919-894c-b34691c952d9 tempest-TestStampPattern-538910304 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f8608b3-7b48-4cd7-b080-07172ef4409b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84448) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 15:24:53 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-0782f188-e486-4919-894c-b34691c952d9 tempest-TestStampPattern-538910304 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2f8608b3-7b48-4cd7-b080-07172ef4409b {{(pid=84448) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 15:24:53 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-0782f188-e486-4919-894c-b34691c952d9 tempest-TestStampPattern-538910304 None] Creating direct copy from snapshot {{(pid=84448) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 15:24:53 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ebd0af-4b43-4774-a9d7-0ab77c7f7a06]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:24:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-0782f188-e486-4919-894c-b34691c952d9 tempest-TestStampPattern-538910304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2f8608b3-7b48-4cd7-b080-07172ef4409b {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:24:53 devstack sudo[104276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2f8608b3-7b48-4cd7-b080-07172ef4409b Apr 29 15:24:53 devstack sudo[104276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:24:54 devstack sudo[104271]: pam_unix(sudo:session): session closed for user root Apr 29 15:24:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-de16efa4-ec52-44e9-86bb-34e80b22eea1 tempest-VolumesExtendTest-1443083602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c556a6f2-c616-452c-b807-13f86dec6195" returned: 0 in 1.076s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:24:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-de16efa4-ec52-44e9-86bb-34e80b22eea1 tempest-VolumesExtendTest-1443083602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c556a6f2-c616-452c-b807-13f86dec6195 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:24:54 devstack sudo[104280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c556a6f2-c616-452c-b807-13f86dec6195 Apr 29 15:24:54 devstack sudo[104280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:24:54 devstack sudo[104276]: pam_unix(sudo:session): session closed for user root Apr 29 15:24:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-0782f188-e486-4919-894c-b34691c952d9 tempest-TestStampPattern-538910304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2f8608b3-7b48-4cd7-b080-07172ef4409b" returned: 0 in 0.992s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:24:54 devstack cinder-volume[84448]: DEBUG cinder.utils [None req-0782f188-e486-4919-894c-b34691c952d9 tempest-TestStampPattern-538910304 None] Path /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-b062e17a-3235-47de-b7de-4fbbb10abfb7 not found in is_blk_device check {{(pid=84448) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 15:24:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-0782f188-e486-4919-894c-b34691c952d9 tempest-TestStampPattern-538910304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2f8608b3-7b48-4cd7-b080-07172ef4409b /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-b062e17a-3235-47de-b7de-4fbbb10abfb7 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:24:54 devstack sudo[104285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2f8608b3-7b48-4cd7-b080-07172ef4409b /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-b062e17a-3235-47de-b7de-4fbbb10abfb7 Apr 29 15:24:54 devstack sudo[104285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:24:55 devstack sudo[104280]: pam_unix(sudo:session): session closed for user root Apr 29 15:24:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-de16efa4-ec52-44e9-86bb-34e80b22eea1 tempest-VolumesExtendTest-1443083602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c556a6f2-c616-452c-b807-13f86dec6195" returned: 1 in 0.816s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:24:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-de16efa4-ec52-44e9-86bb-34e80b22eea1 tempest-VolumesExtendTest-1443083602 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c556a6f2-c616-452c-b807-13f86dec6195' failed. Not Retrying. {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 15:24:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-de16efa4-ec52-44e9-86bb-34e80b22eea1 tempest-VolumesExtendTest-1443083602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c556a6f2-c616-452c-b807-13f86dec6195 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:24:55 devstack sudo[104290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c556a6f2-c616-452c-b807-13f86dec6195 Apr 29 15:24:55 devstack sudo[104290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:24:56 devstack sudo[104290]: pam_unix(sudo:session): session closed for user root Apr 29 15:24:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-de16efa4-ec52-44e9-86bb-34e80b22eea1 tempest-VolumesExtendTest-1443083602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c556a6f2-c616-452c-b807-13f86dec6195" returned: 0 in 0.958s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:24:56 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-de16efa4-ec52-44e9-86bb-34e80b22eea1 tempest-VolumesExtendTest-1443083602 None] Lock "cinder-quobyte-c556a6f2-c616-452c-b807-13f86dec6195" released by "delete_volume" :: held 2.981s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:24:56 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-de16efa4-ec52-44e9-86bb-34e80b22eea1 tempest-VolumesExtendTest-1443083602 None] Created reservations ['089df9f3-06f8-4fc9-9b98-799253080caa', '9c74a187-8857-4277-b934-21bb39f262b3', 'f16ce3e9-6034-4ede-ba32-667e9165c727', '2d9fcfc6-de5b-415f-9e96-bc769b481216'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:24:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-de16efa4-ec52-44e9-86bb-34e80b22eea1 tempest-VolumesExtendTest-1443083602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:24:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-de16efa4-ec52-44e9-86bb-34e80b22eea1 tempest-VolumesExtendTest-1443083602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:24:56 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-de16efa4-ec52-44e9-86bb-34e80b22eea1 tempest-VolumesExtendTest-1443083602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:24:56 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-de16efa4-ec52-44e9-86bb-34e80b22eea1 tempest-VolumesExtendTest-1443083602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:24:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-de16efa4-ec52-44e9-86bb-34e80b22eea1 tempest-VolumesExtendTest-1443083602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:24:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-de16efa4-ec52-44e9-86bb-34e80b22eea1 tempest-VolumesExtendTest-1443083602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:24:56 devstack sudo[104304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:24:56 devstack sudo[104304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:24:57 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-b783d531-c738-4924-82f3-1ab562430724 tempest-VolumesExtendTest-1443083602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:24:58 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b783d531-c738-4924-82f3-1ab562430724 tempest-VolumesExtendTest-1443083602 None] Flow 'volume_create_manager' (03ee4ed6-b7e7-479f-b478-4612f84625be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:24:58 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b783d531-c738-4924-82f3-1ab562430724 tempest-VolumesExtendTest-1443083602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45daf898-b83e-4b76-bc45-dc37b390672a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:24:58 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b783d531-c738-4924-82f3-1ab562430724 tempest-VolumesExtendTest-1443083602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45daf898-b83e-4b76-bc45-dc37b390672a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:24:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-743668518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d4ac517-2cd7-40c2-9d7b-1365ee542450,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96ebabd973414507bdc3adc8d2a05a09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:24:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:24:58Z,use_quota=True,user_id='06908ea582014412b6cdebc368643b01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:24:58 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b783d531-c738-4924-82f3-1ab562430724 tempest-VolumesExtendTest-1443083602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (680924d7-3c31-42ce-a952-d5548a7131e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:24:58 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b783d531-c738-4924-82f3-1ab562430724 tempest-VolumesExtendTest-1443083602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (680924d7-3c31-42ce-a952-d5548a7131e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:24:58 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b783d531-c738-4924-82f3-1ab562430724 tempest-VolumesExtendTest-1443083602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba7578ac-21f8-4f97-8ba3-22c0faf9505b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:24:58 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b783d531-c738-4924-82f3-1ab562430724 tempest-VolumesExtendTest-1443083602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba7578ac-21f8-4f97-8ba3-22c0faf9505b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d4ac517-2cd7-40c2-9d7b-1365ee542450', 'volume_name': 'volume-1d4ac517-2cd7-40c2-9d7b-1365ee542450', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:24:58 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b783d531-c738-4924-82f3-1ab562430724 tempest-VolumesExtendTest-1443083602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b72be72-5a36-4071-bf52-e6187703f4b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:24:58 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b783d531-c738-4924-82f3-1ab562430724 tempest-VolumesExtendTest-1443083602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b72be72-5a36-4071-bf52-e6187703f4b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:24:58 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b783d531-c738-4924-82f3-1ab562430724 tempest-VolumesExtendTest-1443083602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77e5508e-8803-44d5-8d14-2d3152521f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:24:58 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-b783d531-c738-4924-82f3-1ab562430724 tempest-VolumesExtendTest-1443083602 None] Volume 1d4ac517-2cd7-40c2-9d7b-1365ee542450: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d4ac517-2cd7-40c2-9d7b-1365ee542450', 'volume_size': 1} Apr 29 15:24:58 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-b783d531-c738-4924-82f3-1ab562430724 tempest-VolumesExtendTest-1443083602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:24:59 devstack sudo[104304]: pam_unix(sudo:session): session closed for user root Apr 29 15:24:59 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-de16efa4-ec52-44e9-86bb-34e80b22eea1 tempest-VolumesExtendTest-1443083602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 2.430s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:24:59 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-de16efa4-ec52-44e9-86bb-34e80b22eea1 tempest-VolumesExtendTest-1443083602 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:24:59 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-de16efa4-ec52-44e9-86bb-34e80b22eea1 tempest-VolumesExtendTest-1443083602 None] Deleted volume successfully. Apr 29 15:24:59 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-de16efa4-ec52-44e9-86bb-34e80b22eea1 tempest-VolumesExtendTest-1443083602 None] Lock "cinder-c556a6f2-c616-452c-b807-13f86dec6195-delete_volume" released by "delete_volume" :: held 6.042s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:25:02 devstack sudo[104285]: pam_unix(sudo:session): session closed for user root Apr 29 15:25:02 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-0782f188-e486-4919-894c-b34691c952d9 tempest-TestStampPattern-538910304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2f8608b3-7b48-4cd7-b080-07172ef4409b /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-b062e17a-3235-47de-b7de-4fbbb10abfb7" returned: 0 in 7.485s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:25:02 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[954513eb-60b5-419c-93ca-b44abd74d8e2]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:25:02 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-0782f188-e486-4919-894c-b34691c952d9 tempest-TestStampPattern-538910304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2f8608b3-7b48-4cd7-b080-07172ef4409b {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:25:02 devstack sudo[104311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2f8608b3-7b48-4cd7-b080-07172ef4409b Apr 29 15:25:02 devstack sudo[104311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:25:02 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-64a03b04-781e-4b47-a13f-8a4317c2e51e tempest-TestInstancesWithCinderVolumes-634922416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:25:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-64a03b04-781e-4b47-a13f-8a4317c2e51e tempest-TestInstancesWithCinderVolumes-634922416 None] Flow 'volume_create_manager' (cf5002a0-d007-480c-93a7-f3f1171034dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:25:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-64a03b04-781e-4b47-a13f-8a4317c2e51e tempest-TestInstancesWithCinderVolumes-634922416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e82aad70-5b69-41ad-b9ca-748cc36ec33e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:25:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-64a03b04-781e-4b47-a13f-8a4317c2e51e tempest-TestInstancesWithCinderVolumes-634922416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e82aad70-5b69-41ad-b9ca-748cc36ec33e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:25:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1157144417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72578478-516d-4a91-ae69-d068d73653cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='128a3be4a591459eaa97416ed2428af7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:25:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:25:03Z,use_quota=True,user_id='bf9ea8e824db4b97a752e1a8b1eaf0d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa8dc660-39ca-48d2-84de-f5a9c5aa9a6c),volume_type_id=fa8dc660-39ca-48d2-84de-f5a9c5aa9a6c)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:25:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-64a03b04-781e-4b47-a13f-8a4317c2e51e tempest-TestInstancesWithCinderVolumes-634922416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3c0f498-047f-4997-8d8a-8c675eaecd93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:25:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-64a03b04-781e-4b47-a13f-8a4317c2e51e tempest-TestInstancesWithCinderVolumes-634922416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3c0f498-047f-4997-8d8a-8c675eaecd93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:25:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-64a03b04-781e-4b47-a13f-8a4317c2e51e tempest-TestInstancesWithCinderVolumes-634922416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c53a5ad-3ab0-4af1-a052-5b36d0e0f412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:25:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-64a03b04-781e-4b47-a13f-8a4317c2e51e tempest-TestInstancesWithCinderVolumes-634922416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c53a5ad-3ab0-4af1-a052-5b36d0e0f412) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72578478-516d-4a91-ae69-d068d73653cd', 'volume_name': 'volume-72578478-516d-4a91-ae69-d068d73653cd', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:25:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-64a03b04-781e-4b47-a13f-8a4317c2e51e tempest-TestInstancesWithCinderVolumes-634922416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc3f8a1c-b02e-4f82-b6bc-cc45bba2af9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:25:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-64a03b04-781e-4b47-a13f-8a4317c2e51e tempest-TestInstancesWithCinderVolumes-634922416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc3f8a1c-b02e-4f82-b6bc-cc45bba2af9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:25:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-64a03b04-781e-4b47-a13f-8a4317c2e51e tempest-TestInstancesWithCinderVolumes-634922416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (816dab2e-d79e-433e-a499-9905746c0e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:25:03 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-64a03b04-781e-4b47-a13f-8a4317c2e51e tempest-TestInstancesWithCinderVolumes-634922416 None] Volume 72578478-516d-4a91-ae69-d068d73653cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72578478-516d-4a91-ae69-d068d73653cd', 'volume_size': 1} Apr 29 15:25:03 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-64a03b04-781e-4b47-a13f-8a4317c2e51e tempest-TestInstancesWithCinderVolumes-634922416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:25:03 devstack sudo[104311]: pam_unix(sudo:session): session closed for user root Apr 29 15:25:03 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-0782f188-e486-4919-894c-b34691c952d9 tempest-TestStampPattern-538910304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2f8608b3-7b48-4cd7-b080-07172ef4409b" returned: 0 in 1.396s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:25:03 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [None req-0782f188-e486-4919-894c-b34691c952d9 tempest-TestStampPattern-538910304 None] Image conversion details: src /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2f8608b3-7b48-4cd7-b080-07172ef4409b, size 1024.00 MB, duration 7.49 sec, destination /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-b062e17a-3235-47de-b7de-4fbbb10abfb7 {{(pid=84448) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 15:25:03 devstack cinder-volume[84448]: INFO cinder.image.image_utils [None req-0782f188-e486-4919-894c-b34691c952d9 tempest-TestStampPattern-538910304 None] Converted 1024.00 MB image at 136.78 MB/s Apr 29 15:25:03 devstack cinder-volume[84448]: WARNING cinder.volume.drivers.remotefs [None req-0782f188-e486-4919-894c-b34691c952d9 tempest-TestStampPattern-538910304 None] /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-b062e17a-3235-47de-b7de-4fbbb10abfb7 is being set with open permissions: ugo+rw Apr 29 15:25:03 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-0782f188-e486-4919-894c-b34691c952d9 tempest-TestStampPattern-538910304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-b062e17a-3235-47de-b7de-4fbbb10abfb7 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:25:03 devstack sudo[104321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-b062e17a-3235-47de-b7de-4fbbb10abfb7 Apr 29 15:25:03 devstack sudo[104321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:25:03 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-74d09ca2-4ee7-45c6-93b7-20720b27c912 tempest-TestInstancesWithCinderVolumes-634922416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:25:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-74d09ca2-4ee7-45c6-93b7-20720b27c912 tempest-TestInstancesWithCinderVolumes-634922416 None] Flow 'volume_create_manager' (139e522c-1147-491b-ad50-53a261627dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:25:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-74d09ca2-4ee7-45c6-93b7-20720b27c912 tempest-TestInstancesWithCinderVolumes-634922416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25d0481d-6a74-4b14-b94b-b5f63f3111db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:25:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-74d09ca2-4ee7-45c6-93b7-20720b27c912 tempest-TestInstancesWithCinderVolumes-634922416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25d0481d-6a74-4b14-b94b-b5f63f3111db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:25:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1034292685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61771c01-1179-41e9-8c96-337301e21803,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='128a3be4a591459eaa97416ed2428af7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:25:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:25:04Z,use_quota=True,user_id='bf9ea8e824db4b97a752e1a8b1eaf0d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94456f81-00e4-45a3-a8aa-3ffdec7ab763),volume_type_id=94456f81-00e4-45a3-a8aa-3ffdec7ab763)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:25:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-74d09ca2-4ee7-45c6-93b7-20720b27c912 tempest-TestInstancesWithCinderVolumes-634922416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00e2d2f8-a1c0-475b-a429-d75f6c360f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:25:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-74d09ca2-4ee7-45c6-93b7-20720b27c912 tempest-TestInstancesWithCinderVolumes-634922416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00e2d2f8-a1c0-475b-a429-d75f6c360f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:25:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-74d09ca2-4ee7-45c6-93b7-20720b27c912 tempest-TestInstancesWithCinderVolumes-634922416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04c778e0-e7c9-481c-a6ea-a05de8af0e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:25:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-74d09ca2-4ee7-45c6-93b7-20720b27c912 tempest-TestInstancesWithCinderVolumes-634922416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04c778e0-e7c9-481c-a6ea-a05de8af0e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61771c01-1179-41e9-8c96-337301e21803', 'volume_name': 'volume-61771c01-1179-41e9-8c96-337301e21803', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:25:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-74d09ca2-4ee7-45c6-93b7-20720b27c912 tempest-TestInstancesWithCinderVolumes-634922416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07c39c9b-f40b-4eb7-aa18-83f88ed735e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:25:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-74d09ca2-4ee7-45c6-93b7-20720b27c912 tempest-TestInstancesWithCinderVolumes-634922416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07c39c9b-f40b-4eb7-aa18-83f88ed735e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:25:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-74d09ca2-4ee7-45c6-93b7-20720b27c912 tempest-TestInstancesWithCinderVolumes-634922416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40e6e6be-69e6-4aba-ac43-7d5715568436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:25:03 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-74d09ca2-4ee7-45c6-93b7-20720b27c912 tempest-TestInstancesWithCinderVolumes-634922416 None] Volume 61771c01-1179-41e9-8c96-337301e21803: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61771c01-1179-41e9-8c96-337301e21803', 'volume_size': 1} Apr 29 15:25:03 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-74d09ca2-4ee7-45c6-93b7-20720b27c912 tempest-TestInstancesWithCinderVolumes-634922416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:25:04 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-502a5918-bad8-4e16-9c95-73d4ec51abd5 tempest-TestInstancesWithCinderVolumes-634922416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:25:04 devstack sudo[104321]: pam_unix(sudo:session): session closed for user root Apr 29 15:25:04 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-502a5918-bad8-4e16-9c95-73d4ec51abd5 tempest-TestInstancesWithCinderVolumes-634922416 None] Flow 'volume_create_manager' (1dc0e3a3-ce35-4bb3-8d3e-75fb4ffd3478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:25:04 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-502a5918-bad8-4e16-9c95-73d4ec51abd5 tempest-TestInstancesWithCinderVolumes-634922416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6378bee9-44bb-425c-92c6-31b534e0da40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:25:04 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-0782f188-e486-4919-894c-b34691c952d9 tempest-TestStampPattern-538910304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-b062e17a-3235-47de-b7de-4fbbb10abfb7" returned: 0 in 0.792s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:25:04 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-0782f188-e486-4919-894c-b34691c952d9 tempest-TestStampPattern-538910304 None] Lock "cinder-quobyte-b062e17a-3235-47de-b7de-4fbbb10abfb7" released by "_copy_volume_from_snapshot" :: held 11.823s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:25:04 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-502a5918-bad8-4e16-9c95-73d4ec51abd5 tempest-TestInstancesWithCinderVolumes-634922416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6378bee9-44bb-425c-92c6-31b534e0da40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:25:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-830104823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55d9a812-0a88-4ae0-8a9a-82254ec66c2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='128a3be4a591459eaa97416ed2428af7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:25:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:25:04Z,use_quota=True,user_id='bf9ea8e824db4b97a752e1a8b1eaf0d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57fed57d-fc0f-4034-9ffc-e887bb9c108e),volume_type_id=57fed57d-fc0f-4034-9ffc-e887bb9c108e)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:25:04 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-502a5918-bad8-4e16-9c95-73d4ec51abd5 tempest-TestInstancesWithCinderVolumes-634922416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90cc17ba-5f49-4e5b-ad51-60b4bf27e9ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:25:04 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-502a5918-bad8-4e16-9c95-73d4ec51abd5 tempest-TestInstancesWithCinderVolumes-634922416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90cc17ba-5f49-4e5b-ad51-60b4bf27e9ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:25:04 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-502a5918-bad8-4e16-9c95-73d4ec51abd5 tempest-TestInstancesWithCinderVolumes-634922416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58083efe-de7a-44d2-9e89-ebf3108cbefb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:25:04 devstack cinder-volume[84448]: DEBUG cinder.image.glance [None req-502a5918-bad8-4e16-9c95-73d4ec51abd5 tempest-TestInstancesWithCinderVolumes-634922416 None] Creating Keystone auth plugin from conf {{(pid=84448) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 29 15:25:04 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-0782f188-e486-4919-894c-b34691c952d9 tempest-TestStampPattern-538910304 None] Lock "cinder-quobyte-e3afcf32-738d-4ee3-b193-7303a7e0b0ab-b062e17a-3235-47de-b7de-4fbbb10abfb7" released by "_create_volume_from_snapshot" :: held 11.896s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:25:04 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-0782f188-e486-4919-894c-b34691c952d9 tempest-TestStampPattern-538910304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.937s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:25:04 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-b783d531-c738-4924-82f3-1ab562430724 tempest-VolumesExtendTest-1443083602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.264s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:25:04 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-b783d531-c738-4924-82f3-1ab562430724 tempest-VolumesExtendTest-1443083602 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:24:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-743668518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d4ac517-2cd7-40c2-9d7b-1365ee542450,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96ebabd973414507bdc3adc8d2a05a09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:24:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:24:58Z,use_quota=True,user_id='06908ea582014412b6cdebc368643b01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:25:04 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-b783d531-c738-4924-82f3-1ab562430724 tempest-VolumesExtendTest-1443083602 None] Creating volume 1d4ac517-2cd7-40c2-9d7b-1365ee542450 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:25:04 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-b783d531-c738-4924-82f3-1ab562430724 tempest-VolumesExtendTest-1443083602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:25:04 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-b783d531-c738-4924-82f3-1ab562430724 tempest-VolumesExtendTest-1443083602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:25:04 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-b783d531-c738-4924-82f3-1ab562430724 tempest-VolumesExtendTest-1443083602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:25:04 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-b783d531-c738-4924-82f3-1ab562430724 tempest-VolumesExtendTest-1443083602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:25:04 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-b783d531-c738-4924-82f3-1ab562430724 tempest-VolumesExtendTest-1443083602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:25:04 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-b783d531-c738-4924-82f3-1ab562430724 tempest-VolumesExtendTest-1443083602 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:25:04 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-b783d531-c738-4924-82f3-1ab562430724 tempest-VolumesExtendTest-1443083602 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:25:04 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-b783d531-c738-4924-82f3-1ab562430724 tempest-VolumesExtendTest-1443083602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1d4ac517-2cd7-40c2-9d7b-1365ee542450 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:25:04 devstack sudo[104346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1d4ac517-2cd7-40c2-9d7b-1365ee542450 1073741824 Apr 29 15:25:04 devstack sudo[104346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:25:04 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-0782f188-e486-4919-894c-b34691c952d9 tempest-TestStampPattern-538910304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35b6675a-f6a7-4593-995c-7d3a556c7394) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b062e17a-3235-47de-b7de-4fbbb10abfb7', 'volume_size': 1, 'snapshot_id': 'e3afcf32-738d-4ee3-b193-7303a7e0b0ab'}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:25:04 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-0782f188-e486-4919-894c-b34691c952d9 tempest-TestStampPattern-538910304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01737db9-6444-440a-a3ea-41208c355af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:25:04 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-0782f188-e486-4919-894c-b34691c952d9 tempest-TestStampPattern-538910304 None] Volume volume-b062e17a-3235-47de-b7de-4fbbb10abfb7 (b062e17a-3235-47de-b7de-4fbbb10abfb7): created successfully Apr 29 15:25:04 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-0782f188-e486-4919-894c-b34691c952d9 tempest-TestStampPattern-538910304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01737db9-6444-440a-a3ea-41208c355af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:25:04 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-0782f188-e486-4919-894c-b34691c952d9 tempest-TestStampPattern-538910304 None] Flow 'volume_create_manager' (5c2d146f-eb6b-4797-8f94-ae089d437949) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:25:04 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-0782f188-e486-4919-894c-b34691c952d9 tempest-TestStampPattern-538910304 None] Created volume successfully. Apr 29 15:25:04 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-502a5918-bad8-4e16-9c95-73d4ec51abd5 tempest-TestInstancesWithCinderVolumes-634922416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58083efe-de7a-44d2-9e89-ebf3108cbefb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '55d9a812-0a88-4ae0-8a9a-82254ec66c2d', 'volume_name': 'volume-55d9a812-0a88-4ae0-8a9a-82254ec66c2d', 'volume_size': 1, 'image_id': '0c9bd9f5-40ac-42ac-bf1e-f318bfa206f6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0c9bd9f5-40ac-42ac-bf1e-f318bfa206f6', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1059369632', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '128a3be4a591459eaa97416ed2428af7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0c9bd9f5-40ac-42ac-bf1e-f318bfa206f6', 'created_at': datetime.datetime(2026, 4, 29, 13, 24, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 13, 25, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0c9bd9f5-40ac-42ac-bf1e-f318bfa206f6/file', 'properties': {}}, 'image_service': }' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:25:04 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-502a5918-bad8-4e16-9c95-73d4ec51abd5 tempest-TestInstancesWithCinderVolumes-634922416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28a930ca-d532-47bd-a1b4-31e2cb0fcdab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:25:04 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-502a5918-bad8-4e16-9c95-73d4ec51abd5 tempest-TestInstancesWithCinderVolumes-634922416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28a930ca-d532-47bd-a1b4-31e2cb0fcdab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:25:04 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-502a5918-bad8-4e16-9c95-73d4ec51abd5 tempest-TestInstancesWithCinderVolumes-634922416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec4c9e2d-001a-4740-8fd3-1d0b3c4eaaf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:25:04 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-502a5918-bad8-4e16-9c95-73d4ec51abd5 tempest-TestInstancesWithCinderVolumes-634922416 None] Volume 55d9a812-0a88-4ae0-8a9a-82254ec66c2d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-55d9a812-0a88-4ae0-8a9a-82254ec66c2d', 'volume_size': 1, 'image_id': '0c9bd9f5-40ac-42ac-bf1e-f318bfa206f6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0c9bd9f5-40ac-42ac-bf1e-f318bfa206f6', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1059369632', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '128a3be4a591459eaa97416ed2428af7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0c9bd9f5-40ac-42ac-bf1e-f318bfa206f6', 'created_at': datetime.datetime(2026, 4, 29, 13, 24, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 13, 25, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0c9bd9f5-40ac-42ac-bf1e-f318bfa206f6/file', 'properties': {}}, 'image_service': } Apr 29 15:25:04 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-502a5918-bad8-4e16-9c95-73d4ec51abd5 tempest-TestInstancesWithCinderVolumes-634922416 None] Trying to clone 55d9a812-0a88-4ae0-8a9a-82254ec66c2d from image 0c9bd9f5-40ac-42ac-bf1e-f318bfa206f6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0c9bd9f5-40ac-42ac-bf1e-f318bfa206f6', 'metadata': {}}]). {{(pid=84448) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 29 15:25:05 devstack sudo[104346]: pam_unix(sudo:session): session closed for user root Apr 29 15:25:05 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-b783d531-c738-4924-82f3-1ab562430724 tempest-VolumesExtendTest-1443083602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1d4ac517-2cd7-40c2-9d7b-1365ee542450 1073741824" returned: 0 in 0.832s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:25:05 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-b783d531-c738-4924-82f3-1ab562430724 tempest-VolumesExtendTest-1443083602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1d4ac517-2cd7-40c2-9d7b-1365ee542450 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:25:05 devstack sudo[104354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1d4ac517-2cd7-40c2-9d7b-1365ee542450 Apr 29 15:25:05 devstack sudo[104354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:25:05 devstack sudo[104354]: pam_unix(sudo:session): session closed for user root Apr 29 15:25:05 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-b783d531-c738-4924-82f3-1ab562430724 tempest-VolumesExtendTest-1443083602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1d4ac517-2cd7-40c2-9d7b-1365ee542450" returned: 0 in 0.703s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:25:05 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-b783d531-c738-4924-82f3-1ab562430724 tempest-VolumesExtendTest-1443083602 None] <== create_volume: return (1581ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:25:05 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-b783d531-c738-4924-82f3-1ab562430724 tempest-VolumesExtendTest-1443083602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.583s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:25:05 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-64a03b04-781e-4b47-a13f-8a4317c2e51e tempest-TestInstancesWithCinderVolumes-634922416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.870s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:25:05 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-64a03b04-781e-4b47-a13f-8a4317c2e51e tempest-TestInstancesWithCinderVolumes-634922416 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:25:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1157144417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72578478-516d-4a91-ae69-d068d73653cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='128a3be4a591459eaa97416ed2428af7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:25:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:25:03Z,use_quota=True,user_id='bf9ea8e824db4b97a752e1a8b1eaf0d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa8dc660-39ca-48d2-84de-f5a9c5aa9a6c),volume_type_id=fa8dc660-39ca-48d2-84de-f5a9c5aa9a6c)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:25:05 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-64a03b04-781e-4b47-a13f-8a4317c2e51e tempest-TestInstancesWithCinderVolumes-634922416 None] Creating volume 72578478-516d-4a91-ae69-d068d73653cd {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:25:05 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-64a03b04-781e-4b47-a13f-8a4317c2e51e tempest-TestInstancesWithCinderVolumes-634922416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:25:05 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-64a03b04-781e-4b47-a13f-8a4317c2e51e tempest-TestInstancesWithCinderVolumes-634922416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:25:05 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-64a03b04-781e-4b47-a13f-8a4317c2e51e tempest-TestInstancesWithCinderVolumes-634922416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:25:05 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-64a03b04-781e-4b47-a13f-8a4317c2e51e tempest-TestInstancesWithCinderVolumes-634922416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:25:05 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-64a03b04-781e-4b47-a13f-8a4317c2e51e tempest-TestInstancesWithCinderVolumes-634922416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:25:05 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-64a03b04-781e-4b47-a13f-8a4317c2e51e tempest-TestInstancesWithCinderVolumes-634922416 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:25:05 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-64a03b04-781e-4b47-a13f-8a4317c2e51e tempest-TestInstancesWithCinderVolumes-634922416 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:25:05 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-64a03b04-781e-4b47-a13f-8a4317c2e51e tempest-TestInstancesWithCinderVolumes-634922416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-72578478-516d-4a91-ae69-d068d73653cd 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:25:06 devstack sudo[104358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-72578478-516d-4a91-ae69-d068d73653cd 1073741824 Apr 29 15:25:06 devstack sudo[104358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:25:06 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b783d531-c738-4924-82f3-1ab562430724 tempest-VolumesExtendTest-1443083602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77e5508e-8803-44d5-8d14-2d3152521f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d4ac517-2cd7-40c2-9d7b-1365ee542450', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:25:06 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b783d531-c738-4924-82f3-1ab562430724 tempest-VolumesExtendTest-1443083602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c36d11d1-21b5-4c7d-9e28-e1891d2261f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:25:06 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-b783d531-c738-4924-82f3-1ab562430724 tempest-VolumesExtendTest-1443083602 None] Volume volume-1d4ac517-2cd7-40c2-9d7b-1365ee542450 (1d4ac517-2cd7-40c2-9d7b-1365ee542450): created successfully Apr 29 15:25:06 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b783d531-c738-4924-82f3-1ab562430724 tempest-VolumesExtendTest-1443083602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c36d11d1-21b5-4c7d-9e28-e1891d2261f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:25:06 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b783d531-c738-4924-82f3-1ab562430724 tempest-VolumesExtendTest-1443083602 None] Flow 'volume_create_manager' (03ee4ed6-b7e7-479f-b478-4612f84625be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:25:06 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-b783d531-c738-4924-82f3-1ab562430724 tempest-VolumesExtendTest-1443083602 None] Created volume successfully. Apr 29 15:25:06 devstack sudo[104358]: pam_unix(sudo:session): session closed for user root Apr 29 15:25:06 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-64a03b04-781e-4b47-a13f-8a4317c2e51e tempest-TestInstancesWithCinderVolumes-634922416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-72578478-516d-4a91-ae69-d068d73653cd 1073741824" returned: 0 in 0.846s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:25:06 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-64a03b04-781e-4b47-a13f-8a4317c2e51e tempest-TestInstancesWithCinderVolumes-634922416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-72578478-516d-4a91-ae69-d068d73653cd {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:25:06 devstack sudo[104371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-72578478-516d-4a91-ae69-d068d73653cd Apr 29 15:25:06 devstack sudo[104371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:25:07 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-6a3825ee-41f2-47df-8df3-afb32284bbab tempest-VolumesExtendTest-1443083602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:25:07 devstack sudo[104371]: pam_unix(sudo:session): session closed for user root Apr 29 15:25:07 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-64a03b04-781e-4b47-a13f-8a4317c2e51e tempest-TestInstancesWithCinderVolumes-634922416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-72578478-516d-4a91-ae69-d068d73653cd" returned: 0 in 0.682s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:25:07 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-64a03b04-781e-4b47-a13f-8a4317c2e51e tempest-TestInstancesWithCinderVolumes-634922416 None] <== create_volume: return (1578ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:25:07 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-64a03b04-781e-4b47-a13f-8a4317c2e51e tempest-TestInstancesWithCinderVolumes-634922416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.581s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:25:07 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-74d09ca2-4ee7-45c6-93b7-20720b27c912 tempest-TestInstancesWithCinderVolumes-634922416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.828s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:25:07 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-74d09ca2-4ee7-45c6-93b7-20720b27c912 tempest-TestInstancesWithCinderVolumes-634922416 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:25:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1034292685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61771c01-1179-41e9-8c96-337301e21803,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='128a3be4a591459eaa97416ed2428af7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:25:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:25:04Z,use_quota=True,user_id='bf9ea8e824db4b97a752e1a8b1eaf0d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94456f81-00e4-45a3-a8aa-3ffdec7ab763),volume_type_id=94456f81-00e4-45a3-a8aa-3ffdec7ab763)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:25:07 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-74d09ca2-4ee7-45c6-93b7-20720b27c912 tempest-TestInstancesWithCinderVolumes-634922416 None] Creating volume 61771c01-1179-41e9-8c96-337301e21803 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:25:07 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-74d09ca2-4ee7-45c6-93b7-20720b27c912 tempest-TestInstancesWithCinderVolumes-634922416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:25:07 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-74d09ca2-4ee7-45c6-93b7-20720b27c912 tempest-TestInstancesWithCinderVolumes-634922416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:25:07 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-74d09ca2-4ee7-45c6-93b7-20720b27c912 tempest-TestInstancesWithCinderVolumes-634922416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:25:07 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-74d09ca2-4ee7-45c6-93b7-20720b27c912 tempest-TestInstancesWithCinderVolumes-634922416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:25:07 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-74d09ca2-4ee7-45c6-93b7-20720b27c912 tempest-TestInstancesWithCinderVolumes-634922416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:25:07 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-74d09ca2-4ee7-45c6-93b7-20720b27c912 tempest-TestInstancesWithCinderVolumes-634922416 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:25:07 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-74d09ca2-4ee7-45c6-93b7-20720b27c912 tempest-TestInstancesWithCinderVolumes-634922416 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:25:07 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-74d09ca2-4ee7-45c6-93b7-20720b27c912 tempest-TestInstancesWithCinderVolumes-634922416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-61771c01-1179-41e9-8c96-337301e21803 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:25:07 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-64a03b04-781e-4b47-a13f-8a4317c2e51e tempest-TestInstancesWithCinderVolumes-634922416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (816dab2e-d79e-433e-a499-9905746c0e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72578478-516d-4a91-ae69-d068d73653cd', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:25:07 devstack sudo[104374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-61771c01-1179-41e9-8c96-337301e21803 1073741824 Apr 29 15:25:07 devstack sudo[104374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:25:07 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-64a03b04-781e-4b47-a13f-8a4317c2e51e tempest-TestInstancesWithCinderVolumes-634922416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b63960f-4f9e-4c9e-9351-1e429e763eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:25:07 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-64a03b04-781e-4b47-a13f-8a4317c2e51e tempest-TestInstancesWithCinderVolumes-634922416 None] Volume volume-72578478-516d-4a91-ae69-d068d73653cd (72578478-516d-4a91-ae69-d068d73653cd): created successfully Apr 29 15:25:07 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-64a03b04-781e-4b47-a13f-8a4317c2e51e tempest-TestInstancesWithCinderVolumes-634922416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b63960f-4f9e-4c9e-9351-1e429e763eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:25:07 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-64a03b04-781e-4b47-a13f-8a4317c2e51e tempest-TestInstancesWithCinderVolumes-634922416 None] Flow 'volume_create_manager' (cf5002a0-d007-480c-93a7-f3f1171034dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:25:07 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-64a03b04-781e-4b47-a13f-8a4317c2e51e tempest-TestInstancesWithCinderVolumes-634922416 None] Created volume successfully. Apr 29 15:25:08 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [None req-502a5918-bad8-4e16-9c95-73d4ec51abd5 tempest-TestInstancesWithCinderVolumes-634922416 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0c9bd9f5-40ac-42ac-bf1e-f318bfa206f6_ffwh0zk4devstack@QuobyteHD, size 20.69 MB, duration 3.60 sec {{(pid=84448) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 29 15:25:08 devstack cinder-volume[84448]: INFO cinder.image.image_utils [None req-502a5918-bad8-4e16-9c95-73d4ec51abd5 tempest-TestInstancesWithCinderVolumes-634922416 None] Image download 20.69 MB at 5.75 MB/s Apr 29 15:25:08 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1027f75-15f8-4478-bac2-495ff59fcbd2]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:25:08 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-502a5918-bad8-4e16-9c95-73d4ec51abd5 tempest-TestInstancesWithCinderVolumes-634922416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c9bd9f5-40ac-42ac-bf1e-f318bfa206f6_ffwh0zk4devstack@QuobyteHD {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:25:08 devstack sudo[104374]: pam_unix(sudo:session): session closed for user root Apr 29 15:25:08 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-74d09ca2-4ee7-45c6-93b7-20720b27c912 tempest-TestInstancesWithCinderVolumes-634922416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-61771c01-1179-41e9-8c96-337301e21803 1073741824" returned: 0 in 0.818s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:25:08 devstack sudo[104380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c9bd9f5-40ac-42ac-bf1e-f318bfa206f6_ffwh0zk4devstack@QuobyteHD Apr 29 15:25:08 devstack sudo[104380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:25:08 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-74d09ca2-4ee7-45c6-93b7-20720b27c912 tempest-TestInstancesWithCinderVolumes-634922416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-61771c01-1179-41e9-8c96-337301e21803 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:25:08 devstack sudo[104414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-61771c01-1179-41e9-8c96-337301e21803 Apr 29 15:25:08 devstack sudo[104414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:25:09 devstack sudo[104414]: pam_unix(sudo:session): session closed for user root Apr 29 15:25:09 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-74d09ca2-4ee7-45c6-93b7-20720b27c912 tempest-TestInstancesWithCinderVolumes-634922416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-61771c01-1179-41e9-8c96-337301e21803" returned: 0 in 1.035s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:25:09 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-74d09ca2-4ee7-45c6-93b7-20720b27c912 tempest-TestInstancesWithCinderVolumes-634922416 None] <== create_volume: return (1953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:25:09 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-74d09ca2-4ee7-45c6-93b7-20720b27c912 tempest-TestInstancesWithCinderVolumes-634922416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.956s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:25:09 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-6a3825ee-41f2-47df-8df3-afb32284bbab tempest-VolumesExtendTest-1443083602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.339s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:25:09 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-74d09ca2-4ee7-45c6-93b7-20720b27c912 tempest-TestInstancesWithCinderVolumes-634922416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40e6e6be-69e6-4aba-ac43-7d5715568436) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61771c01-1179-41e9-8c96-337301e21803', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:25:09 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-74d09ca2-4ee7-45c6-93b7-20720b27c912 tempest-TestInstancesWithCinderVolumes-634922416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf51a9b7-39f7-49e7-afc0-6f8bebfd7540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:25:09 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-6a3825ee-41f2-47df-8df3-afb32284bbab tempest-VolumesExtendTest-1443083602 None] Creating offline snapshot 52981b68-3cf4-4692-ba4d-49e00e35911f of volume 1d4ac517-2cd7-40c2-9d7b-1365ee542450 {{(pid=84448) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 15:25:09 devstack sudo[104380]: pam_unix(sudo:session): session closed for user root Apr 29 15:25:09 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-502a5918-bad8-4e16-9c95-73d4ec51abd5 tempest-TestInstancesWithCinderVolumes-634922416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c9bd9f5-40ac-42ac-bf1e-f318bfa206f6_ffwh0zk4devstack@QuobyteHD" returned: 0 in 1.277s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:25:09 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [None req-502a5918-bad8-4e16-9c95-73d4ec51abd5 tempest-TestInstancesWithCinderVolumes-634922416 None] Temporary image 0c9bd9f5-40ac-42ac-bf1e-f318bfa206f6 is fetched for user bf9ea8e824db4b97a752e1a8b1eaf0d2. {{(pid=84448) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 29 15:25:09 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-74d09ca2-4ee7-45c6-93b7-20720b27c912 tempest-TestInstancesWithCinderVolumes-634922416 None] Volume volume-61771c01-1179-41e9-8c96-337301e21803 (61771c01-1179-41e9-8c96-337301e21803): created successfully Apr 29 15:25:09 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-74d09ca2-4ee7-45c6-93b7-20720b27c912 tempest-TestInstancesWithCinderVolumes-634922416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf51a9b7-39f7-49e7-afc0-6f8bebfd7540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:25:09 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-74d09ca2-4ee7-45c6-93b7-20720b27c912 tempest-TestInstancesWithCinderVolumes-634922416 None] Flow 'volume_create_manager' (139e522c-1147-491b-ad50-53a261627dc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:25:09 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[7794de01-2cf3-4272-8306-22892eb5abb8]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:25:09 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6a3825ee-41f2-47df-8df3-afb32284bbab tempest-VolumesExtendTest-1443083602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1d4ac517-2cd7-40c2-9d7b-1365ee542450 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:25:09 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-74d09ca2-4ee7-45c6-93b7-20720b27c912 tempest-TestInstancesWithCinderVolumes-634922416 None] Created volume successfully. Apr 29 15:25:09 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c01de34-b732-4c91-85ca-b9bef2da68ad]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:25:09 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-502a5918-bad8-4e16-9c95-73d4ec51abd5 tempest-TestInstancesWithCinderVolumes-634922416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c9bd9f5-40ac-42ac-bf1e-f318bfa206f6_ffwh0zk4devstack@QuobyteHD {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:25:09 devstack sudo[104757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1d4ac517-2cd7-40c2-9d7b-1365ee542450 Apr 29 15:25:09 devstack sudo[104757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:25:09 devstack sudo[104768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c9bd9f5-40ac-42ac-bf1e-f318bfa206f6_ffwh0zk4devstack@QuobyteHD Apr 29 15:25:09 devstack sudo[104768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:25:10 devstack sudo[104768]: pam_unix(sudo:session): session closed for user root Apr 29 15:25:10 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-502a5918-bad8-4e16-9c95-73d4ec51abd5 tempest-TestInstancesWithCinderVolumes-634922416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c9bd9f5-40ac-42ac-bf1e-f318bfa206f6_ffwh0zk4devstack@QuobyteHD" returned: 0 in 0.886s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:25:10 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-502a5918-bad8-4e16-9c95-73d4ec51abd5 tempest-TestInstancesWithCinderVolumes-634922416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:25:10 devstack sudo[104757]: pam_unix(sudo:session): session closed for user root Apr 29 15:25:10 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6a3825ee-41f2-47df-8df3-afb32284bbab tempest-VolumesExtendTest-1443083602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1d4ac517-2cd7-40c2-9d7b-1365ee542450" returned: 0 in 0.990s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:25:10 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6a3825ee-41f2-47df-8df3-afb32284bbab tempest-VolumesExtendTest-1443083602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1d4ac517-2cd7-40c2-9d7b-1365ee542450,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1d4ac517-2cd7-40c2-9d7b-1365ee542450.52981b68-3cf4-4692-ba4d-49e00e35911f 1G {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:25:10 devstack sudo[104779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1d4ac517-2cd7-40c2-9d7b-1365ee542450,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1d4ac517-2cd7-40c2-9d7b-1365ee542450.52981b68-3cf4-4692-ba4d-49e00e35911f 1G Apr 29 15:25:10 devstack sudo[104779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:25:11 devstack sudo[104779]: pam_unix(sudo:session): session closed for user root Apr 29 15:25:11 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6a3825ee-41f2-47df-8df3-afb32284bbab tempest-VolumesExtendTest-1443083602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1d4ac517-2cd7-40c2-9d7b-1365ee542450,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1d4ac517-2cd7-40c2-9d7b-1365ee542450.52981b68-3cf4-4692-ba4d-49e00e35911f 1G" returned: 0 in 0.904s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:25:11 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6a3825ee-41f2-47df-8df3-afb32284bbab tempest-VolumesExtendTest-1443083602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d4ac517-2cd7-40c2-9d7b-1365ee542450 -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1d4ac517-2cd7-40c2-9d7b-1365ee542450.52981b68-3cf4-4692-ba4d-49e00e35911f {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:25:11 devstack sudo[104786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d4ac517-2cd7-40c2-9d7b-1365ee542450 -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1d4ac517-2cd7-40c2-9d7b-1365ee542450.52981b68-3cf4-4692-ba4d-49e00e35911f Apr 29 15:25:11 devstack sudo[104786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:25:12 devstack sudo[104786]: pam_unix(sudo:session): session closed for user root Apr 29 15:25:12 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6a3825ee-41f2-47df-8df3-afb32284bbab tempest-VolumesExtendTest-1443083602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d4ac517-2cd7-40c2-9d7b-1365ee542450 -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1d4ac517-2cd7-40c2-9d7b-1365ee542450.52981b68-3cf4-4692-ba4d-49e00e35911f" returned: 0 in 0.776s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:25:12 devstack cinder-volume[84448]: WARNING cinder.volume.drivers.remotefs [None req-6a3825ee-41f2-47df-8df3-afb32284bbab tempest-VolumesExtendTest-1443083602 None] /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1d4ac517-2cd7-40c2-9d7b-1365ee542450.52981b68-3cf4-4692-ba4d-49e00e35911f is being set with open permissions: ugo+rw Apr 29 15:25:12 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6a3825ee-41f2-47df-8df3-afb32284bbab tempest-VolumesExtendTest-1443083602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1d4ac517-2cd7-40c2-9d7b-1365ee542450.52981b68-3cf4-4692-ba4d-49e00e35911f {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:25:12 devstack sudo[104792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1d4ac517-2cd7-40c2-9d7b-1365ee542450.52981b68-3cf4-4692-ba4d-49e00e35911f Apr 29 15:25:12 devstack sudo[104792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:25:12 devstack sudo[104792]: pam_unix(sudo:session): session closed for user root Apr 29 15:25:12 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6a3825ee-41f2-47df-8df3-afb32284bbab tempest-VolumesExtendTest-1443083602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1d4ac517-2cd7-40c2-9d7b-1365ee542450.52981b68-3cf4-4692-ba4d-49e00e35911f" returned: 0 in 0.664s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:25:13 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6a3825ee-41f2-47df-8df3-afb32284bbab tempest-VolumesExtendTest-1443083602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1d4ac517-2cd7-40c2-9d7b-1365ee542450.info {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:25:13 devstack sudo[104795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1d4ac517-2cd7-40c2-9d7b-1365ee542450.info Apr 29 15:25:13 devstack sudo[104795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:25:13 devstack sudo[104795]: pam_unix(sudo:session): session closed for user root Apr 29 15:25:13 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6a3825ee-41f2-47df-8df3-afb32284bbab tempest-VolumesExtendTest-1443083602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1d4ac517-2cd7-40c2-9d7b-1365ee542450.info" returned: 0 in 0.626s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:25:13 devstack cinder-volume[84448]: WARNING cinder.volume.drivers.remotefs [None req-6a3825ee-41f2-47df-8df3-afb32284bbab tempest-VolumesExtendTest-1443083602 None] /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1d4ac517-2cd7-40c2-9d7b-1365ee542450.info is being set with open permissions: ugo+rw Apr 29 15:25:13 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6a3825ee-41f2-47df-8df3-afb32284bbab tempest-VolumesExtendTest-1443083602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1d4ac517-2cd7-40c2-9d7b-1365ee542450.info {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:25:13 devstack sudo[104798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1d4ac517-2cd7-40c2-9d7b-1365ee542450.info Apr 29 15:25:13 devstack sudo[104798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:25:14 devstack sudo[104798]: pam_unix(sudo:session): session closed for user root Apr 29 15:25:14 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6a3825ee-41f2-47df-8df3-afb32284bbab tempest-VolumesExtendTest-1443083602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1d4ac517-2cd7-40c2-9d7b-1365ee542450.info" returned: 0 in 0.766s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:25:14 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-6a3825ee-41f2-47df-8df3-afb32284bbab tempest-VolumesExtendTest-1443083602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.921s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:25:14 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-502a5918-bad8-4e16-9c95-73d4ec51abd5 tempest-TestInstancesWithCinderVolumes-634922416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.854s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:25:14 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-502a5918-bad8-4e16-9c95-73d4ec51abd5 tempest-TestInstancesWithCinderVolumes-634922416 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:25:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-830104823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55d9a812-0a88-4ae0-8a9a-82254ec66c2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='128a3be4a591459eaa97416ed2428af7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:25:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:25:04Z,use_quota=True,user_id='bf9ea8e824db4b97a752e1a8b1eaf0d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57fed57d-fc0f-4034-9ffc-e887bb9c108e),volume_type_id=57fed57d-fc0f-4034-9ffc-e887bb9c108e)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:25:14 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-502a5918-bad8-4e16-9c95-73d4ec51abd5 tempest-TestInstancesWithCinderVolumes-634922416 None] Creating volume 55d9a812-0a88-4ae0-8a9a-82254ec66c2d {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:25:14 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-502a5918-bad8-4e16-9c95-73d4ec51abd5 tempest-TestInstancesWithCinderVolumes-634922416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:25:14 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-502a5918-bad8-4e16-9c95-73d4ec51abd5 tempest-TestInstancesWithCinderVolumes-634922416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:25:14 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-502a5918-bad8-4e16-9c95-73d4ec51abd5 tempest-TestInstancesWithCinderVolumes-634922416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:25:14 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-502a5918-bad8-4e16-9c95-73d4ec51abd5 tempest-TestInstancesWithCinderVolumes-634922416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:25:14 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-502a5918-bad8-4e16-9c95-73d4ec51abd5 tempest-TestInstancesWithCinderVolumes-634922416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:25:14 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-502a5918-bad8-4e16-9c95-73d4ec51abd5 tempest-TestInstancesWithCinderVolumes-634922416 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:25:14 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-502a5918-bad8-4e16-9c95-73d4ec51abd5 tempest-TestInstancesWithCinderVolumes-634922416 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:25:14 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-502a5918-bad8-4e16-9c95-73d4ec51abd5 tempest-TestInstancesWithCinderVolumes-634922416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-55d9a812-0a88-4ae0-8a9a-82254ec66c2d 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:25:14 devstack sudo[104889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-55d9a812-0a88-4ae0-8a9a-82254ec66c2d 1073741824 Apr 29 15:25:14 devstack sudo[104889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:25:14 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-6a3825ee-41f2-47df-8df3-afb32284bbab tempest-VolumesExtendTest-1443083602 None] Create snapshot completed successfully Apr 29 15:25:15 devstack sudo[104889]: pam_unix(sudo:session): session closed for user root Apr 29 15:25:15 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-502a5918-bad8-4e16-9c95-73d4ec51abd5 tempest-TestInstancesWithCinderVolumes-634922416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-55d9a812-0a88-4ae0-8a9a-82254ec66c2d 1073741824" returned: 0 in 0.870s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:25:15 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-502a5918-bad8-4e16-9c95-73d4ec51abd5 tempest-TestInstancesWithCinderVolumes-634922416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-55d9a812-0a88-4ae0-8a9a-82254ec66c2d {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:25:15 devstack sudo[104895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-55d9a812-0a88-4ae0-8a9a-82254ec66c2d Apr 29 15:25:15 devstack sudo[104895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:25:15 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-d385f483-daab-4168-b6c7-11a292bfe7de tempest-VolumesExtendTest-1443083602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:25:16 devstack sudo[104895]: pam_unix(sudo:session): session closed for user root Apr 29 15:25:16 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-502a5918-bad8-4e16-9c95-73d4ec51abd5 tempest-TestInstancesWithCinderVolumes-634922416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-55d9a812-0a88-4ae0-8a9a-82254ec66c2d" returned: 0 in 0.620s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:25:16 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-502a5918-bad8-4e16-9c95-73d4ec51abd5 tempest-TestInstancesWithCinderVolumes-634922416 None] <== create_volume: return (1536ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:25:16 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-502a5918-bad8-4e16-9c95-73d4ec51abd5 tempest-TestInstancesWithCinderVolumes-634922416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.543s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:25:16 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-d385f483-daab-4168-b6c7-11a292bfe7de tempest-VolumesExtendTest-1443083602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.295s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:25:16 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd468b6c-d97b-49f5-9350-133682979e0b]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:25:16 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-d385f483-daab-4168-b6c7-11a292bfe7de tempest-VolumesExtendTest-1443083602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1d4ac517-2cd7-40c2-9d7b-1365ee542450 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:25:16 devstack cinder-volume[84448]: DEBUG cinder.volume.volume_utils [None req-502a5918-bad8-4e16-9c95-73d4ec51abd5 tempest-TestInstancesWithCinderVolumes-634922416 None] Attempting download of 0c9bd9f5-40ac-42ac-bf1e-f318bfa206f6 ((None, [{'url': 'file:///opt/stack/data/glance/images/0c9bd9f5-40ac-42ac-bf1e-f318bfa206f6', 'metadata': {}}])) to volume 55d9a812-0a88-4ae0-8a9a-82254ec66c2d. {{(pid=84448) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 29 15:25:16 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd6528e-28ba-487c-b800-1629f4b78f3e]: (4, 'raw') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:25:16 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-502a5918-bad8-4e16-9c95-73d4ec51abd5 tempest-TestInstancesWithCinderVolumes-634922416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0c9bd9f5-40ac-42ac-bf1e-f318bfa206f6_odoivxso {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:25:16 devstack sudo[104899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1d4ac517-2cd7-40c2-9d7b-1365ee542450 Apr 29 15:25:16 devstack sudo[104899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:25:16 devstack sudo[104900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0c9bd9f5-40ac-42ac-bf1e-f318bfa206f6_odoivxso Apr 29 15:25:16 devstack sudo[104900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:25:16 devstack sudo[104899]: pam_unix(sudo:session): session closed for user root Apr 29 15:25:16 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-d385f483-daab-4168-b6c7-11a292bfe7de tempest-VolumesExtendTest-1443083602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1d4ac517-2cd7-40c2-9d7b-1365ee542450" returned: 0 in 0.778s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:25:16 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-d385f483-daab-4168-b6c7-11a292bfe7de tempest-VolumesExtendTest-1443083602 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1d4ac517-2cd7-40c2-9d7b-1365ee542450.52981b68-3cf4-4692-ba4d-49e00e35911f 2G {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:25:16 devstack sudo[104900]: pam_unix(sudo:session): session closed for user root Apr 29 15:25:16 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-502a5918-bad8-4e16-9c95-73d4ec51abd5 tempest-TestInstancesWithCinderVolumes-634922416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0c9bd9f5-40ac-42ac-bf1e-f318bfa206f6_odoivxso" returned: 0 in 0.769s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:25:16 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-502a5918-bad8-4e16-9c95-73d4ec51abd5 tempest-TestInstancesWithCinderVolumes-634922416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0c9bd9f5-40ac-42ac-bf1e-f318bfa206f6_odoivxso {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:25:16 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-d385f483-daab-4168-b6c7-11a292bfe7de tempest-VolumesExtendTest-1443083602 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1d4ac517-2cd7-40c2-9d7b-1365ee542450.52981b68-3cf4-4692-ba4d-49e00e35911f 2G" returned: 0 in 0.149s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:25:16 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-d385f483-daab-4168-b6c7-11a292bfe7de tempest-VolumesExtendTest-1443083602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.975s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:25:17 devstack sudo[104911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0c9bd9f5-40ac-42ac-bf1e-f318bfa206f6_odoivxso Apr 29 15:25:17 devstack sudo[104911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:25:17 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-d385f483-daab-4168-b6c7-11a292bfe7de tempest-VolumesExtendTest-1443083602 None] Extend volume completed successfully. Apr 29 15:25:17 devstack sudo[104911]: pam_unix(sudo:session): session closed for user root Apr 29 15:25:17 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-502a5918-bad8-4e16-9c95-73d4ec51abd5 tempest-TestInstancesWithCinderVolumes-634922416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0c9bd9f5-40ac-42ac-bf1e-f318bfa206f6_odoivxso" returned: 1 in 0.717s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:25:17 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-502a5918-bad8-4e16-9c95-73d4ec51abd5 tempest-TestInstancesWithCinderVolumes-634922416 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0c9bd9f5-40ac-42ac-bf1e-f318bfa206f6_odoivxso' failed. Not Retrying. {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 15:25:17 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e6ee5da-f5b7-46f0-996e-0e0a48ccf39e]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:25:17 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-502a5918-bad8-4e16-9c95-73d4ec51abd5 tempest-TestInstancesWithCinderVolumes-634922416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c9bd9f5-40ac-42ac-bf1e-f318bfa206f6_ffwh0zk4devstack@QuobyteHD {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:25:17 devstack sudo[104916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c9bd9f5-40ac-42ac-bf1e-f318bfa206f6_ffwh0zk4devstack@QuobyteHD Apr 29 15:25:17 devstack sudo[104916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:25:18 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-6728664d-dadc-4609-bb4f-e4450dfe0d2d tempest-VolumesExtendTest-1443083602 None] Acquiring lock "cinder-52981b68-3cf4-4692-ba4d-49e00e35911f-delete_snapshot" by "delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:25:18 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-6728664d-dadc-4609-bb4f-e4450dfe0d2d tempest-VolumesExtendTest-1443083602 None] Lock "cinder-52981b68-3cf4-4692-ba4d-49e00e35911f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:25:18 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-6728664d-dadc-4609-bb4f-e4450dfe0d2d tempest-VolumesExtendTest-1443083602 None] Acquiring lock "cinder-quobyte-1d4ac517-2cd7-40c2-9d7b-1365ee542450" by "delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:25:18 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-6728664d-dadc-4609-bb4f-e4450dfe0d2d tempest-VolumesExtendTest-1443083602 None] Lock "cinder-quobyte-1d4ac517-2cd7-40c2-9d7b-1365ee542450" acquired by "delete_snapshot" :: waited 0.019s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:25:18 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-6728664d-dadc-4609-bb4f-e4450dfe0d2d tempest-VolumesExtendTest-1443083602 None] Acquiring lock "cinder-quobyte-52981b68-3cf4-4692-ba4d-49e00e35911f" by "_delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:25:18 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-6728664d-dadc-4609-bb4f-e4450dfe0d2d tempest-VolumesExtendTest-1443083602 None] Lock "cinder-quobyte-52981b68-3cf4-4692-ba4d-49e00e35911f" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:25:18 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-6728664d-dadc-4609-bb4f-e4450dfe0d2d tempest-VolumesExtendTest-1443083602 None] Deleting offline snapshot 52981b68-3cf4-4692-ba4d-49e00e35911f of volume 1d4ac517-2cd7-40c2-9d7b-1365ee542450 {{(pid=84448) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 15:25:18 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-6728664d-dadc-4609-bb4f-e4450dfe0d2d tempest-VolumesExtendTest-1443083602 None] snapshot_file for this snap is: volume-1d4ac517-2cd7-40c2-9d7b-1365ee542450.52981b68-3cf4-4692-ba4d-49e00e35911f {{(pid=84448) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 15:25:18 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[0761ccfd-2059-4bff-814c-128ee0e46234]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:25:18 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6728664d-dadc-4609-bb4f-e4450dfe0d2d tempest-VolumesExtendTest-1443083602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1d4ac517-2cd7-40c2-9d7b-1365ee542450.52981b68-3cf4-4692-ba4d-49e00e35911f {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:25:18 devstack sudo[104918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1d4ac517-2cd7-40c2-9d7b-1365ee542450.52981b68-3cf4-4692-ba4d-49e00e35911f Apr 29 15:25:18 devstack sudo[104918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:25:18 devstack sudo[104916]: pam_unix(sudo:session): session closed for user root Apr 29 15:25:18 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-502a5918-bad8-4e16-9c95-73d4ec51abd5 tempest-TestInstancesWithCinderVolumes-634922416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c9bd9f5-40ac-42ac-bf1e-f318bfa206f6_ffwh0zk4devstack@QuobyteHD" returned: 0 in 0.809s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:25:18 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [None req-502a5918-bad8-4e16-9c95-73d4ec51abd5 tempest-TestInstancesWithCinderVolumes-634922416 None] 0c9bd9f5-40ac-42ac-bf1e-f318bfa206f6 was qcow2, converting to raw {{(pid=84448) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 29 15:25:18 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-502a5918-bad8-4e16-9c95-73d4ec51abd5 tempest-TestInstancesWithCinderVolumes-634922416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0c9bd9f5-40ac-42ac-bf1e-f318bfa206f6_ffwh0zk4devstack@QuobyteHD /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-55d9a812-0a88-4ae0-8a9a-82254ec66c2d {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:25:18 devstack sudo[104923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0c9bd9f5-40ac-42ac-bf1e-f318bfa206f6_ffwh0zk4devstack@QuobyteHD /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-55d9a812-0a88-4ae0-8a9a-82254ec66c2d Apr 29 15:25:18 devstack sudo[104923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:25:18 devstack sudo[104918]: pam_unix(sudo:session): session closed for user root Apr 29 15:25:18 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6728664d-dadc-4609-bb4f-e4450dfe0d2d tempest-VolumesExtendTest-1443083602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1d4ac517-2cd7-40c2-9d7b-1365ee542450.52981b68-3cf4-4692-ba4d-49e00e35911f" returned: 0 in 0.768s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:25:18 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-6728664d-dadc-4609-bb4f-e4450dfe0d2d tempest-VolumesExtendTest-1443083602 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d4ac517-2cd7-40c2-9d7b-1365ee542450(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84448) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 15:25:19 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[654f8a09-21c5-4cb3-a3bb-433b5b9e6350]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:25:19 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6728664d-dadc-4609-bb4f-e4450dfe0d2d tempest-VolumesExtendTest-1443083602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1d4ac517-2cd7-40c2-9d7b-1365ee542450 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:25:19 devstack sudo[104931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1d4ac517-2cd7-40c2-9d7b-1365ee542450 Apr 29 15:25:19 devstack sudo[104931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:25:19 devstack sudo[104931]: pam_unix(sudo:session): session closed for user root Apr 29 15:25:19 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6728664d-dadc-4609-bb4f-e4450dfe0d2d tempest-VolumesExtendTest-1443083602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1d4ac517-2cd7-40c2-9d7b-1365ee542450" returned: 0 in 0.901s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:25:19 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6728664d-dadc-4609-bb4f-e4450dfe0d2d tempest-VolumesExtendTest-1443083602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1d4ac517-2cd7-40c2-9d7b-1365ee542450.52981b68-3cf4-4692-ba4d-49e00e35911f {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:25:19 devstack sudo[104945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1d4ac517-2cd7-40c2-9d7b-1365ee542450.52981b68-3cf4-4692-ba4d-49e00e35911f Apr 29 15:25:19 devstack sudo[104945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:25:20 devstack sudo[104923]: pam_unix(sudo:session): session closed for user root Apr 29 15:25:20 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-502a5918-bad8-4e16-9c95-73d4ec51abd5 tempest-TestInstancesWithCinderVolumes-634922416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0c9bd9f5-40ac-42ac-bf1e-f318bfa206f6_ffwh0zk4devstack@QuobyteHD /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-55d9a812-0a88-4ae0-8a9a-82254ec66c2d" returned: 0 in 1.926s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:25:20 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [None req-502a5918-bad8-4e16-9c95-73d4ec51abd5 tempest-TestInstancesWithCinderVolumes-634922416 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0c9bd9f5-40ac-42ac-bf1e-f318bfa206f6_ffwh0zk4devstack@QuobyteHD, size 112.00 MB, duration 1.93 sec, destination /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-55d9a812-0a88-4ae0-8a9a-82254ec66c2d {{(pid=84448) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 15:25:20 devstack cinder-volume[84448]: INFO cinder.image.image_utils [None req-502a5918-bad8-4e16-9c95-73d4ec51abd5 tempest-TestInstancesWithCinderVolumes-634922416 None] Converted 112.00 MB image at 58.11 MB/s Apr 29 15:25:20 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-502a5918-bad8-4e16-9c95-73d4ec51abd5 tempest-TestInstancesWithCinderVolumes-634922416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-55d9a812-0a88-4ae0-8a9a-82254ec66c2d 1G {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:25:20 devstack sudo[104947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-55d9a812-0a88-4ae0-8a9a-82254ec66c2d 1G Apr 29 15:25:20 devstack sudo[104947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:25:20 devstack sudo[104945]: pam_unix(sudo:session): session closed for user root Apr 29 15:25:20 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6728664d-dadc-4609-bb4f-e4450dfe0d2d tempest-VolumesExtendTest-1443083602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1d4ac517-2cd7-40c2-9d7b-1365ee542450.52981b68-3cf4-4692-ba4d-49e00e35911f" returned: 0 in 0.765s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:25:20 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6728664d-dadc-4609-bb4f-e4450dfe0d2d tempest-VolumesExtendTest-1443083602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1d4ac517-2cd7-40c2-9d7b-1365ee542450.52981b68-3cf4-4692-ba4d-49e00e35911f {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:25:20 devstack sudo[104953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1d4ac517-2cd7-40c2-9d7b-1365ee542450.52981b68-3cf4-4692-ba4d-49e00e35911f Apr 29 15:25:20 devstack sudo[104953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:25:21 devstack sudo[104947]: pam_unix(sudo:session): session closed for user root Apr 29 15:25:21 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-502a5918-bad8-4e16-9c95-73d4ec51abd5 tempest-TestInstancesWithCinderVolumes-634922416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-55d9a812-0a88-4ae0-8a9a-82254ec66c2d 1G" returned: 0 in 0.665s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:25:21 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b1e56b6-ab8d-4d4f-aadd-d676bfef948a]: (4, 'raw') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:25:21 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-502a5918-bad8-4e16-9c95-73d4ec51abd5 tempest-TestInstancesWithCinderVolumes-634922416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-55d9a812-0a88-4ae0-8a9a-82254ec66c2d {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:25:21 devstack sudo[104958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-55d9a812-0a88-4ae0-8a9a-82254ec66c2d Apr 29 15:25:21 devstack sudo[104958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:25:21 devstack sudo[104953]: pam_unix(sudo:session): session closed for user root Apr 29 15:25:21 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6728664d-dadc-4609-bb4f-e4450dfe0d2d tempest-VolumesExtendTest-1443083602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1d4ac517-2cd7-40c2-9d7b-1365ee542450.52981b68-3cf4-4692-ba4d-49e00e35911f" returned: 0 in 0.616s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:25:21 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-6728664d-dadc-4609-bb4f-e4450dfe0d2d tempest-VolumesExtendTest-1443083602 None] Lock "cinder-quobyte-52981b68-3cf4-4692-ba4d-49e00e35911f" released by "_delete_snapshot" :: held 3.180s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:25:21 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-6728664d-dadc-4609-bb4f-e4450dfe0d2d tempest-VolumesExtendTest-1443083602 None] Lock "cinder-quobyte-1d4ac517-2cd7-40c2-9d7b-1365ee542450" released by "delete_snapshot" :: held 3.206s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:25:21 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-6728664d-dadc-4609-bb4f-e4450dfe0d2d tempest-VolumesExtendTest-1443083602 None] Created reservations ['99e032fd-2953-40e7-a49d-29c42a2de01f', 'e0b7d832-9c24-4eb8-af14-46d5289a4571', '7673d319-31fc-4849-ba89-6efa43b3233a', '84eafa7f-367f-4e3a-904d-39e17cda1f43'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:25:21 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-6728664d-dadc-4609-bb4f-e4450dfe0d2d tempest-VolumesExtendTest-1443083602 None] Delete snapshot completed successfully. Apr 29 15:25:21 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-6728664d-dadc-4609-bb4f-e4450dfe0d2d tempest-VolumesExtendTest-1443083602 None] Lock "cinder-52981b68-3cf4-4692-ba4d-49e00e35911f-delete_snapshot" released by "delete_snapshot" :: held 3.392s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:25:21 devstack sudo[104958]: pam_unix(sudo:session): session closed for user root Apr 29 15:25:21 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-502a5918-bad8-4e16-9c95-73d4ec51abd5 tempest-TestInstancesWithCinderVolumes-634922416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-55d9a812-0a88-4ae0-8a9a-82254ec66c2d" returned: 0 in 0.764s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:25:21 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-502a5918-bad8-4e16-9c95-73d4ec51abd5 tempest-TestInstancesWithCinderVolumes-634922416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-55d9a812-0a88-4ae0-8a9a-82254ec66c2d {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:25:21 devstack sudo[104970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-55d9a812-0a88-4ae0-8a9a-82254ec66c2d Apr 29 15:25:21 devstack sudo[104970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:25:22 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-4ca75d17-d8c9-47c2-be66-2cba429777bb tempest-VolumesExtendTest-1443083602 None] Acquiring lock "cinder-1d4ac517-2cd7-40c2-9d7b-1365ee542450-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:25:22 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-4ca75d17-d8c9-47c2-be66-2cba429777bb tempest-VolumesExtendTest-1443083602 None] Lock "cinder-1d4ac517-2cd7-40c2-9d7b-1365ee542450-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:25:22 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-4ca75d17-d8c9-47c2-be66-2cba429777bb tempest-VolumesExtendTest-1443083602 None] Acquiring lock "cinder-quobyte-1d4ac517-2cd7-40c2-9d7b-1365ee542450" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:25:22 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-4ca75d17-d8c9-47c2-be66-2cba429777bb tempest-VolumesExtendTest-1443083602 None] Lock "cinder-quobyte-1d4ac517-2cd7-40c2-9d7b-1365ee542450" acquired by "delete_volume" :: waited 0.015s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:25:22 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f521439-6904-4158-908c-626d8683f2a5]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:25:22 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-4ca75d17-d8c9-47c2-be66-2cba429777bb tempest-VolumesExtendTest-1443083602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1d4ac517-2cd7-40c2-9d7b-1365ee542450 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:25:22 devstack sudo[104970]: pam_unix(sudo:session): session closed for user root Apr 29 15:25:22 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-502a5918-bad8-4e16-9c95-73d4ec51abd5 tempest-TestInstancesWithCinderVolumes-634922416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-55d9a812-0a88-4ae0-8a9a-82254ec66c2d" returned: 1 in 0.753s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:25:22 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-502a5918-bad8-4e16-9c95-73d4ec51abd5 tempest-TestInstancesWithCinderVolumes-634922416 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-55d9a812-0a88-4ae0-8a9a-82254ec66c2d' failed. Not Retrying. {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 15:25:22 devstack cinder-volume[84448]: DEBUG cinder.volume.volume_utils [None req-502a5918-bad8-4e16-9c95-73d4ec51abd5 tempest-TestInstancesWithCinderVolumes-634922416 None] Downloaded image 0c9bd9f5-40ac-42ac-bf1e-f318bfa206f6 ((None, [{'url': 'file:///opt/stack/data/glance/images/0c9bd9f5-40ac-42ac-bf1e-f318bfa206f6', 'metadata': {}}])) to volume 55d9a812-0a88-4ae0-8a9a-82254ec66c2d successfully. {{(pid=84448) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 29 15:25:22 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [None req-502a5918-bad8-4e16-9c95-73d4ec51abd5 tempest-TestInstancesWithCinderVolumes-634922416 None] Temporary image 0c9bd9f5-40ac-42ac-bf1e-f318bfa206f6 for user bf9ea8e824db4b97a752e1a8b1eaf0d2 is deleted. {{(pid=84448) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 29 15:25:22 devstack cinder-volume[84448]: DEBUG cinder.volume.volume_utils [None req-502a5918-bad8-4e16-9c95-73d4ec51abd5 tempest-TestInstancesWithCinderVolumes-634922416 None] Marking volume 55d9a812-0a88-4ae0-8a9a-82254ec66c2d as bootable. {{(pid=84448) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 29 15:25:22 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-502a5918-bad8-4e16-9c95-73d4ec51abd5 tempest-TestInstancesWithCinderVolumes-634922416 None] Copying metadata from image 0c9bd9f5-40ac-42ac-bf1e-f318bfa206f6 to 55d9a812-0a88-4ae0-8a9a-82254ec66c2d. {{(pid=84448) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 29 15:25:22 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-502a5918-bad8-4e16-9c95-73d4ec51abd5 tempest-TestInstancesWithCinderVolumes-634922416 None] Creating volume glance metadata for volume 55d9a812-0a88-4ae0-8a9a-82254ec66c2d backed by image 0c9bd9f5-40ac-42ac-bf1e-f318bfa206f6 with: {'image_id': '0c9bd9f5-40ac-42ac-bf1e-f318bfa206f6', 'image_name': 'tempest-scenario-img--1059369632', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84448) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 29 15:25:22 devstack sudo[104978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1d4ac517-2cd7-40c2-9d7b-1365ee542450 Apr 29 15:25:22 devstack sudo[104978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:25:22 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-502a5918-bad8-4e16-9c95-73d4ec51abd5 tempest-TestInstancesWithCinderVolumes-634922416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec4c9e2d-001a-4740-8fd3-1d0b3c4eaaf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55d9a812-0a88-4ae0-8a9a-82254ec66c2d', 'volume_size': 1, 'image_id': '0c9bd9f5-40ac-42ac-bf1e-f318bfa206f6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0c9bd9f5-40ac-42ac-bf1e-f318bfa206f6', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1059369632', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '128a3be4a591459eaa97416ed2428af7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0c9bd9f5-40ac-42ac-bf1e-f318bfa206f6', 'created_at': datetime.datetime(2026, 4, 29, 13, 24, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 13, 25, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0c9bd9f5-40ac-42ac-bf1e-f318bfa206f6/file', 'properties': {}}, 'image_service': }' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:25:22 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-502a5918-bad8-4e16-9c95-73d4ec51abd5 tempest-TestInstancesWithCinderVolumes-634922416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (925ccf0b-92fb-463b-9668-44730d86ce68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:25:22 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-502a5918-bad8-4e16-9c95-73d4ec51abd5 tempest-TestInstancesWithCinderVolumes-634922416 None] Volume volume-55d9a812-0a88-4ae0-8a9a-82254ec66c2d (55d9a812-0a88-4ae0-8a9a-82254ec66c2d): created successfully Apr 29 15:25:22 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-502a5918-bad8-4e16-9c95-73d4ec51abd5 tempest-TestInstancesWithCinderVolumes-634922416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (925ccf0b-92fb-463b-9668-44730d86ce68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:25:22 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-502a5918-bad8-4e16-9c95-73d4ec51abd5 tempest-TestInstancesWithCinderVolumes-634922416 None] Flow 'volume_create_manager' (1dc0e3a3-ce35-4bb3-8d3e-75fb4ffd3478) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:25:22 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-502a5918-bad8-4e16-9c95-73d4ec51abd5 tempest-TestInstancesWithCinderVolumes-634922416 None] Created volume successfully. Apr 29 15:25:23 devstack sudo[104978]: pam_unix(sudo:session): session closed for user root Apr 29 15:25:23 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-4ca75d17-d8c9-47c2-be66-2cba429777bb tempest-VolumesExtendTest-1443083602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1d4ac517-2cd7-40c2-9d7b-1365ee542450" returned: 0 in 0.714s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:25:23 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-4ca75d17-d8c9-47c2-be66-2cba429777bb tempest-VolumesExtendTest-1443083602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1d4ac517-2cd7-40c2-9d7b-1365ee542450 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:25:23 devstack sudo[104983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1d4ac517-2cd7-40c2-9d7b-1365ee542450 Apr 29 15:25:23 devstack sudo[104983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:25:23 devstack sudo[104983]: pam_unix(sudo:session): session closed for user root Apr 29 15:25:23 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-4ca75d17-d8c9-47c2-be66-2cba429777bb tempest-VolumesExtendTest-1443083602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1d4ac517-2cd7-40c2-9d7b-1365ee542450" returned: 0 in 0.626s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:25:23 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-4ca75d17-d8c9-47c2-be66-2cba429777bb tempest-VolumesExtendTest-1443083602 None] Lock "cinder-quobyte-1d4ac517-2cd7-40c2-9d7b-1365ee542450" released by "delete_volume" :: held 1.399s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:25:23 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-4ca75d17-d8c9-47c2-be66-2cba429777bb tempest-VolumesExtendTest-1443083602 None] Created reservations ['e6da6cef-9eca-4e28-a8ed-ee708ded6594', '6d5c5a61-0ba7-44c2-9532-ce5b285046da', 'c3d74047-2bc1-4580-a5f4-1494b00b970f', 'b594379a-55c1-4c3d-9b6f-1b60da49bdc2'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:25:24 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-4ca75d17-d8c9-47c2-be66-2cba429777bb tempest-VolumesExtendTest-1443083602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:25:24 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-4ca75d17-d8c9-47c2-be66-2cba429777bb tempest-VolumesExtendTest-1443083602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:25:24 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-4ca75d17-d8c9-47c2-be66-2cba429777bb tempest-VolumesExtendTest-1443083602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:25:24 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-4ca75d17-d8c9-47c2-be66-2cba429777bb tempest-VolumesExtendTest-1443083602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:25:24 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-4ca75d17-d8c9-47c2-be66-2cba429777bb tempest-VolumesExtendTest-1443083602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:25:24 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-4ca75d17-d8c9-47c2-be66-2cba429777bb tempest-VolumesExtendTest-1443083602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:25:24 devstack sudo[104986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:25:24 devstack sudo[104986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:25:24 devstack sudo[104986]: pam_unix(sudo:session): session closed for user root Apr 29 15:25:24 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-4ca75d17-d8c9-47c2-be66-2cba429777bb tempest-VolumesExtendTest-1443083602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.628s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:25:24 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-4ca75d17-d8c9-47c2-be66-2cba429777bb tempest-VolumesExtendTest-1443083602 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:25:24 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-4ca75d17-d8c9-47c2-be66-2cba429777bb tempest-VolumesExtendTest-1443083602 None] Deleted volume successfully. Apr 29 15:25:24 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-4ca75d17-d8c9-47c2-be66-2cba429777bb tempest-VolumesExtendTest-1443083602 None] Lock "cinder-1d4ac517-2cd7-40c2-9d7b-1365ee542450-delete_volume" released by "delete_volume" :: held 2.241s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:25:27 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3e53dc2-3a88-4811-9022-3ceb5a282f9c tempest-VolumesListTestJSON-2005237333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:25:27 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-d3e53dc2-3a88-4811-9022-3ceb5a282f9c tempest-VolumesListTestJSON-2005237333 None] Flow 'volume_create_manager' (d898db32-cd02-4ccd-9e9f-dd4f38b65117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:25:27 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-d3e53dc2-3a88-4811-9022-3ceb5a282f9c tempest-VolumesListTestJSON-2005237333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfa31dc0-f159-4103-be57-af4022e1fd91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:25:27 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-d3e53dc2-3a88-4811-9022-3ceb5a282f9c tempest-VolumesListTestJSON-2005237333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfa31dc0-f159-4103-be57-af4022e1fd91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:25:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-363732939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3010bda2-1e9c-41d6-8375-3f52a1f2dcad,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b1a89f80a48547bebfb5f27209f699bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:25:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:25:27Z,use_quota=True,user_id='cf79411115414cb19e1f562b742bca52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:25:27 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-d3e53dc2-3a88-4811-9022-3ceb5a282f9c tempest-VolumesListTestJSON-2005237333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (587edd5e-3b9c-497b-bf25-c025eeaa492f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:25:27 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-d3e53dc2-3a88-4811-9022-3ceb5a282f9c tempest-VolumesListTestJSON-2005237333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (587edd5e-3b9c-497b-bf25-c025eeaa492f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:25:27 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-d3e53dc2-3a88-4811-9022-3ceb5a282f9c tempest-VolumesListTestJSON-2005237333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d17bd09d-64ea-496b-b2a8-8a7fa9c3f343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:25:27 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-d3e53dc2-3a88-4811-9022-3ceb5a282f9c tempest-VolumesListTestJSON-2005237333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d17bd09d-64ea-496b-b2a8-8a7fa9c3f343) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3010bda2-1e9c-41d6-8375-3f52a1f2dcad', 'volume_name': 'volume-3010bda2-1e9c-41d6-8375-3f52a1f2dcad', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:25:27 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-d3e53dc2-3a88-4811-9022-3ceb5a282f9c tempest-VolumesListTestJSON-2005237333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3c7f1cb-971d-4c31-8dc8-a1c3b465ff3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:25:27 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-d3e53dc2-3a88-4811-9022-3ceb5a282f9c tempest-VolumesListTestJSON-2005237333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3c7f1cb-971d-4c31-8dc8-a1c3b465ff3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:25:27 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-d3e53dc2-3a88-4811-9022-3ceb5a282f9c tempest-VolumesListTestJSON-2005237333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e66f482-4c92-42e7-a71f-c2c4d1078c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:25:27 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-d3e53dc2-3a88-4811-9022-3ceb5a282f9c tempest-VolumesListTestJSON-2005237333 None] Volume 3010bda2-1e9c-41d6-8375-3f52a1f2dcad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3010bda2-1e9c-41d6-8375-3f52a1f2dcad', 'volume_size': 1} Apr 29 15:25:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-d3e53dc2-3a88-4811-9022-3ceb5a282f9c tempest-VolumesListTestJSON-2005237333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:25:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-d3e53dc2-3a88-4811-9022-3ceb5a282f9c tempest-VolumesListTestJSON-2005237333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:25:27 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-d3e53dc2-3a88-4811-9022-3ceb5a282f9c tempest-VolumesListTestJSON-2005237333 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:25:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-363732939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3010bda2-1e9c-41d6-8375-3f52a1f2dcad,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b1a89f80a48547bebfb5f27209f699bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:25:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:25:27Z,use_quota=True,user_id='cf79411115414cb19e1f562b742bca52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:25:27 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-d3e53dc2-3a88-4811-9022-3ceb5a282f9c tempest-VolumesListTestJSON-2005237333 None] Creating volume 3010bda2-1e9c-41d6-8375-3f52a1f2dcad {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:25:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-d3e53dc2-3a88-4811-9022-3ceb5a282f9c tempest-VolumesListTestJSON-2005237333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:25:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-d3e53dc2-3a88-4811-9022-3ceb5a282f9c tempest-VolumesListTestJSON-2005237333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:25:27 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-d3e53dc2-3a88-4811-9022-3ceb5a282f9c tempest-VolumesListTestJSON-2005237333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:25:27 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-d3e53dc2-3a88-4811-9022-3ceb5a282f9c tempest-VolumesListTestJSON-2005237333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:25:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-d3e53dc2-3a88-4811-9022-3ceb5a282f9c tempest-VolumesListTestJSON-2005237333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:25:27 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-d3e53dc2-3a88-4811-9022-3ceb5a282f9c tempest-VolumesListTestJSON-2005237333 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:25:27 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-d3e53dc2-3a88-4811-9022-3ceb5a282f9c tempest-VolumesListTestJSON-2005237333 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:25:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-d3e53dc2-3a88-4811-9022-3ceb5a282f9c tempest-VolumesListTestJSON-2005237333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3010bda2-1e9c-41d6-8375-3f52a1f2dcad 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:25:27 devstack sudo[104992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3010bda2-1e9c-41d6-8375-3f52a1f2dcad 1073741824 Apr 29 15:25:27 devstack sudo[104992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:25:28 devstack sudo[104992]: pam_unix(sudo:session): session closed for user root Apr 29 15:25:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-d3e53dc2-3a88-4811-9022-3ceb5a282f9c tempest-VolumesListTestJSON-2005237333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3010bda2-1e9c-41d6-8375-3f52a1f2dcad 1073741824" returned: 0 in 0.826s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:25:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-d3e53dc2-3a88-4811-9022-3ceb5a282f9c tempest-VolumesListTestJSON-2005237333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3010bda2-1e9c-41d6-8375-3f52a1f2dcad {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:25:28 devstack sudo[104998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3010bda2-1e9c-41d6-8375-3f52a1f2dcad Apr 29 15:25:28 devstack sudo[104998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:25:28 devstack sudo[104998]: pam_unix(sudo:session): session closed for user root Apr 29 15:25:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-d3e53dc2-3a88-4811-9022-3ceb5a282f9c tempest-VolumesListTestJSON-2005237333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3010bda2-1e9c-41d6-8375-3f52a1f2dcad" returned: 0 in 0.612s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:25:28 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-d3e53dc2-3a88-4811-9022-3ceb5a282f9c tempest-VolumesListTestJSON-2005237333 None] <== create_volume: return (1484ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:25:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-d3e53dc2-3a88-4811-9022-3ceb5a282f9c tempest-VolumesListTestJSON-2005237333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.487s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:25:28 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-d3e53dc2-3a88-4811-9022-3ceb5a282f9c tempest-VolumesListTestJSON-2005237333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e66f482-4c92-42e7-a71f-c2c4d1078c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3010bda2-1e9c-41d6-8375-3f52a1f2dcad', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:25:29 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-d3e53dc2-3a88-4811-9022-3ceb5a282f9c tempest-VolumesListTestJSON-2005237333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6619201-8f7e-4772-8c8c-b2e17d207dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:25:29 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-d3e53dc2-3a88-4811-9022-3ceb5a282f9c tempest-VolumesListTestJSON-2005237333 None] Volume volume-3010bda2-1e9c-41d6-8375-3f52a1f2dcad (3010bda2-1e9c-41d6-8375-3f52a1f2dcad): created successfully Apr 29 15:25:29 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-d3e53dc2-3a88-4811-9022-3ceb5a282f9c tempest-VolumesListTestJSON-2005237333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6619201-8f7e-4772-8c8c-b2e17d207dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:25:29 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-d3e53dc2-3a88-4811-9022-3ceb5a282f9c tempest-VolumesListTestJSON-2005237333 None] Flow 'volume_create_manager' (d898db32-cd02-4ccd-9e9f-dd4f38b65117) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:25:29 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-d3e53dc2-3a88-4811-9022-3ceb5a282f9c tempest-VolumesListTestJSON-2005237333 None] Created volume successfully. Apr 29 15:25:30 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-c43ea422-38e5-4ff1-9cf3-09f435a6af03 tempest-VolumesListTestJSON-2005237333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:25:30 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c43ea422-38e5-4ff1-9cf3-09f435a6af03 tempest-VolumesListTestJSON-2005237333 None] Flow 'volume_create_manager' (59bd6b39-c349-4f8c-939b-3ead2ad92727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:25:30 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c43ea422-38e5-4ff1-9cf3-09f435a6af03 tempest-VolumesListTestJSON-2005237333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44659752-790a-425a-90e5-a578b80a605c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:25:30 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c43ea422-38e5-4ff1-9cf3-09f435a6af03 tempest-VolumesListTestJSON-2005237333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44659752-790a-425a-90e5-a578b80a605c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:25:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-992924536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b6e8dcb-46bf-48c7-bfc7-92285d2a18c9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b1a89f80a48547bebfb5f27209f699bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:25:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:25:30Z,use_quota=True,user_id='cf79411115414cb19e1f562b742bca52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:25:30 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c43ea422-38e5-4ff1-9cf3-09f435a6af03 tempest-VolumesListTestJSON-2005237333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59e4dbb7-6c13-4607-8ffa-510334500daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:25:30 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c43ea422-38e5-4ff1-9cf3-09f435a6af03 tempest-VolumesListTestJSON-2005237333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59e4dbb7-6c13-4607-8ffa-510334500daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:25:30 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c43ea422-38e5-4ff1-9cf3-09f435a6af03 tempest-VolumesListTestJSON-2005237333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (955f6efa-28ab-4c5c-8cd8-b30eca281e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:25:30 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c43ea422-38e5-4ff1-9cf3-09f435a6af03 tempest-VolumesListTestJSON-2005237333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (955f6efa-28ab-4c5c-8cd8-b30eca281e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b6e8dcb-46bf-48c7-bfc7-92285d2a18c9', 'volume_name': 'volume-2b6e8dcb-46bf-48c7-bfc7-92285d2a18c9', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:25:30 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c43ea422-38e5-4ff1-9cf3-09f435a6af03 tempest-VolumesListTestJSON-2005237333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (219312b8-7a9b-44b2-ae8e-13433c8b4cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:25:30 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c43ea422-38e5-4ff1-9cf3-09f435a6af03 tempest-VolumesListTestJSON-2005237333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (219312b8-7a9b-44b2-ae8e-13433c8b4cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:25:30 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c43ea422-38e5-4ff1-9cf3-09f435a6af03 tempest-VolumesListTestJSON-2005237333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d4f6b2c-026d-47ad-8660-7d645feabb25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:25:30 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-c43ea422-38e5-4ff1-9cf3-09f435a6af03 tempest-VolumesListTestJSON-2005237333 None] Volume 2b6e8dcb-46bf-48c7-bfc7-92285d2a18c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b6e8dcb-46bf-48c7-bfc7-92285d2a18c9', 'volume_size': 1} Apr 29 15:25:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-c43ea422-38e5-4ff1-9cf3-09f435a6af03 tempest-VolumesListTestJSON-2005237333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:25:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-c43ea422-38e5-4ff1-9cf3-09f435a6af03 tempest-VolumesListTestJSON-2005237333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:25:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-c43ea422-38e5-4ff1-9cf3-09f435a6af03 tempest-VolumesListTestJSON-2005237333 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:25:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-992924536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b6e8dcb-46bf-48c7-bfc7-92285d2a18c9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b1a89f80a48547bebfb5f27209f699bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:25:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:25:30Z,use_quota=True,user_id='cf79411115414cb19e1f562b742bca52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:25:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-c43ea422-38e5-4ff1-9cf3-09f435a6af03 tempest-VolumesListTestJSON-2005237333 None] Creating volume 2b6e8dcb-46bf-48c7-bfc7-92285d2a18c9 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:25:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-c43ea422-38e5-4ff1-9cf3-09f435a6af03 tempest-VolumesListTestJSON-2005237333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:25:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-c43ea422-38e5-4ff1-9cf3-09f435a6af03 tempest-VolumesListTestJSON-2005237333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:25:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-c43ea422-38e5-4ff1-9cf3-09f435a6af03 tempest-VolumesListTestJSON-2005237333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:25:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-c43ea422-38e5-4ff1-9cf3-09f435a6af03 tempest-VolumesListTestJSON-2005237333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:25:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-c43ea422-38e5-4ff1-9cf3-09f435a6af03 tempest-VolumesListTestJSON-2005237333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:25:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-c43ea422-38e5-4ff1-9cf3-09f435a6af03 tempest-VolumesListTestJSON-2005237333 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:25:30 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-c43ea422-38e5-4ff1-9cf3-09f435a6af03 tempest-VolumesListTestJSON-2005237333 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:25:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c43ea422-38e5-4ff1-9cf3-09f435a6af03 tempest-VolumesListTestJSON-2005237333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2b6e8dcb-46bf-48c7-bfc7-92285d2a18c9 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:25:30 devstack sudo[105001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2b6e8dcb-46bf-48c7-bfc7-92285d2a18c9 1073741824 Apr 29 15:25:30 devstack sudo[105001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:25:30 devstack cinder-volume[84448]: DEBUG oslo_service.periodic_task [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84448) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 15:25:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:25:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:25:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:25:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:25:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:25:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:25:30 devstack sudo[105003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:25:30 devstack sudo[105003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:25:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-2d4d377e-9218-4fa6-817a-57ddb4078aa7 req-0d88e7b2-3014-4c9d-933a-624b96eb1ede tempest-TestInstancesWithCinderVolumes-634922416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:25:31 devstack sudo[105003]: pam_unix(sudo:session): session closed for user root Apr 29 15:25:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.679s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:25:31 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:25:31 devstack sudo[105001]: pam_unix(sudo:session): session closed for user root Apr 29 15:25:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c43ea422-38e5-4ff1-9cf3-09f435a6af03 tempest-VolumesListTestJSON-2005237333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2b6e8dcb-46bf-48c7-bfc7-92285d2a18c9 1073741824" returned: 0 in 0.953s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:25:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c43ea422-38e5-4ff1-9cf3-09f435a6af03 tempest-VolumesListTestJSON-2005237333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2b6e8dcb-46bf-48c7-bfc7-92285d2a18c9 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:25:31 devstack sudo[105019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2b6e8dcb-46bf-48c7-bfc7-92285d2a18c9 Apr 29 15:25:31 devstack sudo[105019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:25:31 devstack sudo[105019]: pam_unix(sudo:session): session closed for user root Apr 29 15:25:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c43ea422-38e5-4ff1-9cf3-09f435a6af03 tempest-VolumesListTestJSON-2005237333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2b6e8dcb-46bf-48c7-bfc7-92285d2a18c9" returned: 0 in 0.636s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:25:31 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-c43ea422-38e5-4ff1-9cf3-09f435a6af03 tempest-VolumesListTestJSON-2005237333 None] <== create_volume: return (1631ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:25:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-c43ea422-38e5-4ff1-9cf3-09f435a6af03 tempest-VolumesListTestJSON-2005237333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.633s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:25:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-2d4d377e-9218-4fa6-817a-57ddb4078aa7 req-0d88e7b2-3014-4c9d-933a-624b96eb1ede tempest-TestInstancesWithCinderVolumes-634922416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.859s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:25:31 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c43ea422-38e5-4ff1-9cf3-09f435a6af03 tempest-VolumesListTestJSON-2005237333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d4f6b2c-026d-47ad-8660-7d645feabb25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b6e8dcb-46bf-48c7-bfc7-92285d2a18c9', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:25:31 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c43ea422-38e5-4ff1-9cf3-09f435a6af03 tempest-VolumesListTestJSON-2005237333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d608308-35c4-4c23-9a50-c3b1f31ea4f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:25:31 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[93db834e-d9dd-43b6-b288-0cc227035c90]: (4, 'raw') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:25:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-2d4d377e-9218-4fa6-817a-57ddb4078aa7 req-0d88e7b2-3014-4c9d-933a-624b96eb1ede tempest-TestInstancesWithCinderVolumes-634922416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-55d9a812-0a88-4ae0-8a9a-82254ec66c2d {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:25:31 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-c43ea422-38e5-4ff1-9cf3-09f435a6af03 tempest-VolumesListTestJSON-2005237333 None] Volume volume-2b6e8dcb-46bf-48c7-bfc7-92285d2a18c9 (2b6e8dcb-46bf-48c7-bfc7-92285d2a18c9): created successfully Apr 29 15:25:31 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c43ea422-38e5-4ff1-9cf3-09f435a6af03 tempest-VolumesListTestJSON-2005237333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d608308-35c4-4c23-9a50-c3b1f31ea4f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:25:31 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c43ea422-38e5-4ff1-9cf3-09f435a6af03 tempest-VolumesListTestJSON-2005237333 None] Flow 'volume_create_manager' (59bd6b39-c349-4f8c-939b-3ead2ad92727) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:25:31 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-c43ea422-38e5-4ff1-9cf3-09f435a6af03 tempest-VolumesListTestJSON-2005237333 None] Created volume successfully. Apr 29 15:25:31 devstack sudo[105029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-55d9a812-0a88-4ae0-8a9a-82254ec66c2d Apr 29 15:25:31 devstack sudo[105029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:25:32 devstack sudo[105029]: pam_unix(sudo:session): session closed for user root Apr 29 15:25:32 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-2d4d377e-9218-4fa6-817a-57ddb4078aa7 req-0d88e7b2-3014-4c9d-933a-624b96eb1ede tempest-TestInstancesWithCinderVolumes-634922416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-55d9a812-0a88-4ae0-8a9a-82254ec66c2d" returned: 0 in 0.732s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:25:32 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-2d4d377e-9218-4fa6-817a-57ddb4078aa7 req-0d88e7b2-3014-4c9d-933a-624b96eb1ede tempest-TestInstancesWithCinderVolumes-634922416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-55d9a812-0a88-4ae0-8a9a-82254ec66c2d {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:25:32 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-598aa046-33ed-470c-bd6d-88b67f850dce tempest-VolumesListTestJSON-2005237333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:25:32 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-598aa046-33ed-470c-bd6d-88b67f850dce tempest-VolumesListTestJSON-2005237333 None] Flow 'volume_create_manager' (82da2812-6e41-4ec2-91c1-c225b5f1bd41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:25:32 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-598aa046-33ed-470c-bd6d-88b67f850dce tempest-VolumesListTestJSON-2005237333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (336e3dd6-c89a-4109-a054-027d36a5426b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:25:32 devstack sudo[105033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-55d9a812-0a88-4ae0-8a9a-82254ec66c2d Apr 29 15:25:32 devstack sudo[105033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:25:32 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-598aa046-33ed-470c-bd6d-88b67f850dce tempest-VolumesListTestJSON-2005237333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (336e3dd6-c89a-4109-a054-027d36a5426b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:25:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-191133689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7226c6b-417b-420c-b097-2281f8a16950,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b1a89f80a48547bebfb5f27209f699bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:25:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:25:33Z,use_quota=True,user_id='cf79411115414cb19e1f562b742bca52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:25:32 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-598aa046-33ed-470c-bd6d-88b67f850dce tempest-VolumesListTestJSON-2005237333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9824ba16-4cc0-476e-a5de-671a3a3198b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:25:32 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-598aa046-33ed-470c-bd6d-88b67f850dce tempest-VolumesListTestJSON-2005237333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9824ba16-4cc0-476e-a5de-671a3a3198b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:25:32 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-598aa046-33ed-470c-bd6d-88b67f850dce tempest-VolumesListTestJSON-2005237333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85d88136-d870-426c-a874-867966d70713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:25:32 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-598aa046-33ed-470c-bd6d-88b67f850dce tempest-VolumesListTestJSON-2005237333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85d88136-d870-426c-a874-867966d70713) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7226c6b-417b-420c-b097-2281f8a16950', 'volume_name': 'volume-d7226c6b-417b-420c-b097-2281f8a16950', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:25:32 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-598aa046-33ed-470c-bd6d-88b67f850dce tempest-VolumesListTestJSON-2005237333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a2a801a-1487-4508-a9d7-bc816bf7009f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:25:32 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-598aa046-33ed-470c-bd6d-88b67f850dce tempest-VolumesListTestJSON-2005237333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a2a801a-1487-4508-a9d7-bc816bf7009f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:25:32 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-598aa046-33ed-470c-bd6d-88b67f850dce tempest-VolumesListTestJSON-2005237333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7626597-becb-4db1-9ea9-cbb9a38153bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:25:32 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-598aa046-33ed-470c-bd6d-88b67f850dce tempest-VolumesListTestJSON-2005237333 None] Volume d7226c6b-417b-420c-b097-2281f8a16950: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7226c6b-417b-420c-b097-2281f8a16950', 'volume_size': 1} Apr 29 15:25:32 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-598aa046-33ed-470c-bd6d-88b67f850dce tempest-VolumesListTestJSON-2005237333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:25:33 devstack sudo[105033]: pam_unix(sudo:session): session closed for user root Apr 29 15:25:33 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-2d4d377e-9218-4fa6-817a-57ddb4078aa7 req-0d88e7b2-3014-4c9d-933a-624b96eb1ede tempest-TestInstancesWithCinderVolumes-634922416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-55d9a812-0a88-4ae0-8a9a-82254ec66c2d" returned: 1 in 0.765s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:25:33 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-2d4d377e-9218-4fa6-817a-57ddb4078aa7 req-0d88e7b2-3014-4c9d-933a-624b96eb1ede tempest-TestInstancesWithCinderVolumes-634922416 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-55d9a812-0a88-4ae0-8a9a-82254ec66c2d' failed. Not Retrying. {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 15:25:33 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-2d4d377e-9218-4fa6-817a-57ddb4078aa7 req-0d88e7b2-3014-4c9d-933a-624b96eb1ede tempest-TestInstancesWithCinderVolumes-634922416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.544s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:25:33 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-598aa046-33ed-470c-bd6d-88b67f850dce tempest-VolumesListTestJSON-2005237333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.588s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:25:33 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-598aa046-33ed-470c-bd6d-88b67f850dce tempest-VolumesListTestJSON-2005237333 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:25:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-191133689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7226c6b-417b-420c-b097-2281f8a16950,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b1a89f80a48547bebfb5f27209f699bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:25:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:25:33Z,use_quota=True,user_id='cf79411115414cb19e1f562b742bca52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:25:33 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-598aa046-33ed-470c-bd6d-88b67f850dce tempest-VolumesListTestJSON-2005237333 None] Creating volume d7226c6b-417b-420c-b097-2281f8a16950 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:25:33 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-598aa046-33ed-470c-bd6d-88b67f850dce tempest-VolumesListTestJSON-2005237333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:25:33 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-598aa046-33ed-470c-bd6d-88b67f850dce tempest-VolumesListTestJSON-2005237333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:25:33 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-598aa046-33ed-470c-bd6d-88b67f850dce tempest-VolumesListTestJSON-2005237333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:25:33 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-598aa046-33ed-470c-bd6d-88b67f850dce tempest-VolumesListTestJSON-2005237333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:25:33 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-598aa046-33ed-470c-bd6d-88b67f850dce tempest-VolumesListTestJSON-2005237333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:25:33 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-598aa046-33ed-470c-bd6d-88b67f850dce tempest-VolumesListTestJSON-2005237333 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:25:33 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-598aa046-33ed-470c-bd6d-88b67f850dce tempest-VolumesListTestJSON-2005237333 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:25:33 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-598aa046-33ed-470c-bd6d-88b67f850dce tempest-VolumesListTestJSON-2005237333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d7226c6b-417b-420c-b097-2281f8a16950 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:25:33 devstack sudo[105074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d7226c6b-417b-420c-b097-2281f8a16950 1073741824 Apr 29 15:25:33 devstack sudo[105074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:25:33 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-2d4d377e-9218-4fa6-817a-57ddb4078aa7 req-0d88e7b2-3014-4c9d-933a-624b96eb1ede tempest-TestInstancesWithCinderVolumes-634922416 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a', 'name': 'volume-55d9a812-0a88-4ae0-8a9a-82254ec66c2d', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ad2de756-7906-4639-8a9d-a72190b8de39', 'enforce_multipath': True} {{(pid=84448) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 15:25:33 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-2d4d377e-9218-4fa6-817a-57ddb4078aa7 req-0d88e7b2-3014-4c9d-933a-624b96eb1ede tempest-TestInstancesWithCinderVolumes-634922416 None] attachment_update completed successfully. Apr 29 15:25:34 devstack sudo[105074]: pam_unix(sudo:session): session closed for user root Apr 29 15:25:34 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-598aa046-33ed-470c-bd6d-88b67f850dce tempest-VolumesListTestJSON-2005237333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d7226c6b-417b-420c-b097-2281f8a16950 1073741824" returned: 0 in 0.852s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:25:34 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-598aa046-33ed-470c-bd6d-88b67f850dce tempest-VolumesListTestJSON-2005237333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d7226c6b-417b-420c-b097-2281f8a16950 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:25:34 devstack sudo[105080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d7226c6b-417b-420c-b097-2281f8a16950 Apr 29 15:25:34 devstack sudo[105080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:25:34 devstack sudo[105080]: pam_unix(sudo:session): session closed for user root Apr 29 15:25:34 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-598aa046-33ed-470c-bd6d-88b67f850dce tempest-VolumesListTestJSON-2005237333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d7226c6b-417b-420c-b097-2281f8a16950" returned: 0 in 0.637s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:25:34 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-598aa046-33ed-470c-bd6d-88b67f850dce tempest-VolumesListTestJSON-2005237333 None] <== create_volume: return (1534ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:25:34 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-598aa046-33ed-470c-bd6d-88b67f850dce tempest-VolumesListTestJSON-2005237333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.538s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:25:34 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-598aa046-33ed-470c-bd6d-88b67f850dce tempest-VolumesListTestJSON-2005237333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7626597-becb-4db1-9ea9-cbb9a38153bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7226c6b-417b-420c-b097-2281f8a16950', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:25:34 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-598aa046-33ed-470c-bd6d-88b67f850dce tempest-VolumesListTestJSON-2005237333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa656ab3-b501-4087-a6e0-bd670ec41cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:25:34 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-598aa046-33ed-470c-bd6d-88b67f850dce tempest-VolumesListTestJSON-2005237333 None] Volume volume-d7226c6b-417b-420c-b097-2281f8a16950 (d7226c6b-417b-420c-b097-2281f8a16950): created successfully Apr 29 15:25:34 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-598aa046-33ed-470c-bd6d-88b67f850dce tempest-VolumesListTestJSON-2005237333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa656ab3-b501-4087-a6e0-bd670ec41cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:25:34 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-598aa046-33ed-470c-bd6d-88b67f850dce tempest-VolumesListTestJSON-2005237333 None] Flow 'volume_create_manager' (82da2812-6e41-4ec2-91c1-c225b5f1bd41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:25:34 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-598aa046-33ed-470c-bd6d-88b67f850dce tempest-VolumesListTestJSON-2005237333 None] Created volume successfully. Apr 29 15:25:37 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-f57cd69e-1958-423f-9b08-e09e02f76a6c tempest-VolumesListTestJSON-2005237333 None] Acquiring lock "cinder-d7226c6b-417b-420c-b097-2281f8a16950-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:25:37 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-f57cd69e-1958-423f-9b08-e09e02f76a6c tempest-VolumesListTestJSON-2005237333 None] Lock "cinder-d7226c6b-417b-420c-b097-2281f8a16950-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:25:37 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-f57cd69e-1958-423f-9b08-e09e02f76a6c tempest-VolumesListTestJSON-2005237333 None] Acquiring lock "cinder-quobyte-d7226c6b-417b-420c-b097-2281f8a16950" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:25:38 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-f57cd69e-1958-423f-9b08-e09e02f76a6c tempest-VolumesListTestJSON-2005237333 None] Lock "cinder-quobyte-d7226c6b-417b-420c-b097-2281f8a16950" acquired by "delete_volume" :: waited 0.015s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:25:38 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb9aff45-e29e-4675-b2c6-39204d8b918d]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:25:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f57cd69e-1958-423f-9b08-e09e02f76a6c tempest-VolumesListTestJSON-2005237333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d7226c6b-417b-420c-b097-2281f8a16950 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:25:38 devstack sudo[105160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d7226c6b-417b-420c-b097-2281f8a16950 Apr 29 15:25:38 devstack sudo[105160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:25:38 devstack sudo[105160]: pam_unix(sudo:session): session closed for user root Apr 29 15:25:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f57cd69e-1958-423f-9b08-e09e02f76a6c tempest-VolumesListTestJSON-2005237333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d7226c6b-417b-420c-b097-2281f8a16950" returned: 0 in 0.822s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:25:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f57cd69e-1958-423f-9b08-e09e02f76a6c tempest-VolumesListTestJSON-2005237333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d7226c6b-417b-420c-b097-2281f8a16950 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:25:38 devstack sudo[105420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d7226c6b-417b-420c-b097-2281f8a16950 Apr 29 15:25:38 devstack sudo[105420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:25:39 devstack sudo[105420]: pam_unix(sudo:session): session closed for user root Apr 29 15:25:39 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f57cd69e-1958-423f-9b08-e09e02f76a6c tempest-VolumesListTestJSON-2005237333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d7226c6b-417b-420c-b097-2281f8a16950" returned: 0 in 1.090s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:25:39 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-f57cd69e-1958-423f-9b08-e09e02f76a6c tempest-VolumesListTestJSON-2005237333 None] Lock "cinder-quobyte-d7226c6b-417b-420c-b097-2281f8a16950" released by "delete_volume" :: held 1.957s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:25:39 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:UPDATE=64,cinder:SELECT=54,cinder:INSERT=17,cinder:DELETE=5 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:25:39 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:SELECT=68,cinder:UPDATE=56,cinder:INSERT=26,cinder:DELETE=8 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:25:40 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-f57cd69e-1958-423f-9b08-e09e02f76a6c tempest-VolumesListTestJSON-2005237333 None] Created reservations ['abf7f61b-a7bd-4f54-8a48-6e23bcee127c', 'c4122418-3ae1-47fc-b773-8b16f47d6862', 'e6a8bfb3-d21d-4d98-97ee-9f296b3a5b40', 'ce6b309c-7921-4360-9844-fdbd9b4abdac'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:25:40 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-f57cd69e-1958-423f-9b08-e09e02f76a6c tempest-VolumesListTestJSON-2005237333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:25:40 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-f57cd69e-1958-423f-9b08-e09e02f76a6c tempest-VolumesListTestJSON-2005237333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:25:40 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-f57cd69e-1958-423f-9b08-e09e02f76a6c tempest-VolumesListTestJSON-2005237333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:25:40 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-f57cd69e-1958-423f-9b08-e09e02f76a6c tempest-VolumesListTestJSON-2005237333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:25:40 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-f57cd69e-1958-423f-9b08-e09e02f76a6c tempest-VolumesListTestJSON-2005237333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:25:40 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f57cd69e-1958-423f-9b08-e09e02f76a6c tempest-VolumesListTestJSON-2005237333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:25:40 devstack sudo[105581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:25:40 devstack sudo[105581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:25:40 devstack sudo[105581]: pam_unix(sudo:session): session closed for user root Apr 29 15:25:40 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f57cd69e-1958-423f-9b08-e09e02f76a6c tempest-VolumesListTestJSON-2005237333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.690s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:25:40 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-f57cd69e-1958-423f-9b08-e09e02f76a6c tempest-VolumesListTestJSON-2005237333 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:25:40 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-f57cd69e-1958-423f-9b08-e09e02f76a6c tempest-VolumesListTestJSON-2005237333 None] Deleted volume successfully. Apr 29 15:25:40 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-f57cd69e-1958-423f-9b08-e09e02f76a6c tempest-VolumesListTestJSON-2005237333 None] Lock "cinder-d7226c6b-417b-420c-b097-2281f8a16950-delete_volume" released by "delete_volume" :: held 2.988s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:25:41 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-fdd0186c-ff49-4d79-940f-195f04bef82b tempest-VolumesListTestJSON-2005237333 None] Acquiring lock "cinder-2b6e8dcb-46bf-48c7-bfc7-92285d2a18c9-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:25:41 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-fdd0186c-ff49-4d79-940f-195f04bef82b tempest-VolumesListTestJSON-2005237333 None] Lock "cinder-2b6e8dcb-46bf-48c7-bfc7-92285d2a18c9-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:25:41 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-fdd0186c-ff49-4d79-940f-195f04bef82b tempest-VolumesListTestJSON-2005237333 None] Acquiring lock "cinder-quobyte-2b6e8dcb-46bf-48c7-bfc7-92285d2a18c9" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:25:41 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-fdd0186c-ff49-4d79-940f-195f04bef82b tempest-VolumesListTestJSON-2005237333 None] Lock "cinder-quobyte-2b6e8dcb-46bf-48c7-bfc7-92285d2a18c9" acquired by "delete_volume" :: waited 0.019s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:25:41 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c6d99e-3c5b-4a08-b76f-d743b56d4290]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:25:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-fdd0186c-ff49-4d79-940f-195f04bef82b tempest-VolumesListTestJSON-2005237333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2b6e8dcb-46bf-48c7-bfc7-92285d2a18c9 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:25:41 devstack sudo[105609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2b6e8dcb-46bf-48c7-bfc7-92285d2a18c9 Apr 29 15:25:41 devstack sudo[105609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:25:42 devstack sudo[105609]: pam_unix(sudo:session): session closed for user root Apr 29 15:25:42 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-fdd0186c-ff49-4d79-940f-195f04bef82b tempest-VolumesListTestJSON-2005237333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2b6e8dcb-46bf-48c7-bfc7-92285d2a18c9" returned: 0 in 0.850s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:25:42 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-fdd0186c-ff49-4d79-940f-195f04bef82b tempest-VolumesListTestJSON-2005237333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2b6e8dcb-46bf-48c7-bfc7-92285d2a18c9 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:25:42 devstack sudo[105617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2b6e8dcb-46bf-48c7-bfc7-92285d2a18c9 Apr 29 15:25:42 devstack sudo[105617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:25:43 devstack sudo[105617]: pam_unix(sudo:session): session closed for user root Apr 29 15:25:43 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-fdd0186c-ff49-4d79-940f-195f04bef82b tempest-VolumesListTestJSON-2005237333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2b6e8dcb-46bf-48c7-bfc7-92285d2a18c9" returned: 0 in 0.763s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:25:43 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-fdd0186c-ff49-4d79-940f-195f04bef82b tempest-VolumesListTestJSON-2005237333 None] Lock "cinder-quobyte-2b6e8dcb-46bf-48c7-bfc7-92285d2a18c9" released by "delete_volume" :: held 1.666s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:25:43 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-fdd0186c-ff49-4d79-940f-195f04bef82b tempest-VolumesListTestJSON-2005237333 None] Created reservations ['ddb1a55d-33f8-440d-b0fd-768000ed401c', 'bcb98fc5-c46b-487f-bae4-e3e44eeef0f6', 'c8a3334d-fb6c-426f-b610-00f472b83bfc', '109d0937-e547-44a8-8e37-6a968c017c59'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:25:43 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-fdd0186c-ff49-4d79-940f-195f04bef82b tempest-VolumesListTestJSON-2005237333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:25:43 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-fdd0186c-ff49-4d79-940f-195f04bef82b tempest-VolumesListTestJSON-2005237333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:25:43 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-fdd0186c-ff49-4d79-940f-195f04bef82b tempest-VolumesListTestJSON-2005237333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:25:43 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-fdd0186c-ff49-4d79-940f-195f04bef82b tempest-VolumesListTestJSON-2005237333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:25:43 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-fdd0186c-ff49-4d79-940f-195f04bef82b tempest-VolumesListTestJSON-2005237333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:25:43 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-fdd0186c-ff49-4d79-940f-195f04bef82b tempest-VolumesListTestJSON-2005237333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:25:43 devstack sudo[105622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:25:43 devstack sudo[105622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:25:43 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-86c23d8b-5b9c-4e11-a742-1a021b138006 tempest-VolumesListTestJSON-2005237333 None] Acquiring lock "cinder-3010bda2-1e9c-41d6-8375-3f52a1f2dcad-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:25:43 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-86c23d8b-5b9c-4e11-a742-1a021b138006 tempest-VolumesListTestJSON-2005237333 None] Lock "cinder-3010bda2-1e9c-41d6-8375-3f52a1f2dcad-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:25:44 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-86c23d8b-5b9c-4e11-a742-1a021b138006 tempest-VolumesListTestJSON-2005237333 None] Acquiring lock "cinder-quobyte-3010bda2-1e9c-41d6-8375-3f52a1f2dcad" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:25:44 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-86c23d8b-5b9c-4e11-a742-1a021b138006 tempest-VolumesListTestJSON-2005237333 None] Lock "cinder-quobyte-3010bda2-1e9c-41d6-8375-3f52a1f2dcad" acquired by "delete_volume" :: waited 0.024s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:25:44 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c33c28-cc8e-4903-a4ae-a745ac2b6445]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:25:44 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-86c23d8b-5b9c-4e11-a742-1a021b138006 tempest-VolumesListTestJSON-2005237333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3010bda2-1e9c-41d6-8375-3f52a1f2dcad {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:25:44 devstack sudo[105622]: pam_unix(sudo:session): session closed for user root Apr 29 15:25:44 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-fdd0186c-ff49-4d79-940f-195f04bef82b tempest-VolumesListTestJSON-2005237333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.974s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:25:44 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-fdd0186c-ff49-4d79-940f-195f04bef82b tempest-VolumesListTestJSON-2005237333 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:25:44 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-fdd0186c-ff49-4d79-940f-195f04bef82b tempest-VolumesListTestJSON-2005237333 None] Deleted volume successfully. Apr 29 15:25:44 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-fdd0186c-ff49-4d79-940f-195f04bef82b tempest-VolumesListTestJSON-2005237333 None] Lock "cinder-2b6e8dcb-46bf-48c7-bfc7-92285d2a18c9-delete_volume" released by "delete_volume" :: held 2.934s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:25:44 devstack sudo[105625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3010bda2-1e9c-41d6-8375-3f52a1f2dcad Apr 29 15:25:44 devstack sudo[105625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:25:45 devstack sudo[105625]: pam_unix(sudo:session): session closed for user root Apr 29 15:25:45 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-86c23d8b-5b9c-4e11-a742-1a021b138006 tempest-VolumesListTestJSON-2005237333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3010bda2-1e9c-41d6-8375-3f52a1f2dcad" returned: 0 in 0.949s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:25:45 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-86c23d8b-5b9c-4e11-a742-1a021b138006 tempest-VolumesListTestJSON-2005237333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3010bda2-1e9c-41d6-8375-3f52a1f2dcad {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:25:45 devstack sudo[105632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3010bda2-1e9c-41d6-8375-3f52a1f2dcad Apr 29 15:25:45 devstack sudo[105632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:25:45 devstack sudo[105632]: pam_unix(sudo:session): session closed for user root Apr 29 15:25:45 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-86c23d8b-5b9c-4e11-a742-1a021b138006 tempest-VolumesListTestJSON-2005237333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3010bda2-1e9c-41d6-8375-3f52a1f2dcad" returned: 0 in 0.730s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:25:45 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-86c23d8b-5b9c-4e11-a742-1a021b138006 tempest-VolumesListTestJSON-2005237333 None] Lock "cinder-quobyte-3010bda2-1e9c-41d6-8375-3f52a1f2dcad" released by "delete_volume" :: held 1.760s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:25:45 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-86c23d8b-5b9c-4e11-a742-1a021b138006 tempest-VolumesListTestJSON-2005237333 None] Created reservations ['2d9bfd59-6ad8-47b1-bb23-46739154559a', 'df8c80ce-4554-4cc6-b764-3f443724d3c9', '8c0e9210-ade5-4600-93d2-7f307ab6f070', 'a45af5de-4cbf-4a16-a62d-d7916d09e3f2'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:25:45 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-86c23d8b-5b9c-4e11-a742-1a021b138006 tempest-VolumesListTestJSON-2005237333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:25:45 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-86c23d8b-5b9c-4e11-a742-1a021b138006 tempest-VolumesListTestJSON-2005237333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:25:45 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-86c23d8b-5b9c-4e11-a742-1a021b138006 tempest-VolumesListTestJSON-2005237333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:25:45 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-86c23d8b-5b9c-4e11-a742-1a021b138006 tempest-VolumesListTestJSON-2005237333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:25:45 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-86c23d8b-5b9c-4e11-a742-1a021b138006 tempest-VolumesListTestJSON-2005237333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:25:45 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-86c23d8b-5b9c-4e11-a742-1a021b138006 tempest-VolumesListTestJSON-2005237333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:25:45 devstack sudo[105637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:25:45 devstack sudo[105637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:25:46 devstack sudo[105637]: pam_unix(sudo:session): session closed for user root Apr 29 15:25:46 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-86c23d8b-5b9c-4e11-a742-1a021b138006 tempest-VolumesListTestJSON-2005237333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.949s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:25:46 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-86c23d8b-5b9c-4e11-a742-1a021b138006 tempest-VolumesListTestJSON-2005237333 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:25:46 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-86c23d8b-5b9c-4e11-a742-1a021b138006 tempest-VolumesListTestJSON-2005237333 None] Deleted volume successfully. Apr 29 15:25:47 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-86c23d8b-5b9c-4e11-a742-1a021b138006 tempest-VolumesListTestJSON-2005237333 None] Lock "cinder-3010bda2-1e9c-41d6-8375-3f52a1f2dcad-delete_volume" released by "delete_volume" :: held 3.088s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:25:50 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-72e06c2c-0dbc-4318-9568-d021dc9d8211 tempest-VolumesSnapshotNegativeTestJSON-907800577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:25:50 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-72e06c2c-0dbc-4318-9568-d021dc9d8211 tempest-VolumesSnapshotNegativeTestJSON-907800577 None] Flow 'volume_create_manager' (ca1a8c27-fa3e-4ad6-ae31-a8adaf1b42d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:25:50 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-72e06c2c-0dbc-4318-9568-d021dc9d8211 tempest-VolumesSnapshotNegativeTestJSON-907800577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f3423b4-c6c0-4c68-9899-23cd4a8fa22c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:25:50 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-72e06c2c-0dbc-4318-9568-d021dc9d8211 tempest-VolumesSnapshotNegativeTestJSON-907800577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f3423b4-c6c0-4c68-9899-23cd4a8fa22c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:25:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-280403244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7a3bc07-5014-422a-9664-117e91e219c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa4dfa9cecac4077ae6dbd3041de338c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:25:50Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:25:50Z,use_quota=True,user_id='063a538a8d29452a906e7759d195242e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:25:50 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-72e06c2c-0dbc-4318-9568-d021dc9d8211 tempest-VolumesSnapshotNegativeTestJSON-907800577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fd9fe13-d54b-400f-8a0c-fd657b666dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:25:50 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-72e06c2c-0dbc-4318-9568-d021dc9d8211 tempest-VolumesSnapshotNegativeTestJSON-907800577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fd9fe13-d54b-400f-8a0c-fd657b666dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:25:50 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-72e06c2c-0dbc-4318-9568-d021dc9d8211 tempest-VolumesSnapshotNegativeTestJSON-907800577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72b38903-5255-44bf-b7c1-4e218036a4ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:25:50 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-72e06c2c-0dbc-4318-9568-d021dc9d8211 tempest-VolumesSnapshotNegativeTestJSON-907800577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72b38903-5255-44bf-b7c1-4e218036a4ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7a3bc07-5014-422a-9664-117e91e219c7', 'volume_name': 'volume-e7a3bc07-5014-422a-9664-117e91e219c7', 'volume_size': 2}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:25:50 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-72e06c2c-0dbc-4318-9568-d021dc9d8211 tempest-VolumesSnapshotNegativeTestJSON-907800577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cb1de5a-bc25-4299-9e73-73f66f1ff3ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:25:50 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-72e06c2c-0dbc-4318-9568-d021dc9d8211 tempest-VolumesSnapshotNegativeTestJSON-907800577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cb1de5a-bc25-4299-9e73-73f66f1ff3ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:25:50 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-72e06c2c-0dbc-4318-9568-d021dc9d8211 tempest-VolumesSnapshotNegativeTestJSON-907800577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (929bfefc-257e-4e7b-b107-6b01e08a053e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:25:50 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-72e06c2c-0dbc-4318-9568-d021dc9d8211 tempest-VolumesSnapshotNegativeTestJSON-907800577 None] Volume e7a3bc07-5014-422a-9664-117e91e219c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7a3bc07-5014-422a-9664-117e91e219c7', 'volume_size': 2} Apr 29 15:25:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-72e06c2c-0dbc-4318-9568-d021dc9d8211 tempest-VolumesSnapshotNegativeTestJSON-907800577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:25:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-72e06c2c-0dbc-4318-9568-d021dc9d8211 tempest-VolumesSnapshotNegativeTestJSON-907800577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:25:50 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-72e06c2c-0dbc-4318-9568-d021dc9d8211 tempest-VolumesSnapshotNegativeTestJSON-907800577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:25:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-280403244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7a3bc07-5014-422a-9664-117e91e219c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa4dfa9cecac4077ae6dbd3041de338c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:25:50Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:25:50Z,use_quota=True,user_id='063a538a8d29452a906e7759d195242e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:25:50 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-72e06c2c-0dbc-4318-9568-d021dc9d8211 tempest-VolumesSnapshotNegativeTestJSON-907800577 None] Creating volume e7a3bc07-5014-422a-9664-117e91e219c7 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:25:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-72e06c2c-0dbc-4318-9568-d021dc9d8211 tempest-VolumesSnapshotNegativeTestJSON-907800577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:25:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-72e06c2c-0dbc-4318-9568-d021dc9d8211 tempest-VolumesSnapshotNegativeTestJSON-907800577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:25:50 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-72e06c2c-0dbc-4318-9568-d021dc9d8211 tempest-VolumesSnapshotNegativeTestJSON-907800577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:25:50 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-72e06c2c-0dbc-4318-9568-d021dc9d8211 tempest-VolumesSnapshotNegativeTestJSON-907800577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:25:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-72e06c2c-0dbc-4318-9568-d021dc9d8211 tempest-VolumesSnapshotNegativeTestJSON-907800577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:25:50 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-72e06c2c-0dbc-4318-9568-d021dc9d8211 tempest-VolumesSnapshotNegativeTestJSON-907800577 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:25:50 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-72e06c2c-0dbc-4318-9568-d021dc9d8211 tempest-VolumesSnapshotNegativeTestJSON-907800577 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:25:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-72e06c2c-0dbc-4318-9568-d021dc9d8211 tempest-VolumesSnapshotNegativeTestJSON-907800577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-e7a3bc07-5014-422a-9664-117e91e219c7 2147483648 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:25:50 devstack sudo[105643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-e7a3bc07-5014-422a-9664-117e91e219c7 2147483648 Apr 29 15:25:50 devstack sudo[105643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:25:51 devstack sudo[105643]: pam_unix(sudo:session): session closed for user root Apr 29 15:25:51 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-72e06c2c-0dbc-4318-9568-d021dc9d8211 tempest-VolumesSnapshotNegativeTestJSON-907800577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-e7a3bc07-5014-422a-9664-117e91e219c7 2147483648" returned: 0 in 0.887s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:25:51 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-72e06c2c-0dbc-4318-9568-d021dc9d8211 tempest-VolumesSnapshotNegativeTestJSON-907800577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-e7a3bc07-5014-422a-9664-117e91e219c7 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:25:51 devstack sudo[105652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-e7a3bc07-5014-422a-9664-117e91e219c7 Apr 29 15:25:51 devstack sudo[105652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:25:51 devstack sudo[105652]: pam_unix(sudo:session): session closed for user root Apr 29 15:25:51 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-72e06c2c-0dbc-4318-9568-d021dc9d8211 tempest-VolumesSnapshotNegativeTestJSON-907800577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-e7a3bc07-5014-422a-9664-117e91e219c7" returned: 0 in 0.608s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:25:51 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-72e06c2c-0dbc-4318-9568-d021dc9d8211 tempest-VolumesSnapshotNegativeTestJSON-907800577 None] <== create_volume: return (1552ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:25:51 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-72e06c2c-0dbc-4318-9568-d021dc9d8211 tempest-VolumesSnapshotNegativeTestJSON-907800577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.555s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:25:51 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-72e06c2c-0dbc-4318-9568-d021dc9d8211 tempest-VolumesSnapshotNegativeTestJSON-907800577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (929bfefc-257e-4e7b-b107-6b01e08a053e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7a3bc07-5014-422a-9664-117e91e219c7', 'volume_size': 2}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:25:51 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-72e06c2c-0dbc-4318-9568-d021dc9d8211 tempest-VolumesSnapshotNegativeTestJSON-907800577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de9c7339-8c9f-4cb7-947f-917c91513023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:25:51 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-72e06c2c-0dbc-4318-9568-d021dc9d8211 tempest-VolumesSnapshotNegativeTestJSON-907800577 None] Volume volume-e7a3bc07-5014-422a-9664-117e91e219c7 (e7a3bc07-5014-422a-9664-117e91e219c7): created successfully Apr 29 15:25:51 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-72e06c2c-0dbc-4318-9568-d021dc9d8211 tempest-VolumesSnapshotNegativeTestJSON-907800577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de9c7339-8c9f-4cb7-947f-917c91513023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:25:51 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-72e06c2c-0dbc-4318-9568-d021dc9d8211 tempest-VolumesSnapshotNegativeTestJSON-907800577 None] Flow 'volume_create_manager' (ca1a8c27-fa3e-4ad6-ae31-a8adaf1b42d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:25:51 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-72e06c2c-0dbc-4318-9568-d021dc9d8211 tempest-VolumesSnapshotNegativeTestJSON-907800577 None] Created volume successfully. Apr 29 15:25:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-98e6a19e-dae6-4ceb-b931-354c2d542c47 tempest-VolumesSnapshotNegativeTestJSON-907800577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:25:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-98e6a19e-dae6-4ceb-b931-354c2d542c47 tempest-VolumesSnapshotNegativeTestJSON-907800577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:25:52 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-98e6a19e-dae6-4ceb-b931-354c2d542c47 tempest-VolumesSnapshotNegativeTestJSON-907800577 None] Creating offline snapshot 274baff5-3250-4ee8-b17a-c2990a1ff0fd of volume e7a3bc07-5014-422a-9664-117e91e219c7 {{(pid=84448) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 15:25:52 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[05fee884-f7ca-44f7-b388-0eb4ae9ea0c7]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:25:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-98e6a19e-dae6-4ceb-b931-354c2d542c47 tempest-VolumesSnapshotNegativeTestJSON-907800577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-e7a3bc07-5014-422a-9664-117e91e219c7 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:25:52 devstack sudo[105655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-e7a3bc07-5014-422a-9664-117e91e219c7 Apr 29 15:25:52 devstack sudo[105655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:25:53 devstack sudo[105655]: pam_unix(sudo:session): session closed for user root Apr 29 15:25:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-98e6a19e-dae6-4ceb-b931-354c2d542c47 tempest-VolumesSnapshotNegativeTestJSON-907800577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-e7a3bc07-5014-422a-9664-117e91e219c7" returned: 0 in 0.754s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:25:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-98e6a19e-dae6-4ceb-b931-354c2d542c47 tempest-VolumesSnapshotNegativeTestJSON-907800577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-e7a3bc07-5014-422a-9664-117e91e219c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-e7a3bc07-5014-422a-9664-117e91e219c7.274baff5-3250-4ee8-b17a-c2990a1ff0fd 2G {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:25:53 devstack sudo[105660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-e7a3bc07-5014-422a-9664-117e91e219c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-e7a3bc07-5014-422a-9664-117e91e219c7.274baff5-3250-4ee8-b17a-c2990a1ff0fd 2G Apr 29 15:25:53 devstack sudo[105660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:25:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-5eedd18f-066a-4748-b576-b05a76b7b0f9 req-9ae95b18-a978-4009-9cfd-bedc94d91506 tempest-TestStampPattern-538910304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:25:54 devstack sudo[105660]: pam_unix(sudo:session): session closed for user root Apr 29 15:25:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-98e6a19e-dae6-4ceb-b931-354c2d542c47 tempest-VolumesSnapshotNegativeTestJSON-907800577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-e7a3bc07-5014-422a-9664-117e91e219c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-e7a3bc07-5014-422a-9664-117e91e219c7.274baff5-3250-4ee8-b17a-c2990a1ff0fd 2G" returned: 0 in 0.798s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:25:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-98e6a19e-dae6-4ceb-b931-354c2d542c47 tempest-VolumesSnapshotNegativeTestJSON-907800577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7a3bc07-5014-422a-9664-117e91e219c7 -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-e7a3bc07-5014-422a-9664-117e91e219c7.274baff5-3250-4ee8-b17a-c2990a1ff0fd {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:25:54 devstack sudo[105673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7a3bc07-5014-422a-9664-117e91e219c7 -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-e7a3bc07-5014-422a-9664-117e91e219c7.274baff5-3250-4ee8-b17a-c2990a1ff0fd Apr 29 15:25:54 devstack sudo[105673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:25:54 devstack sudo[105673]: pam_unix(sudo:session): session closed for user root Apr 29 15:25:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-98e6a19e-dae6-4ceb-b931-354c2d542c47 tempest-VolumesSnapshotNegativeTestJSON-907800577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7a3bc07-5014-422a-9664-117e91e219c7 -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-e7a3bc07-5014-422a-9664-117e91e219c7.274baff5-3250-4ee8-b17a-c2990a1ff0fd" returned: 0 in 0.658s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:25:54 devstack cinder-volume[84448]: WARNING cinder.volume.drivers.remotefs [None req-98e6a19e-dae6-4ceb-b931-354c2d542c47 tempest-VolumesSnapshotNegativeTestJSON-907800577 None] /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-e7a3bc07-5014-422a-9664-117e91e219c7.274baff5-3250-4ee8-b17a-c2990a1ff0fd is being set with open permissions: ugo+rw Apr 29 15:25:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-98e6a19e-dae6-4ceb-b931-354c2d542c47 tempest-VolumesSnapshotNegativeTestJSON-907800577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-e7a3bc07-5014-422a-9664-117e91e219c7.274baff5-3250-4ee8-b17a-c2990a1ff0fd {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:25:54 devstack sudo[105683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-e7a3bc07-5014-422a-9664-117e91e219c7.274baff5-3250-4ee8-b17a-c2990a1ff0fd Apr 29 15:25:54 devstack sudo[105683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:25:55 devstack sudo[105683]: pam_unix(sudo:session): session closed for user root Apr 29 15:25:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-98e6a19e-dae6-4ceb-b931-354c2d542c47 tempest-VolumesSnapshotNegativeTestJSON-907800577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-e7a3bc07-5014-422a-9664-117e91e219c7.274baff5-3250-4ee8-b17a-c2990a1ff0fd" returned: 0 in 0.627s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:25:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-98e6a19e-dae6-4ceb-b931-354c2d542c47 tempest-VolumesSnapshotNegativeTestJSON-907800577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-e7a3bc07-5014-422a-9664-117e91e219c7.info {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:25:55 devstack sudo[105753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-e7a3bc07-5014-422a-9664-117e91e219c7.info Apr 29 15:25:55 devstack sudo[105753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:25:56 devstack sudo[105753]: pam_unix(sudo:session): session closed for user root Apr 29 15:25:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-98e6a19e-dae6-4ceb-b931-354c2d542c47 tempest-VolumesSnapshotNegativeTestJSON-907800577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-e7a3bc07-5014-422a-9664-117e91e219c7.info" returned: 0 in 0.675s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:25:56 devstack cinder-volume[84448]: WARNING cinder.volume.drivers.remotefs [None req-98e6a19e-dae6-4ceb-b931-354c2d542c47 tempest-VolumesSnapshotNegativeTestJSON-907800577 None] /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-e7a3bc07-5014-422a-9664-117e91e219c7.info is being set with open permissions: ugo+rw Apr 29 15:25:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-98e6a19e-dae6-4ceb-b931-354c2d542c47 tempest-VolumesSnapshotNegativeTestJSON-907800577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-e7a3bc07-5014-422a-9664-117e91e219c7.info {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:25:56 devstack sudo[105781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-e7a3bc07-5014-422a-9664-117e91e219c7.info Apr 29 15:25:56 devstack sudo[105781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:25:56 devstack sudo[105781]: pam_unix(sudo:session): session closed for user root Apr 29 15:25:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-98e6a19e-dae6-4ceb-b931-354c2d542c47 tempest-VolumesSnapshotNegativeTestJSON-907800577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-e7a3bc07-5014-422a-9664-117e91e219c7.info" returned: 0 in 0.609s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:25:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-98e6a19e-dae6-4ceb-b931-354c2d542c47 tempest-VolumesSnapshotNegativeTestJSON-907800577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.225s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:25:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-5eedd18f-066a-4748-b576-b05a76b7b0f9 req-9ae95b18-a978-4009-9cfd-bedc94d91506 tempest-TestStampPattern-538910304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.957s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:25:56 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[400b8185-5eed-446a-914b-a7f079fa52de]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:25:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-5eedd18f-066a-4748-b576-b05a76b7b0f9 req-9ae95b18-a978-4009-9cfd-bedc94d91506 tempest-TestStampPattern-538910304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-b062e17a-3235-47de-b7de-4fbbb10abfb7 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:25:56 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-98e6a19e-dae6-4ceb-b931-354c2d542c47 tempest-VolumesSnapshotNegativeTestJSON-907800577 None] Create snapshot completed successfully Apr 29 15:25:56 devstack sudo[105784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-b062e17a-3235-47de-b7de-4fbbb10abfb7 Apr 29 15:25:56 devstack sudo[105784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:25:57 devstack sudo[105784]: pam_unix(sudo:session): session closed for user root Apr 29 15:25:57 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-5eedd18f-066a-4748-b576-b05a76b7b0f9 req-9ae95b18-a978-4009-9cfd-bedc94d91506 tempest-TestStampPattern-538910304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-b062e17a-3235-47de-b7de-4fbbb10abfb7" returned: 0 in 0.678s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:25:57 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-5eedd18f-066a-4748-b576-b05a76b7b0f9 req-9ae95b18-a978-4009-9cfd-bedc94d91506 tempest-TestStampPattern-538910304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.698s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:25:57 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-5eedd18f-066a-4748-b576-b05a76b7b0f9 req-9ae95b18-a978-4009-9cfd-bedc94d91506 tempest-TestStampPattern-538910304 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a', 'name': 'volume-b062e17a-3235-47de-b7de-4fbbb10abfb7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '86dd2221-5adf-4cc0-b065-bea00448c11a', 'enforce_multipath': True} {{(pid=84448) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 15:25:57 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-5eedd18f-066a-4748-b576-b05a76b7b0f9 req-9ae95b18-a978-4009-9cfd-bedc94d91506 tempest-TestStampPattern-538910304 None] attachment_update completed successfully. Apr 29 15:25:57 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a624c7f5-e8f5-450a-bedf-fe166b67604a tempest-VolumesSnapshotNegativeTestJSON-907800577 None] Acquiring lock "cinder-274baff5-3250-4ee8-b17a-c2990a1ff0fd-delete_snapshot" by "delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:25:57 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a624c7f5-e8f5-450a-bedf-fe166b67604a tempest-VolumesSnapshotNegativeTestJSON-907800577 None] Lock "cinder-274baff5-3250-4ee8-b17a-c2990a1ff0fd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:25:57 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a624c7f5-e8f5-450a-bedf-fe166b67604a tempest-VolumesSnapshotNegativeTestJSON-907800577 None] Acquiring lock "cinder-quobyte-e7a3bc07-5014-422a-9664-117e91e219c7" by "delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:25:57 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a624c7f5-e8f5-450a-bedf-fe166b67604a tempest-VolumesSnapshotNegativeTestJSON-907800577 None] Lock "cinder-quobyte-e7a3bc07-5014-422a-9664-117e91e219c7" acquired by "delete_snapshot" :: waited 0.014s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:25:57 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a624c7f5-e8f5-450a-bedf-fe166b67604a tempest-VolumesSnapshotNegativeTestJSON-907800577 None] Acquiring lock "cinder-quobyte-274baff5-3250-4ee8-b17a-c2990a1ff0fd" by "_delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:25:57 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a624c7f5-e8f5-450a-bedf-fe166b67604a tempest-VolumesSnapshotNegativeTestJSON-907800577 None] Lock "cinder-quobyte-274baff5-3250-4ee8-b17a-c2990a1ff0fd" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:25:57 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-a624c7f5-e8f5-450a-bedf-fe166b67604a tempest-VolumesSnapshotNegativeTestJSON-907800577 None] Deleting offline snapshot 274baff5-3250-4ee8-b17a-c2990a1ff0fd of volume e7a3bc07-5014-422a-9664-117e91e219c7 {{(pid=84448) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 15:25:57 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-a624c7f5-e8f5-450a-bedf-fe166b67604a tempest-VolumesSnapshotNegativeTestJSON-907800577 None] snapshot_file for this snap is: volume-e7a3bc07-5014-422a-9664-117e91e219c7.274baff5-3250-4ee8-b17a-c2990a1ff0fd {{(pid=84448) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 15:25:57 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb14787-66ee-487e-84ec-18db7ae0c152]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:25:57 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a624c7f5-e8f5-450a-bedf-fe166b67604a tempest-VolumesSnapshotNegativeTestJSON-907800577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-e7a3bc07-5014-422a-9664-117e91e219c7.274baff5-3250-4ee8-b17a-c2990a1ff0fd {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:25:57 devstack sudo[105789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-e7a3bc07-5014-422a-9664-117e91e219c7.274baff5-3250-4ee8-b17a-c2990a1ff0fd Apr 29 15:25:57 devstack sudo[105789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:25:58 devstack sudo[105789]: pam_unix(sudo:session): session closed for user root Apr 29 15:25:58 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a624c7f5-e8f5-450a-bedf-fe166b67604a tempest-VolumesSnapshotNegativeTestJSON-907800577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-e7a3bc07-5014-422a-9664-117e91e219c7.274baff5-3250-4ee8-b17a-c2990a1ff0fd" returned: 0 in 0.736s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:25:58 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-a624c7f5-e8f5-450a-bedf-fe166b67604a tempest-VolumesSnapshotNegativeTestJSON-907800577 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7a3bc07-5014-422a-9664-117e91e219c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84448) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 15:25:58 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[427e29bd-9915-43ae-a108-ab38593d2b42]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:25:58 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a624c7f5-e8f5-450a-bedf-fe166b67604a tempest-VolumesSnapshotNegativeTestJSON-907800577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-e7a3bc07-5014-422a-9664-117e91e219c7 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:25:58 devstack sudo[105796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-e7a3bc07-5014-422a-9664-117e91e219c7 Apr 29 15:25:58 devstack sudo[105796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:25:59 devstack sudo[105796]: pam_unix(sudo:session): session closed for user root Apr 29 15:25:59 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a624c7f5-e8f5-450a-bedf-fe166b67604a tempest-VolumesSnapshotNegativeTestJSON-907800577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-e7a3bc07-5014-422a-9664-117e91e219c7" returned: 0 in 0.708s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:25:59 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a624c7f5-e8f5-450a-bedf-fe166b67604a tempest-VolumesSnapshotNegativeTestJSON-907800577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-e7a3bc07-5014-422a-9664-117e91e219c7.274baff5-3250-4ee8-b17a-c2990a1ff0fd {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:25:59 devstack sudo[105801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-e7a3bc07-5014-422a-9664-117e91e219c7.274baff5-3250-4ee8-b17a-c2990a1ff0fd Apr 29 15:25:59 devstack sudo[105801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:26:00 devstack sudo[105801]: pam_unix(sudo:session): session closed for user root Apr 29 15:26:00 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a624c7f5-e8f5-450a-bedf-fe166b67604a tempest-VolumesSnapshotNegativeTestJSON-907800577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-e7a3bc07-5014-422a-9664-117e91e219c7.274baff5-3250-4ee8-b17a-c2990a1ff0fd" returned: 0 in 0.699s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:26:00 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a624c7f5-e8f5-450a-bedf-fe166b67604a tempest-VolumesSnapshotNegativeTestJSON-907800577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-e7a3bc07-5014-422a-9664-117e91e219c7.274baff5-3250-4ee8-b17a-c2990a1ff0fd {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:26:00 devstack sudo[105806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-e7a3bc07-5014-422a-9664-117e91e219c7.274baff5-3250-4ee8-b17a-c2990a1ff0fd Apr 29 15:26:00 devstack sudo[105806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:26:00 devstack sudo[105806]: pam_unix(sudo:session): session closed for user root Apr 29 15:26:00 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a624c7f5-e8f5-450a-bedf-fe166b67604a tempest-VolumesSnapshotNegativeTestJSON-907800577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-e7a3bc07-5014-422a-9664-117e91e219c7.274baff5-3250-4ee8-b17a-c2990a1ff0fd" returned: 0 in 0.584s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:26:00 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a624c7f5-e8f5-450a-bedf-fe166b67604a tempest-VolumesSnapshotNegativeTestJSON-907800577 None] Lock "cinder-quobyte-274baff5-3250-4ee8-b17a-c2990a1ff0fd" released by "_delete_snapshot" :: held 2.821s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:26:00 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a624c7f5-e8f5-450a-bedf-fe166b67604a tempest-VolumesSnapshotNegativeTestJSON-907800577 None] Lock "cinder-quobyte-e7a3bc07-5014-422a-9664-117e91e219c7" released by "delete_snapshot" :: held 2.843s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:26:00 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-a624c7f5-e8f5-450a-bedf-fe166b67604a tempest-VolumesSnapshotNegativeTestJSON-907800577 None] Created reservations ['49277585-b0cf-4031-ba02-644f1939ce9a', '6f96a2b5-c70f-4ad2-aff5-6abd230dd0fa', 'd9970cc2-c8dd-440f-9631-4bf28e5e0759', '0791a7e9-fa6d-4a79-aa81-85318921fdd4'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:26:00 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-a624c7f5-e8f5-450a-bedf-fe166b67604a tempest-VolumesSnapshotNegativeTestJSON-907800577 None] Delete snapshot completed successfully. Apr 29 15:26:00 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a624c7f5-e8f5-450a-bedf-fe166b67604a tempest-VolumesSnapshotNegativeTestJSON-907800577 None] Lock "cinder-274baff5-3250-4ee8-b17a-c2990a1ff0fd-delete_snapshot" released by "delete_snapshot" :: held 2.987s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:26:01 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-561cfd8f-a6fb-4731-8bbf-80c95adbbc22 tempest-VolumesSnapshotNegativeTestJSON-907800577 None] Acquiring lock "cinder-e7a3bc07-5014-422a-9664-117e91e219c7-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:26:01 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-561cfd8f-a6fb-4731-8bbf-80c95adbbc22 tempest-VolumesSnapshotNegativeTestJSON-907800577 None] Lock "cinder-e7a3bc07-5014-422a-9664-117e91e219c7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:26:01 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-561cfd8f-a6fb-4731-8bbf-80c95adbbc22 tempest-VolumesSnapshotNegativeTestJSON-907800577 None] Acquiring lock "cinder-quobyte-e7a3bc07-5014-422a-9664-117e91e219c7" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:26:01 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-561cfd8f-a6fb-4731-8bbf-80c95adbbc22 tempest-VolumesSnapshotNegativeTestJSON-907800577 None] Lock "cinder-quobyte-e7a3bc07-5014-422a-9664-117e91e219c7" acquired by "delete_volume" :: waited 0.015s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:26:01 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2445a97-6b13-4240-9826-204261b99138]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:26:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-561cfd8f-a6fb-4731-8bbf-80c95adbbc22 tempest-VolumesSnapshotNegativeTestJSON-907800577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-e7a3bc07-5014-422a-9664-117e91e219c7 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:26:01 devstack sudo[105809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-e7a3bc07-5014-422a-9664-117e91e219c7 Apr 29 15:26:01 devstack sudo[105809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:26:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-561cfd8f-a6fb-4731-8bbf-80c95adbbc22 tempest-VolumesSnapshotNegativeTestJSON-907800577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-e7a3bc07-5014-422a-9664-117e91e219c7" returned: 0 in 0.723s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:26:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-561cfd8f-a6fb-4731-8bbf-80c95adbbc22 tempest-VolumesSnapshotNegativeTestJSON-907800577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-e7a3bc07-5014-422a-9664-117e91e219c7 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:26:01 devstack sudo[105809]: pam_unix(sudo:session): session closed for user root Apr 29 15:26:01 devstack sudo[105816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-e7a3bc07-5014-422a-9664-117e91e219c7 Apr 29 15:26:01 devstack sudo[105816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:26:02 devstack sudo[105816]: pam_unix(sudo:session): session closed for user root Apr 29 15:26:02 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-561cfd8f-a6fb-4731-8bbf-80c95adbbc22 tempest-VolumesSnapshotNegativeTestJSON-907800577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-e7a3bc07-5014-422a-9664-117e91e219c7" returned: 0 in 0.595s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:26:02 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-561cfd8f-a6fb-4731-8bbf-80c95adbbc22 tempest-VolumesSnapshotNegativeTestJSON-907800577 None] Lock "cinder-quobyte-e7a3bc07-5014-422a-9664-117e91e219c7" released by "delete_volume" :: held 1.374s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:26:02 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-561cfd8f-a6fb-4731-8bbf-80c95adbbc22 tempest-VolumesSnapshotNegativeTestJSON-907800577 None] Created reservations ['c74c98c4-b3db-4496-a984-0077b0bd0c5c', '372c2fc3-5fc4-43ff-9eb9-e22d73b9d153', 'd86002d3-3b8d-4748-a32f-1eba64ce111f', '475b98c0-3892-4707-8027-cafb3dcd5bcf'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:26:02 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-561cfd8f-a6fb-4731-8bbf-80c95adbbc22 tempest-VolumesSnapshotNegativeTestJSON-907800577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:26:02 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-561cfd8f-a6fb-4731-8bbf-80c95adbbc22 tempest-VolumesSnapshotNegativeTestJSON-907800577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:26:02 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-561cfd8f-a6fb-4731-8bbf-80c95adbbc22 tempest-VolumesSnapshotNegativeTestJSON-907800577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:26:02 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-561cfd8f-a6fb-4731-8bbf-80c95adbbc22 tempest-VolumesSnapshotNegativeTestJSON-907800577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:26:02 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-561cfd8f-a6fb-4731-8bbf-80c95adbbc22 tempest-VolumesSnapshotNegativeTestJSON-907800577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:26:02 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-561cfd8f-a6fb-4731-8bbf-80c95adbbc22 tempest-VolumesSnapshotNegativeTestJSON-907800577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:26:02 devstack sudo[105831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:26:02 devstack sudo[105831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:26:03 devstack sudo[105831]: pam_unix(sudo:session): session closed for user root Apr 29 15:26:03 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-561cfd8f-a6fb-4731-8bbf-80c95adbbc22 tempest-VolumesSnapshotNegativeTestJSON-907800577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.663s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:26:03 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-561cfd8f-a6fb-4731-8bbf-80c95adbbc22 tempest-VolumesSnapshotNegativeTestJSON-907800577 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:26:03 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-561cfd8f-a6fb-4731-8bbf-80c95adbbc22 tempest-VolumesSnapshotNegativeTestJSON-907800577 None] Deleted volume successfully. Apr 29 15:26:03 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-561cfd8f-a6fb-4731-8bbf-80c95adbbc22 tempest-VolumesSnapshotNegativeTestJSON-907800577 None] Lock "cinder-e7a3bc07-5014-422a-9664-117e91e219c7-delete_volume" released by "delete_volume" :: held 2.225s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:26:04 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-858dd320-3dbc-4a05-8029-94346d3b8b6b req-21d418aa-d4f1-4873-8e3d-48bd1b9785a0 tempest-TestStampPattern-538910304 None] Terminate volume connection completed successfully. Apr 29 15:26:04 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-858dd320-3dbc-4a05-8029-94346d3b8b6b req-21d418aa-d4f1-4873-8e3d-48bd1b9785a0 tempest-TestStampPattern-538910304 None] Deleting attachment 86dd2221-5adf-4cc0-b065-bea00448c11a. {{(pid=84448) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 15:26:08 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-2072782d-08f8-4caf-9e4d-6e38c5cdfa02 tempest-VolumeImageDependencyTests-1879610301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:26:08 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-2072782d-08f8-4caf-9e4d-6e38c5cdfa02 tempest-VolumeImageDependencyTests-1879610301 None] Flow 'volume_create_manager' (ef79f7f1-2124-42dc-b8d3-44223e92e4cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:26:08 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-2072782d-08f8-4caf-9e4d-6e38c5cdfa02 tempest-VolumeImageDependencyTests-1879610301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7c696cc-b14e-4e6d-88c4-830bb755995d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:26:08 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-2072782d-08f8-4caf-9e4d-6e38c5cdfa02 tempest-VolumeImageDependencyTests-1879610301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7c696cc-b14e-4e6d-88c4-830bb755995d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:26:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baccef8f-66a2-449b-81b5-3b5a62c90484,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7483e8856bb74ada95b4d183ebce2cd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:26:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:26:09Z,use_quota=True,user_id='a31d9739950549d2b7305d57e441dfb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:26:08 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-2072782d-08f8-4caf-9e4d-6e38c5cdfa02 tempest-VolumeImageDependencyTests-1879610301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8aa717ef-575a-4a96-ac1b-60b3fec13cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:26:08 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-2072782d-08f8-4caf-9e4d-6e38c5cdfa02 tempest-VolumeImageDependencyTests-1879610301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8aa717ef-575a-4a96-ac1b-60b3fec13cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:26:08 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-2072782d-08f8-4caf-9e4d-6e38c5cdfa02 tempest-VolumeImageDependencyTests-1879610301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2091c89-3ef7-406d-8438-296a67f88870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:26:08 devstack cinder-volume[84448]: DEBUG cinder.image.glance [None req-2072782d-08f8-4caf-9e4d-6e38c5cdfa02 tempest-VolumeImageDependencyTests-1879610301 None] Creating Keystone auth plugin from conf {{(pid=84448) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 29 15:26:09 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-2072782d-08f8-4caf-9e4d-6e38c5cdfa02 tempest-VolumeImageDependencyTests-1879610301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2091c89-3ef7-406d-8438-296a67f88870) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'baccef8f-66a2-449b-81b5-3b5a62c90484', 'volume_name': 'volume-baccef8f-66a2-449b-81b5-3b5a62c90484', 'volume_size': 1, 'image_id': 'ef87ecf6-27aa-4619-b3e5-6489b132297f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ef87ecf6-27aa-4619-b3e5-6489b132297f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7c205c0588fb27f3f8f9e08a80fc5c56', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7483e8856bb74ada95b4d183ebce2cd5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8aeb87a501118ced18e562dc7507258b6a57dbfe6ac45027185ebf43c2c436b9096945e0105a9b014169a50addff0b4dfd46c187509d44b45745c19ca12d9be7', 'id': 'ef87ecf6-27aa-4619-b3e5-6489b132297f', 'created_at': datetime.datetime(2026, 4, 29, 13, 26, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 13, 26, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ef87ecf6-27aa-4619-b3e5-6489b132297f/file', 'properties': {}}, 'image_service': }' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:26:09 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-2072782d-08f8-4caf-9e4d-6e38c5cdfa02 tempest-VolumeImageDependencyTests-1879610301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2161a062-fb9b-4110-8c6f-6524e39c6cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:26:09 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-2072782d-08f8-4caf-9e4d-6e38c5cdfa02 tempest-VolumeImageDependencyTests-1879610301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2161a062-fb9b-4110-8c6f-6524e39c6cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:26:09 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-2072782d-08f8-4caf-9e4d-6e38c5cdfa02 tempest-VolumeImageDependencyTests-1879610301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaddcd92-f6bf-4716-942c-c05d54c81f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:26:09 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-2072782d-08f8-4caf-9e4d-6e38c5cdfa02 tempest-VolumeImageDependencyTests-1879610301 None] Volume baccef8f-66a2-449b-81b5-3b5a62c90484: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-baccef8f-66a2-449b-81b5-3b5a62c90484', 'volume_size': 1, 'image_id': 'ef87ecf6-27aa-4619-b3e5-6489b132297f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ef87ecf6-27aa-4619-b3e5-6489b132297f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7c205c0588fb27f3f8f9e08a80fc5c56', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7483e8856bb74ada95b4d183ebce2cd5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8aeb87a501118ced18e562dc7507258b6a57dbfe6ac45027185ebf43c2c436b9096945e0105a9b014169a50addff0b4dfd46c187509d44b45745c19ca12d9be7', 'id': 'ef87ecf6-27aa-4619-b3e5-6489b132297f', 'created_at': datetime.datetime(2026, 4, 29, 13, 26, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 13, 26, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ef87ecf6-27aa-4619-b3e5-6489b132297f/file', 'properties': {}}, 'image_service': } Apr 29 15:26:09 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-2072782d-08f8-4caf-9e4d-6e38c5cdfa02 tempest-VolumeImageDependencyTests-1879610301 None] Trying to clone baccef8f-66a2-449b-81b5-3b5a62c90484 from image ef87ecf6-27aa-4619-b3e5-6489b132297f at location (None, [{'url': 'file:///opt/stack/data/glance/images/ef87ecf6-27aa-4619-b3e5-6489b132297f', 'metadata': {}}]). {{(pid=84448) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 29 15:26:09 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [None req-2072782d-08f8-4caf-9e4d-6e38c5cdfa02 tempest-VolumeImageDependencyTests-1879610301 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ef87ecf6-27aa-4619-b3e5-6489b132297f_jn1eu414devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=84448) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 29 15:26:09 devstack cinder-volume[84448]: INFO cinder.image.image_utils [None req-2072782d-08f8-4caf-9e4d-6e38c5cdfa02 tempest-VolumeImageDependencyTests-1879610301 None] Image download 0.00 MB at 0.00 MB/s Apr 29 15:26:09 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[2038b094-d539-4d0f-8c23-f97d4f526359]: (4, 'raw') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:26:09 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-2072782d-08f8-4caf-9e4d-6e38c5cdfa02 tempest-VolumeImageDependencyTests-1879610301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ef87ecf6-27aa-4619-b3e5-6489b132297f_jn1eu414devstack@QuobyteHD {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:26:09 devstack sudo[105890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ef87ecf6-27aa-4619-b3e5-6489b132297f_jn1eu414devstack@QuobyteHD Apr 29 15:26:09 devstack sudo[105890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:26:09 devstack sudo[105890]: pam_unix(sudo:session): session closed for user root Apr 29 15:26:09 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-2072782d-08f8-4caf-9e4d-6e38c5cdfa02 tempest-VolumeImageDependencyTests-1879610301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ef87ecf6-27aa-4619-b3e5-6489b132297f_jn1eu414devstack@QuobyteHD" returned: 0 in 0.695s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:26:09 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-2072782d-08f8-4caf-9e4d-6e38c5cdfa02 tempest-VolumeImageDependencyTests-1879610301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ef87ecf6-27aa-4619-b3e5-6489b132297f_jn1eu414devstack@QuobyteHD {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:26:10 devstack sudo[105898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ef87ecf6-27aa-4619-b3e5-6489b132297f_jn1eu414devstack@QuobyteHD Apr 29 15:26:10 devstack sudo[105898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:26:10 devstack sudo[105898]: pam_unix(sudo:session): session closed for user root Apr 29 15:26:10 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-2072782d-08f8-4caf-9e4d-6e38c5cdfa02 tempest-VolumeImageDependencyTests-1879610301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ef87ecf6-27aa-4619-b3e5-6489b132297f_jn1eu414devstack@QuobyteHD" returned: 1 in 0.746s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:26:10 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-2072782d-08f8-4caf-9e4d-6e38c5cdfa02 tempest-VolumeImageDependencyTests-1879610301 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ef87ecf6-27aa-4619-b3e5-6489b132297f_jn1eu414devstack@QuobyteHD' failed. Not Retrying. {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 15:26:10 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [None req-2072782d-08f8-4caf-9e4d-6e38c5cdfa02 tempest-VolumeImageDependencyTests-1879610301 None] Temporary image ef87ecf6-27aa-4619-b3e5-6489b132297f is fetched for user a31d9739950549d2b7305d57e441dfb9. {{(pid=84448) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 29 15:26:10 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc29b3bc-806a-4f83-a6c7-1e8a8c7e7981]: (4, 'raw') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:26:10 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-2072782d-08f8-4caf-9e4d-6e38c5cdfa02 tempest-VolumeImageDependencyTests-1879610301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ef87ecf6-27aa-4619-b3e5-6489b132297f_jn1eu414devstack@QuobyteHD {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:26:10 devstack sudo[105904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ef87ecf6-27aa-4619-b3e5-6489b132297f_jn1eu414devstack@QuobyteHD Apr 29 15:26:10 devstack sudo[105904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:26:11 devstack sudo[105904]: pam_unix(sudo:session): session closed for user root Apr 29 15:26:11 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-2072782d-08f8-4caf-9e4d-6e38c5cdfa02 tempest-VolumeImageDependencyTests-1879610301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ef87ecf6-27aa-4619-b3e5-6489b132297f_jn1eu414devstack@QuobyteHD" returned: 0 in 0.689s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:26:11 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-2072782d-08f8-4caf-9e4d-6e38c5cdfa02 tempest-VolumeImageDependencyTests-1879610301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ef87ecf6-27aa-4619-b3e5-6489b132297f_jn1eu414devstack@QuobyteHD {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:26:11 devstack sudo[105908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ef87ecf6-27aa-4619-b3e5-6489b132297f_jn1eu414devstack@QuobyteHD Apr 29 15:26:11 devstack sudo[105908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:26:12 devstack sudo[105908]: pam_unix(sudo:session): session closed for user root Apr 29 15:26:12 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-2072782d-08f8-4caf-9e4d-6e38c5cdfa02 tempest-VolumeImageDependencyTests-1879610301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ef87ecf6-27aa-4619-b3e5-6489b132297f_jn1eu414devstack@QuobyteHD" returned: 1 in 0.693s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:26:12 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-2072782d-08f8-4caf-9e4d-6e38c5cdfa02 tempest-VolumeImageDependencyTests-1879610301 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ef87ecf6-27aa-4619-b3e5-6489b132297f_jn1eu414devstack@QuobyteHD' failed. Not Retrying. {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 15:26:12 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-2072782d-08f8-4caf-9e4d-6e38c5cdfa02 tempest-VolumeImageDependencyTests-1879610301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:26:12 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-2072782d-08f8-4caf-9e4d-6e38c5cdfa02 tempest-VolumeImageDependencyTests-1879610301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:26:12 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-2072782d-08f8-4caf-9e4d-6e38c5cdfa02 tempest-VolumeImageDependencyTests-1879610301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:26:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baccef8f-66a2-449b-81b5-3b5a62c90484,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7483e8856bb74ada95b4d183ebce2cd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:26:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:26:09Z,use_quota=True,user_id='a31d9739950549d2b7305d57e441dfb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:26:12 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-2072782d-08f8-4caf-9e4d-6e38c5cdfa02 tempest-VolumeImageDependencyTests-1879610301 None] Creating volume baccef8f-66a2-449b-81b5-3b5a62c90484 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:26:12 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-2072782d-08f8-4caf-9e4d-6e38c5cdfa02 tempest-VolumeImageDependencyTests-1879610301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:26:12 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-2072782d-08f8-4caf-9e4d-6e38c5cdfa02 tempest-VolumeImageDependencyTests-1879610301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:26:12 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-2072782d-08f8-4caf-9e4d-6e38c5cdfa02 tempest-VolumeImageDependencyTests-1879610301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:26:12 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-2072782d-08f8-4caf-9e4d-6e38c5cdfa02 tempest-VolumeImageDependencyTests-1879610301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:26:12 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-2072782d-08f8-4caf-9e4d-6e38c5cdfa02 tempest-VolumeImageDependencyTests-1879610301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:26:12 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-2072782d-08f8-4caf-9e4d-6e38c5cdfa02 tempest-VolumeImageDependencyTests-1879610301 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:26:12 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-2072782d-08f8-4caf-9e4d-6e38c5cdfa02 tempest-VolumeImageDependencyTests-1879610301 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:26:12 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-2072782d-08f8-4caf-9e4d-6e38c5cdfa02 tempest-VolumeImageDependencyTests-1879610301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-baccef8f-66a2-449b-81b5-3b5a62c90484 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:26:12 devstack sudo[105913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-baccef8f-66a2-449b-81b5-3b5a62c90484 1073741824 Apr 29 15:26:12 devstack sudo[105913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:26:12 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-2be554de-9f70-45ae-89fe-adeab69c421f req-ecaaf701-51db-460c-9f7e-8fc204e5c098 tempest-TestInstancesWithCinderVolumes-634922416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:26:12 devstack sudo[105913]: pam_unix(sudo:session): session closed for user root Apr 29 15:26:12 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-2072782d-08f8-4caf-9e4d-6e38c5cdfa02 tempest-VolumeImageDependencyTests-1879610301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-baccef8f-66a2-449b-81b5-3b5a62c90484 1073741824" returned: 0 in 0.824s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:26:12 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-2072782d-08f8-4caf-9e4d-6e38c5cdfa02 tempest-VolumeImageDependencyTests-1879610301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-baccef8f-66a2-449b-81b5-3b5a62c90484 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:26:12 devstack sudo[105927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-baccef8f-66a2-449b-81b5-3b5a62c90484 Apr 29 15:26:12 devstack sudo[105927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:26:13 devstack sudo[105927]: pam_unix(sudo:session): session closed for user root Apr 29 15:26:13 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-2072782d-08f8-4caf-9e4d-6e38c5cdfa02 tempest-VolumeImageDependencyTests-1879610301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-baccef8f-66a2-449b-81b5-3b5a62c90484" returned: 0 in 0.601s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:26:13 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-2072782d-08f8-4caf-9e4d-6e38c5cdfa02 tempest-VolumeImageDependencyTests-1879610301 None] <== create_volume: return (1475ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:26:13 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-2072782d-08f8-4caf-9e4d-6e38c5cdfa02 tempest-VolumeImageDependencyTests-1879610301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.478s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:26:13 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-2be554de-9f70-45ae-89fe-adeab69c421f req-ecaaf701-51db-460c-9f7e-8fc204e5c098 tempest-TestInstancesWithCinderVolumes-634922416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.705s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:26:13 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe29061c-a53f-4a4b-b671-ee22bd66f559]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:26:13 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-2be554de-9f70-45ae-89fe-adeab69c421f req-ecaaf701-51db-460c-9f7e-8fc204e5c098 tempest-TestInstancesWithCinderVolumes-634922416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-72578478-516d-4a91-ae69-d068d73653cd {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:26:13 devstack cinder-volume[84448]: DEBUG cinder.volume.volume_utils [None req-2072782d-08f8-4caf-9e4d-6e38c5cdfa02 tempest-VolumeImageDependencyTests-1879610301 None] Attempting download of ef87ecf6-27aa-4619-b3e5-6489b132297f ((None, [{'url': 'file:///opt/stack/data/glance/images/ef87ecf6-27aa-4619-b3e5-6489b132297f', 'metadata': {}}])) to volume baccef8f-66a2-449b-81b5-3b5a62c90484. {{(pid=84448) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 29 15:26:13 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[a401b89e-5d6d-4a04-a013-2d1ef3dce2be]: (4, 'raw') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:26:13 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-2072782d-08f8-4caf-9e4d-6e38c5cdfa02 tempest-VolumeImageDependencyTests-1879610301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ef87ecf6-27aa-4619-b3e5-6489b132297f_2mf7hw94 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:26:13 devstack sudo[105930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-72578478-516d-4a91-ae69-d068d73653cd Apr 29 15:26:13 devstack sudo[105930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:26:13 devstack sudo[105931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ef87ecf6-27aa-4619-b3e5-6489b132297f_2mf7hw94 Apr 29 15:26:13 devstack sudo[105931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:26:14 devstack sudo[105930]: pam_unix(sudo:session): session closed for user root Apr 29 15:26:14 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-2be554de-9f70-45ae-89fe-adeab69c421f req-ecaaf701-51db-460c-9f7e-8fc204e5c098 tempest-TestInstancesWithCinderVolumes-634922416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-72578478-516d-4a91-ae69-d068d73653cd" returned: 0 in 0.714s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:26:14 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-2be554de-9f70-45ae-89fe-adeab69c421f req-ecaaf701-51db-460c-9f7e-8fc204e5c098 tempest-TestInstancesWithCinderVolumes-634922416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.734s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:26:14 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-2be554de-9f70-45ae-89fe-adeab69c421f req-ecaaf701-51db-460c-9f7e-8fc204e5c098 tempest-TestInstancesWithCinderVolumes-634922416 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a', 'name': 'volume-72578478-516d-4a91-ae69-d068d73653cd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '98579fc4-a40f-4073-8c21-bc09a802318b', 'enforce_multipath': True} {{(pid=84448) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 15:26:14 devstack sudo[105931]: pam_unix(sudo:session): session closed for user root Apr 29 15:26:14 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-2072782d-08f8-4caf-9e4d-6e38c5cdfa02 tempest-VolumeImageDependencyTests-1879610301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ef87ecf6-27aa-4619-b3e5-6489b132297f_2mf7hw94" returned: 0 in 0.714s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:26:14 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-2072782d-08f8-4caf-9e4d-6e38c5cdfa02 tempest-VolumeImageDependencyTests-1879610301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ef87ecf6-27aa-4619-b3e5-6489b132297f_2mf7hw94 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:26:14 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-2be554de-9f70-45ae-89fe-adeab69c421f req-ecaaf701-51db-460c-9f7e-8fc204e5c098 tempest-TestInstancesWithCinderVolumes-634922416 None] attachment_update completed successfully. Apr 29 15:26:14 devstack sudo[105939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ef87ecf6-27aa-4619-b3e5-6489b132297f_2mf7hw94 Apr 29 15:26:14 devstack sudo[105939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:26:14 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-6bc33b23-5c55-48a6-9271-1fd0dd04818f tempest-TestStampPattern-538910304 None] Acquiring lock "cinder-b062e17a-3235-47de-b7de-4fbbb10abfb7-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:26:14 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-6bc33b23-5c55-48a6-9271-1fd0dd04818f tempest-TestStampPattern-538910304 None] Lock "cinder-b062e17a-3235-47de-b7de-4fbbb10abfb7-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:26:14 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-6bc33b23-5c55-48a6-9271-1fd0dd04818f tempest-TestStampPattern-538910304 None] Acquiring lock "cinder-quobyte-b062e17a-3235-47de-b7de-4fbbb10abfb7" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:26:14 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-6bc33b23-5c55-48a6-9271-1fd0dd04818f tempest-TestStampPattern-538910304 None] Lock "cinder-quobyte-b062e17a-3235-47de-b7de-4fbbb10abfb7" acquired by "delete_volume" :: waited 0.015s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:26:14 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[e302318c-71bd-4220-ab96-a4f9f6b6b903]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:26:14 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6bc33b23-5c55-48a6-9271-1fd0dd04818f tempest-TestStampPattern-538910304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-b062e17a-3235-47de-b7de-4fbbb10abfb7 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:26:14 devstack sudo[105941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-b062e17a-3235-47de-b7de-4fbbb10abfb7 Apr 29 15:26:14 devstack sudo[105941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:26:15 devstack sudo[105939]: pam_unix(sudo:session): session closed for user root Apr 29 15:26:15 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-2072782d-08f8-4caf-9e4d-6e38c5cdfa02 tempest-VolumeImageDependencyTests-1879610301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ef87ecf6-27aa-4619-b3e5-6489b132297f_2mf7hw94" returned: 1 in 0.710s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:26:15 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-2072782d-08f8-4caf-9e4d-6e38c5cdfa02 tempest-VolumeImageDependencyTests-1879610301 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ef87ecf6-27aa-4619-b3e5-6489b132297f_2mf7hw94' failed. Not Retrying. {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 15:26:15 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc7357b-b65e-400d-9fa0-7aa8b9c8a325]: (4, 'raw') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:26:15 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-2072782d-08f8-4caf-9e4d-6e38c5cdfa02 tempest-VolumeImageDependencyTests-1879610301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ef87ecf6-27aa-4619-b3e5-6489b132297f_jn1eu414devstack@QuobyteHD {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:26:15 devstack sudo[105945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ef87ecf6-27aa-4619-b3e5-6489b132297f_jn1eu414devstack@QuobyteHD Apr 29 15:26:15 devstack sudo[105945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:26:15 devstack sudo[105941]: pam_unix(sudo:session): session closed for user root Apr 29 15:26:15 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6bc33b23-5c55-48a6-9271-1fd0dd04818f tempest-TestStampPattern-538910304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-b062e17a-3235-47de-b7de-4fbbb10abfb7" returned: 0 in 0.727s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:26:15 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6bc33b23-5c55-48a6-9271-1fd0dd04818f tempest-TestStampPattern-538910304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-b062e17a-3235-47de-b7de-4fbbb10abfb7 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:26:15 devstack sudo[105950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-b062e17a-3235-47de-b7de-4fbbb10abfb7 Apr 29 15:26:15 devstack sudo[105950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:26:15 devstack sudo[105945]: pam_unix(sudo:session): session closed for user root Apr 29 15:26:15 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-2072782d-08f8-4caf-9e4d-6e38c5cdfa02 tempest-VolumeImageDependencyTests-1879610301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ef87ecf6-27aa-4619-b3e5-6489b132297f_jn1eu414devstack@QuobyteHD" returned: 0 in 0.707s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:26:15 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-2072782d-08f8-4caf-9e4d-6e38c5cdfa02 tempest-VolumeImageDependencyTests-1879610301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ef87ecf6-27aa-4619-b3e5-6489b132297f_jn1eu414devstack@QuobyteHD {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:26:15 devstack sudo[105957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ef87ecf6-27aa-4619-b3e5-6489b132297f_jn1eu414devstack@QuobyteHD Apr 29 15:26:15 devstack sudo[105957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:26:16 devstack sudo[105950]: pam_unix(sudo:session): session closed for user root Apr 29 15:26:16 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6bc33b23-5c55-48a6-9271-1fd0dd04818f tempest-TestStampPattern-538910304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-b062e17a-3235-47de-b7de-4fbbb10abfb7" returned: 0 in 0.649s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:26:16 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-6bc33b23-5c55-48a6-9271-1fd0dd04818f tempest-TestStampPattern-538910304 None] Lock "cinder-quobyte-b062e17a-3235-47de-b7de-4fbbb10abfb7" released by "delete_volume" :: held 1.429s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:26:16 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-6bc33b23-5c55-48a6-9271-1fd0dd04818f tempest-TestStampPattern-538910304 None] Created reservations ['5fcecabe-6bc7-47d8-9c78-8ea7495000e3', '1483b54f-025e-4678-9a3d-5f023057755c', 'c2a5051e-dae5-4f8b-a298-bfe154028801', '42d1f61b-c546-46dd-b4ed-0a565f9346bb'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:26:16 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-6bc33b23-5c55-48a6-9271-1fd0dd04818f tempest-TestStampPattern-538910304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:26:16 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-6bc33b23-5c55-48a6-9271-1fd0dd04818f tempest-TestStampPattern-538910304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:26:16 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-6bc33b23-5c55-48a6-9271-1fd0dd04818f tempest-TestStampPattern-538910304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:26:16 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-6bc33b23-5c55-48a6-9271-1fd0dd04818f tempest-TestStampPattern-538910304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:26:16 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-6bc33b23-5c55-48a6-9271-1fd0dd04818f tempest-TestStampPattern-538910304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:26:16 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6bc33b23-5c55-48a6-9271-1fd0dd04818f tempest-TestStampPattern-538910304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:26:16 devstack sudo[105960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:26:16 devstack sudo[105960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:26:16 devstack sudo[105957]: pam_unix(sudo:session): session closed for user root Apr 29 15:26:16 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-2072782d-08f8-4caf-9e4d-6e38c5cdfa02 tempest-VolumeImageDependencyTests-1879610301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ef87ecf6-27aa-4619-b3e5-6489b132297f_jn1eu414devstack@QuobyteHD" returned: 1 in 0.695s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:26:16 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-2072782d-08f8-4caf-9e4d-6e38c5cdfa02 tempest-VolumeImageDependencyTests-1879610301 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ef87ecf6-27aa-4619-b3e5-6489b132297f_jn1eu414devstack@QuobyteHD' failed. Not Retrying. {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 15:26:16 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [None req-2072782d-08f8-4caf-9e4d-6e38c5cdfa02 tempest-VolumeImageDependencyTests-1879610301 None] ef87ecf6-27aa-4619-b3e5-6489b132297f was raw, converting to raw {{(pid=84448) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 29 15:26:16 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-2072782d-08f8-4caf-9e4d-6e38c5cdfa02 tempest-VolumeImageDependencyTests-1879610301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ef87ecf6-27aa-4619-b3e5-6489b132297f_jn1eu414devstack@QuobyteHD /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-baccef8f-66a2-449b-81b5-3b5a62c90484 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:26:16 devstack sudo[105965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ef87ecf6-27aa-4619-b3e5-6489b132297f_jn1eu414devstack@QuobyteHD /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-baccef8f-66a2-449b-81b5-3b5a62c90484 Apr 29 15:26:16 devstack sudo[105965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:26:16 devstack sudo[105960]: pam_unix(sudo:session): session closed for user root Apr 29 15:26:16 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6bc33b23-5c55-48a6-9271-1fd0dd04818f tempest-TestStampPattern-538910304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.621s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:26:16 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-6bc33b23-5c55-48a6-9271-1fd0dd04818f tempest-TestStampPattern-538910304 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:26:16 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-6bc33b23-5c55-48a6-9271-1fd0dd04818f tempest-TestStampPattern-538910304 None] Deleted volume successfully. Apr 29 15:26:16 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-6bc33b23-5c55-48a6-9271-1fd0dd04818f tempest-TestStampPattern-538910304 None] Lock "cinder-b062e17a-3235-47de-b7de-4fbbb10abfb7-delete_volume" released by "delete_volume" :: held 2.275s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:26:17 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-833ed680-106a-4355-8e72-4243c7ae22d5 tempest-TestStampPattern-538910304 None] Acquiring lock "cinder-e3afcf32-738d-4ee3-b193-7303a7e0b0ab-delete_snapshot" by "delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:26:17 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-833ed680-106a-4355-8e72-4243c7ae22d5 tempest-TestStampPattern-538910304 None] Lock "cinder-e3afcf32-738d-4ee3-b193-7303a7e0b0ab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:26:17 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-833ed680-106a-4355-8e72-4243c7ae22d5 tempest-TestStampPattern-538910304 None] Acquiring lock "cinder-quobyte-2f8608b3-7b48-4cd7-b080-07172ef4409b" by "delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:26:17 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-833ed680-106a-4355-8e72-4243c7ae22d5 tempest-TestStampPattern-538910304 None] Lock "cinder-quobyte-2f8608b3-7b48-4cd7-b080-07172ef4409b" acquired by "delete_snapshot" :: waited 0.017s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:26:17 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-833ed680-106a-4355-8e72-4243c7ae22d5 tempest-TestStampPattern-538910304 None] Acquiring lock "cinder-quobyte-e3afcf32-738d-4ee3-b193-7303a7e0b0ab" by "_delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:26:17 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-833ed680-106a-4355-8e72-4243c7ae22d5 tempest-TestStampPattern-538910304 None] Lock "cinder-quobyte-e3afcf32-738d-4ee3-b193-7303a7e0b0ab" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:26:17 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-833ed680-106a-4355-8e72-4243c7ae22d5 tempest-TestStampPattern-538910304 None] Deleting offline snapshot e3afcf32-738d-4ee3-b193-7303a7e0b0ab of volume 2f8608b3-7b48-4cd7-b080-07172ef4409b {{(pid=84448) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 15:26:17 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-833ed680-106a-4355-8e72-4243c7ae22d5 tempest-TestStampPattern-538910304 None] snapshot_file for this snap is: volume-2f8608b3-7b48-4cd7-b080-07172ef4409b.e3afcf32-738d-4ee3-b193-7303a7e0b0ab {{(pid=84448) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 15:26:17 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff8ae8f-63a4-40ba-964c-65f048a3c4ce]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:26:17 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-833ed680-106a-4355-8e72-4243c7ae22d5 tempest-TestStampPattern-538910304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2f8608b3-7b48-4cd7-b080-07172ef4409b.e3afcf32-738d-4ee3-b193-7303a7e0b0ab {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:26:17 devstack sudo[105965]: pam_unix(sudo:session): session closed for user root Apr 29 15:26:17 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-2072782d-08f8-4caf-9e4d-6e38c5cdfa02 tempest-VolumeImageDependencyTests-1879610301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ef87ecf6-27aa-4619-b3e5-6489b132297f_jn1eu414devstack@QuobyteHD /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-baccef8f-66a2-449b-81b5-3b5a62c90484" returned: 0 in 0.789s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:26:17 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [None req-2072782d-08f8-4caf-9e4d-6e38c5cdfa02 tempest-VolumeImageDependencyTests-1879610301 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ef87ecf6-27aa-4619-b3e5-6489b132297f_jn1eu414devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-baccef8f-66a2-449b-81b5-3b5a62c90484 {{(pid=84448) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 15:26:17 devstack cinder-volume[84448]: INFO cinder.image.image_utils [None req-2072782d-08f8-4caf-9e4d-6e38c5cdfa02 tempest-VolumeImageDependencyTests-1879610301 None] Converted 0.00 MB image at 0.00 MB/s Apr 29 15:26:17 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-2072782d-08f8-4caf-9e4d-6e38c5cdfa02 tempest-VolumeImageDependencyTests-1879610301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-baccef8f-66a2-449b-81b5-3b5a62c90484 1G {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:26:17 devstack sudo[105972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-baccef8f-66a2-449b-81b5-3b5a62c90484 1G Apr 29 15:26:17 devstack sudo[105972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:26:17 devstack sudo[105971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2f8608b3-7b48-4cd7-b080-07172ef4409b.e3afcf32-738d-4ee3-b193-7303a7e0b0ab Apr 29 15:26:17 devstack sudo[105971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:26:17 devstack sudo[105972]: pam_unix(sudo:session): session closed for user root Apr 29 15:26:17 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-2072782d-08f8-4caf-9e4d-6e38c5cdfa02 tempest-VolumeImageDependencyTests-1879610301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-baccef8f-66a2-449b-81b5-3b5a62c90484 1G" returned: 0 in 0.652s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:26:17 devstack sudo[105971]: pam_unix(sudo:session): session closed for user root Apr 29 15:26:17 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-833ed680-106a-4355-8e72-4243c7ae22d5 tempest-TestStampPattern-538910304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2f8608b3-7b48-4cd7-b080-07172ef4409b.e3afcf32-738d-4ee3-b193-7303a7e0b0ab" returned: 0 in 0.745s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:26:17 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-833ed680-106a-4355-8e72-4243c7ae22d5 tempest-TestStampPattern-538910304 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f8608b3-7b48-4cd7-b080-07172ef4409b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84448) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 15:26:17 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[be734bc8-e903-4fba-96c2-b0d2ace9c8d2]: (4, 'raw') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:26:17 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-2072782d-08f8-4caf-9e4d-6e38c5cdfa02 tempest-VolumeImageDependencyTests-1879610301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-baccef8f-66a2-449b-81b5-3b5a62c90484 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:26:18 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[709f5eef-ad03-4ae0-892d-f53744ebdefd]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:26:18 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-833ed680-106a-4355-8e72-4243c7ae22d5 tempest-TestStampPattern-538910304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2f8608b3-7b48-4cd7-b080-07172ef4409b {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:26:18 devstack sudo[105983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-baccef8f-66a2-449b-81b5-3b5a62c90484 Apr 29 15:26:18 devstack sudo[105983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:26:18 devstack sudo[105984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2f8608b3-7b48-4cd7-b080-07172ef4409b Apr 29 15:26:18 devstack sudo[105984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:26:18 devstack sudo[105983]: pam_unix(sudo:session): session closed for user root Apr 29 15:26:18 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-2072782d-08f8-4caf-9e4d-6e38c5cdfa02 tempest-VolumeImageDependencyTests-1879610301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-baccef8f-66a2-449b-81b5-3b5a62c90484" returned: 0 in 0.745s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:26:18 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-2072782d-08f8-4caf-9e4d-6e38c5cdfa02 tempest-VolumeImageDependencyTests-1879610301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-baccef8f-66a2-449b-81b5-3b5a62c90484 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:26:18 devstack sudo[105984]: pam_unix(sudo:session): session closed for user root Apr 29 15:26:18 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-833ed680-106a-4355-8e72-4243c7ae22d5 tempest-TestStampPattern-538910304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2f8608b3-7b48-4cd7-b080-07172ef4409b" returned: 0 in 0.757s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:26:18 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-833ed680-106a-4355-8e72-4243c7ae22d5 tempest-TestStampPattern-538910304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2f8608b3-7b48-4cd7-b080-07172ef4409b.e3afcf32-738d-4ee3-b193-7303a7e0b0ab {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:26:18 devstack sudo[105995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2f8608b3-7b48-4cd7-b080-07172ef4409b.e3afcf32-738d-4ee3-b193-7303a7e0b0ab Apr 29 15:26:18 devstack sudo[105995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:26:18 devstack sudo[105992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-baccef8f-66a2-449b-81b5-3b5a62c90484 Apr 29 15:26:18 devstack sudo[105992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:26:19 devstack sudo[105992]: pam_unix(sudo:session): session closed for user root Apr 29 15:26:19 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-2072782d-08f8-4caf-9e4d-6e38c5cdfa02 tempest-VolumeImageDependencyTests-1879610301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-baccef8f-66a2-449b-81b5-3b5a62c90484" returned: 1 in 0.770s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:26:19 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-2072782d-08f8-4caf-9e4d-6e38c5cdfa02 tempest-VolumeImageDependencyTests-1879610301 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-baccef8f-66a2-449b-81b5-3b5a62c90484' failed. Not Retrying. {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 15:26:19 devstack cinder-volume[84448]: DEBUG cinder.volume.volume_utils [None req-2072782d-08f8-4caf-9e4d-6e38c5cdfa02 tempest-VolumeImageDependencyTests-1879610301 None] Downloaded image ef87ecf6-27aa-4619-b3e5-6489b132297f ((None, [{'url': 'file:///opt/stack/data/glance/images/ef87ecf6-27aa-4619-b3e5-6489b132297f', 'metadata': {}}])) to volume baccef8f-66a2-449b-81b5-3b5a62c90484 successfully. {{(pid=84448) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 29 15:26:19 devstack sudo[105995]: pam_unix(sudo:session): session closed for user root Apr 29 15:26:19 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [None req-2072782d-08f8-4caf-9e4d-6e38c5cdfa02 tempest-VolumeImageDependencyTests-1879610301 None] Temporary image ef87ecf6-27aa-4619-b3e5-6489b132297f for user a31d9739950549d2b7305d57e441dfb9 is deleted. {{(pid=84448) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 29 15:26:19 devstack cinder-volume[84448]: DEBUG cinder.volume.volume_utils [None req-2072782d-08f8-4caf-9e4d-6e38c5cdfa02 tempest-VolumeImageDependencyTests-1879610301 None] Marking volume baccef8f-66a2-449b-81b5-3b5a62c90484 as bootable. {{(pid=84448) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 29 15:26:19 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-833ed680-106a-4355-8e72-4243c7ae22d5 tempest-TestStampPattern-538910304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2f8608b3-7b48-4cd7-b080-07172ef4409b.e3afcf32-738d-4ee3-b193-7303a7e0b0ab" returned: 0 in 0.745s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:26:19 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-833ed680-106a-4355-8e72-4243c7ae22d5 tempest-TestStampPattern-538910304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2f8608b3-7b48-4cd7-b080-07172ef4409b.e3afcf32-738d-4ee3-b193-7303a7e0b0ab {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:26:19 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-2072782d-08f8-4caf-9e4d-6e38c5cdfa02 tempest-VolumeImageDependencyTests-1879610301 None] Copying metadata from image ef87ecf6-27aa-4619-b3e5-6489b132297f to baccef8f-66a2-449b-81b5-3b5a62c90484. {{(pid=84448) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 29 15:26:19 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-2072782d-08f8-4caf-9e4d-6e38c5cdfa02 tempest-VolumeImageDependencyTests-1879610301 None] Creating volume glance metadata for volume baccef8f-66a2-449b-81b5-3b5a62c90484 backed by image ef87ecf6-27aa-4619-b3e5-6489b132297f with: {'image_id': 'ef87ecf6-27aa-4619-b3e5-6489b132297f', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '7c205c0588fb27f3f8f9e08a80fc5c56', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=84448) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 29 15:26:19 devstack sudo[106009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2f8608b3-7b48-4cd7-b080-07172ef4409b.e3afcf32-738d-4ee3-b193-7303a7e0b0ab Apr 29 15:26:19 devstack sudo[106009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:26:19 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-2072782d-08f8-4caf-9e4d-6e38c5cdfa02 tempest-VolumeImageDependencyTests-1879610301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaddcd92-f6bf-4716-942c-c05d54c81f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-baccef8f-66a2-449b-81b5-3b5a62c90484', 'volume_size': 1, 'image_id': 'ef87ecf6-27aa-4619-b3e5-6489b132297f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ef87ecf6-27aa-4619-b3e5-6489b132297f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7c205c0588fb27f3f8f9e08a80fc5c56', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7483e8856bb74ada95b4d183ebce2cd5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8aeb87a501118ced18e562dc7507258b6a57dbfe6ac45027185ebf43c2c436b9096945e0105a9b014169a50addff0b4dfd46c187509d44b45745c19ca12d9be7', 'id': 'ef87ecf6-27aa-4619-b3e5-6489b132297f', 'created_at': datetime.datetime(2026, 4, 29, 13, 26, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 13, 26, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ef87ecf6-27aa-4619-b3e5-6489b132297f/file', 'properties': {}}, 'image_service': }' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:26:19 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-2072782d-08f8-4caf-9e4d-6e38c5cdfa02 tempest-VolumeImageDependencyTests-1879610301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08736f76-30aa-43cf-a3ea-17b8a39fc5ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:26:19 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-2072782d-08f8-4caf-9e4d-6e38c5cdfa02 tempest-VolumeImageDependencyTests-1879610301 None] Volume volume-baccef8f-66a2-449b-81b5-3b5a62c90484 (baccef8f-66a2-449b-81b5-3b5a62c90484): created successfully Apr 29 15:26:19 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-2072782d-08f8-4caf-9e4d-6e38c5cdfa02 tempest-VolumeImageDependencyTests-1879610301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08736f76-30aa-43cf-a3ea-17b8a39fc5ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:26:19 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-2072782d-08f8-4caf-9e4d-6e38c5cdfa02 tempest-VolumeImageDependencyTests-1879610301 None] Flow 'volume_create_manager' (ef79f7f1-2124-42dc-b8d3-44223e92e4cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:26:19 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-2072782d-08f8-4caf-9e4d-6e38c5cdfa02 tempest-VolumeImageDependencyTests-1879610301 None] Created volume successfully. Apr 29 15:26:20 devstack sudo[106009]: pam_unix(sudo:session): session closed for user root Apr 29 15:26:20 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-833ed680-106a-4355-8e72-4243c7ae22d5 tempest-TestStampPattern-538910304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2f8608b3-7b48-4cd7-b080-07172ef4409b.e3afcf32-738d-4ee3-b193-7303a7e0b0ab" returned: 0 in 0.617s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:26:20 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-833ed680-106a-4355-8e72-4243c7ae22d5 tempest-TestStampPattern-538910304 None] Lock "cinder-quobyte-e3afcf32-738d-4ee3-b193-7303a7e0b0ab" released by "_delete_snapshot" :: held 3.016s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:26:20 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-833ed680-106a-4355-8e72-4243c7ae22d5 tempest-TestStampPattern-538910304 None] Lock "cinder-quobyte-2f8608b3-7b48-4cd7-b080-07172ef4409b" released by "delete_snapshot" :: held 3.049s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:26:20 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-833ed680-106a-4355-8e72-4243c7ae22d5 tempest-TestStampPattern-538910304 None] Created reservations ['fef18e95-d736-4765-b527-05c3b918c7f5', '2fcd20d1-74de-4047-890f-ea708e24a03c', 'a7e27e4e-27be-44c5-bda1-0d6ad2fc330c', '9831f95a-7ba9-4629-a35e-cab3e4033a3a'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:26:20 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-833ed680-106a-4355-8e72-4243c7ae22d5 tempest-TestStampPattern-538910304 None] Delete snapshot completed successfully. Apr 29 15:26:20 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-833ed680-106a-4355-8e72-4243c7ae22d5 tempest-TestStampPattern-538910304 None] Lock "cinder-e3afcf32-738d-4ee3-b193-7303a7e0b0ab-delete_snapshot" released by "delete_snapshot" :: held 3.175s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:26:20 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-c73a6c07-fdd5-4be3-8aed-6e6ef53bbc2a tempest-VolumeImageDependencyTests-1879610301 None] Acquiring lock "cinder-baccef8f-66a2-449b-81b5-3b5a62c90484-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:26:20 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-c73a6c07-fdd5-4be3-8aed-6e6ef53bbc2a tempest-VolumeImageDependencyTests-1879610301 None] Lock "cinder-baccef8f-66a2-449b-81b5-3b5a62c90484-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:26:20 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-c73a6c07-fdd5-4be3-8aed-6e6ef53bbc2a tempest-VolumeImageDependencyTests-1879610301 None] Acquiring lock "cinder-quobyte-baccef8f-66a2-449b-81b5-3b5a62c90484" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:26:20 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-c73a6c07-fdd5-4be3-8aed-6e6ef53bbc2a tempest-VolumeImageDependencyTests-1879610301 None] Lock "cinder-quobyte-baccef8f-66a2-449b-81b5-3b5a62c90484" acquired by "delete_volume" :: waited 0.013s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:26:20 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d1d0a9a-9786-48ef-856f-4e695a589da3]: (4, 'raw') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:26:20 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c73a6c07-fdd5-4be3-8aed-6e6ef53bbc2a tempest-VolumeImageDependencyTests-1879610301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-baccef8f-66a2-449b-81b5-3b5a62c90484 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:26:20 devstack sudo[106012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-baccef8f-66a2-449b-81b5-3b5a62c90484 Apr 29 15:26:20 devstack sudo[106012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:26:21 devstack sudo[106012]: pam_unix(sudo:session): session closed for user root Apr 29 15:26:21 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c73a6c07-fdd5-4be3-8aed-6e6ef53bbc2a tempest-VolumeImageDependencyTests-1879610301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-baccef8f-66a2-449b-81b5-3b5a62c90484" returned: 0 in 0.734s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:26:21 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c73a6c07-fdd5-4be3-8aed-6e6ef53bbc2a tempest-VolumeImageDependencyTests-1879610301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-baccef8f-66a2-449b-81b5-3b5a62c90484 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:26:21 devstack sudo[106016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-baccef8f-66a2-449b-81b5-3b5a62c90484 Apr 29 15:26:21 devstack sudo[106016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:26:22 devstack sudo[106016]: pam_unix(sudo:session): session closed for user root Apr 29 15:26:22 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c73a6c07-fdd5-4be3-8aed-6e6ef53bbc2a tempest-VolumeImageDependencyTests-1879610301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-baccef8f-66a2-449b-81b5-3b5a62c90484" returned: 1 in 0.817s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:26:22 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c73a6c07-fdd5-4be3-8aed-6e6ef53bbc2a tempest-VolumeImageDependencyTests-1879610301 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-baccef8f-66a2-449b-81b5-3b5a62c90484' failed. Not Retrying. {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 15:26:22 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c73a6c07-fdd5-4be3-8aed-6e6ef53bbc2a tempest-VolumeImageDependencyTests-1879610301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-baccef8f-66a2-449b-81b5-3b5a62c90484 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:26:22 devstack sudo[106031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-baccef8f-66a2-449b-81b5-3b5a62c90484 Apr 29 15:26:22 devstack sudo[106031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:26:22 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-c5ba6649-a727-49c2-8b79-c5bcd2fdd71c req-1516d239-6c40-4def-80a7-7ca366241332 tempest-TestInstancesWithCinderVolumes-634922416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:26:22 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-c5ba6649-a727-49c2-8b79-c5bcd2fdd71c req-1516d239-6c40-4def-80a7-7ca366241332 tempest-TestInstancesWithCinderVolumes-634922416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:26:22 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eed0bd8-0eed-4513-bd47-d5caf2e1f951]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:26:22 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-c5ba6649-a727-49c2-8b79-c5bcd2fdd71c req-1516d239-6c40-4def-80a7-7ca366241332 tempest-TestInstancesWithCinderVolumes-634922416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-61771c01-1179-41e9-8c96-337301e21803 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:26:22 devstack sudo[106033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-61771c01-1179-41e9-8c96-337301e21803 Apr 29 15:26:22 devstack sudo[106033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:26:22 devstack sudo[106031]: pam_unix(sudo:session): session closed for user root Apr 29 15:26:22 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c73a6c07-fdd5-4be3-8aed-6e6ef53bbc2a tempest-VolumeImageDependencyTests-1879610301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-baccef8f-66a2-449b-81b5-3b5a62c90484" returned: 0 in 0.714s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:26:22 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-c73a6c07-fdd5-4be3-8aed-6e6ef53bbc2a tempest-VolumeImageDependencyTests-1879610301 None] Lock "cinder-quobyte-baccef8f-66a2-449b-81b5-3b5a62c90484" released by "delete_volume" :: held 2.338s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:26:22 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-c73a6c07-fdd5-4be3-8aed-6e6ef53bbc2a tempest-VolumeImageDependencyTests-1879610301 None] Created reservations ['7666b0f0-9b7b-4148-856d-141c9f9a4523', 'df255ecf-97a9-4fac-bd19-e76b1b643800', '8a998379-ef6f-4748-8892-1e1475a0f3b4', '9e526379-fd28-42e0-9f7b-cd8a4ea921fd'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:26:23 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-c73a6c07-fdd5-4be3-8aed-6e6ef53bbc2a tempest-VolumeImageDependencyTests-1879610301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:26:23 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-c73a6c07-fdd5-4be3-8aed-6e6ef53bbc2a tempest-VolumeImageDependencyTests-1879610301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:26:23 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-c73a6c07-fdd5-4be3-8aed-6e6ef53bbc2a tempest-VolumeImageDependencyTests-1879610301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:26:23 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-c73a6c07-fdd5-4be3-8aed-6e6ef53bbc2a tempest-VolumeImageDependencyTests-1879610301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:26:23 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-c73a6c07-fdd5-4be3-8aed-6e6ef53bbc2a tempest-VolumeImageDependencyTests-1879610301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:26:23 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c73a6c07-fdd5-4be3-8aed-6e6ef53bbc2a tempest-VolumeImageDependencyTests-1879610301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:26:23 devstack sudo[106040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:26:23 devstack sudo[106040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:26:23 devstack sudo[106033]: pam_unix(sudo:session): session closed for user root Apr 29 15:26:23 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-c5ba6649-a727-49c2-8b79-c5bcd2fdd71c req-1516d239-6c40-4def-80a7-7ca366241332 tempest-TestInstancesWithCinderVolumes-634922416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-61771c01-1179-41e9-8c96-337301e21803" returned: 0 in 0.829s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:26:23 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-c5ba6649-a727-49c2-8b79-c5bcd2fdd71c req-1516d239-6c40-4def-80a7-7ca366241332 tempest-TestInstancesWithCinderVolumes-634922416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.848s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:26:23 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-c5ba6649-a727-49c2-8b79-c5bcd2fdd71c req-1516d239-6c40-4def-80a7-7ca366241332 tempest-TestInstancesWithCinderVolumes-634922416 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a', 'name': 'volume-61771c01-1179-41e9-8c96-337301e21803', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a459e1a2-3e62-476f-acd5-fa7acb8473fe', 'enforce_multipath': True} {{(pid=84448) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 15:26:23 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-c5ba6649-a727-49c2-8b79-c5bcd2fdd71c req-1516d239-6c40-4def-80a7-7ca366241332 tempest-TestInstancesWithCinderVolumes-634922416 None] attachment_update completed successfully. Apr 29 15:26:24 devstack sudo[106040]: pam_unix(sudo:session): session closed for user root Apr 29 15:26:24 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c73a6c07-fdd5-4be3-8aed-6e6ef53bbc2a tempest-VolumeImageDependencyTests-1879610301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 1.061s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:26:24 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-c73a6c07-fdd5-4be3-8aed-6e6ef53bbc2a tempest-VolumeImageDependencyTests-1879610301 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:26:24 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-c73a6c07-fdd5-4be3-8aed-6e6ef53bbc2a tempest-VolumeImageDependencyTests-1879610301 None] Deleted volume successfully. Apr 29 15:26:24 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-c73a6c07-fdd5-4be3-8aed-6e6ef53bbc2a tempest-VolumeImageDependencyTests-1879610301 None] Lock "cinder-baccef8f-66a2-449b-81b5-3b5a62c90484-delete_volume" released by "delete_volume" :: held 3.641s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:26:28 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-9c04382c-0812-44f6-a33e-7af78a966320 tempest-TestStampPattern-538910304 None] Acquiring lock "cinder-2f8608b3-7b48-4cd7-b080-07172ef4409b-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:26:28 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-9c04382c-0812-44f6-a33e-7af78a966320 tempest-TestStampPattern-538910304 None] Lock "cinder-2f8608b3-7b48-4cd7-b080-07172ef4409b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:26:28 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-9c04382c-0812-44f6-a33e-7af78a966320 tempest-TestStampPattern-538910304 None] Acquiring lock "cinder-quobyte-2f8608b3-7b48-4cd7-b080-07172ef4409b" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:26:28 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-9c04382c-0812-44f6-a33e-7af78a966320 tempest-TestStampPattern-538910304 None] Lock "cinder-quobyte-2f8608b3-7b48-4cd7-b080-07172ef4409b" acquired by "delete_volume" :: waited 0.022s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:26:28 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f83ec9-d030-46df-aa85-162452fe9cfc]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:26:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-9c04382c-0812-44f6-a33e-7af78a966320 tempest-TestStampPattern-538910304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2f8608b3-7b48-4cd7-b080-07172ef4409b {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:26:29 devstack sudo[106113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2f8608b3-7b48-4cd7-b080-07172ef4409b Apr 29 15:26:29 devstack sudo[106113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:26:29 devstack sudo[106113]: pam_unix(sudo:session): session closed for user root Apr 29 15:26:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-9c04382c-0812-44f6-a33e-7af78a966320 tempest-TestStampPattern-538910304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2f8608b3-7b48-4cd7-b080-07172ef4409b" returned: 0 in 0.733s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:26:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-9c04382c-0812-44f6-a33e-7af78a966320 tempest-TestStampPattern-538910304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2f8608b3-7b48-4cd7-b080-07172ef4409b {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:26:29 devstack sudo[106130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2f8608b3-7b48-4cd7-b080-07172ef4409b Apr 29 15:26:29 devstack sudo[106130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:26:30 devstack sudo[106130]: pam_unix(sudo:session): session closed for user root Apr 29 15:26:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-9c04382c-0812-44f6-a33e-7af78a966320 tempest-TestStampPattern-538910304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2f8608b3-7b48-4cd7-b080-07172ef4409b" returned: 0 in 0.583s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:26:30 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-9c04382c-0812-44f6-a33e-7af78a966320 tempest-TestStampPattern-538910304 None] Lock "cinder-quobyte-2f8608b3-7b48-4cd7-b080-07172ef4409b" released by "delete_volume" :: held 1.381s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:26:30 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-9c04382c-0812-44f6-a33e-7af78a966320 tempest-TestStampPattern-538910304 None] Created reservations ['20f30213-d076-4564-ba05-977e899f26fa', 'd1f7939f-5224-442c-b2ce-05173a7a03b9', '464c8ecb-cd17-4749-a72f-aca90812dc76', '499863f0-5f8f-4291-ad21-fe785fa84c52'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:26:30 devstack cinder-volume[84448]: DEBUG oslo_service.periodic_task [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84448) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 15:26:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:26:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:26:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:26:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:26:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:26:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:26:30 devstack sudo[106143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:26:30 devstack sudo[106143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:26:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-9c04382c-0812-44f6-a33e-7af78a966320 tempest-TestStampPattern-538910304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:26:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-9c04382c-0812-44f6-a33e-7af78a966320 tempest-TestStampPattern-538910304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:26:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-9c04382c-0812-44f6-a33e-7af78a966320 tempest-TestStampPattern-538910304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:26:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-9c04382c-0812-44f6-a33e-7af78a966320 tempest-TestStampPattern-538910304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:26:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-9c04382c-0812-44f6-a33e-7af78a966320 tempest-TestStampPattern-538910304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:26:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-9c04382c-0812-44f6-a33e-7af78a966320 tempest-TestStampPattern-538910304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:26:30 devstack sudo[106145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:26:30 devstack sudo[106145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:26:31 devstack sudo[106145]: pam_unix(sudo:session): session closed for user root Apr 29 15:26:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-9c04382c-0812-44f6-a33e-7af78a966320 tempest-TestStampPattern-538910304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.636s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:26:31 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-9c04382c-0812-44f6-a33e-7af78a966320 tempest-TestStampPattern-538910304 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:26:31 devstack sudo[106143]: pam_unix(sudo:session): session closed for user root Apr 29 15:26:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.684s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:26:31 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:26:31 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-9c04382c-0812-44f6-a33e-7af78a966320 tempest-TestStampPattern-538910304 None] Deleted volume successfully. Apr 29 15:26:31 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-9c04382c-0812-44f6-a33e-7af78a966320 tempest-TestStampPattern-538910304 None] Lock "cinder-2f8608b3-7b48-4cd7-b080-07172ef4409b-delete_volume" released by "delete_volume" :: held 2.273s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:26:31 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-d9eb8ad1-8bfe-47b0-ab1a-ba621d5d0abb req-0ee045e9-8c3e-44a9-9d34-1ba93c525208 tempest-TestInstancesWithCinderVolumes-634922416 None] Terminate volume connection completed successfully. Apr 29 15:26:31 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-d9eb8ad1-8bfe-47b0-ab1a-ba621d5d0abb req-0ee045e9-8c3e-44a9-9d34-1ba93c525208 tempest-TestInstancesWithCinderVolumes-634922416 None] Deleting attachment 98579fc4-a40f-4073-8c21-bc09a802318b. {{(pid=84448) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 15:26:33 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-d3b26211-1f09-45c7-8247-b057adda9bbc tempest-TestInstancesWithCinderVolumes-634922416 None] Acquiring lock "cinder-72578478-516d-4a91-ae69-d068d73653cd-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:26:33 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-d3b26211-1f09-45c7-8247-b057adda9bbc tempest-TestInstancesWithCinderVolumes-634922416 None] Lock "cinder-72578478-516d-4a91-ae69-d068d73653cd-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:26:33 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-d3b26211-1f09-45c7-8247-b057adda9bbc tempest-TestInstancesWithCinderVolumes-634922416 None] Acquiring lock "cinder-quobyte-72578478-516d-4a91-ae69-d068d73653cd" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:26:33 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-d3b26211-1f09-45c7-8247-b057adda9bbc tempest-TestInstancesWithCinderVolumes-634922416 None] Lock "cinder-quobyte-72578478-516d-4a91-ae69-d068d73653cd" acquired by "delete_volume" :: waited 0.032s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:26:33 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd09cff-63ea-4829-87cf-e4353f9a3d3f]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:26:33 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-d3b26211-1f09-45c7-8247-b057adda9bbc tempest-TestInstancesWithCinderVolumes-634922416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-72578478-516d-4a91-ae69-d068d73653cd {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:26:34 devstack sudo[106200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-72578478-516d-4a91-ae69-d068d73653cd Apr 29 15:26:34 devstack sudo[106200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:26:34 devstack sudo[106200]: pam_unix(sudo:session): session closed for user root Apr 29 15:26:34 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-d3b26211-1f09-45c7-8247-b057adda9bbc tempest-TestInstancesWithCinderVolumes-634922416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-72578478-516d-4a91-ae69-d068d73653cd" returned: 0 in 0.876s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:26:34 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-d3b26211-1f09-45c7-8247-b057adda9bbc tempest-TestInstancesWithCinderVolumes-634922416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-72578478-516d-4a91-ae69-d068d73653cd {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:26:34 devstack sudo[106205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-72578478-516d-4a91-ae69-d068d73653cd Apr 29 15:26:34 devstack sudo[106205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:26:35 devstack sudo[106205]: pam_unix(sudo:session): session closed for user root Apr 29 15:26:35 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-d3b26211-1f09-45c7-8247-b057adda9bbc tempest-TestInstancesWithCinderVolumes-634922416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-72578478-516d-4a91-ae69-d068d73653cd" returned: 0 in 0.759s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:26:35 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-d3b26211-1f09-45c7-8247-b057adda9bbc tempest-TestInstancesWithCinderVolumes-634922416 None] Lock "cinder-quobyte-72578478-516d-4a91-ae69-d068d73653cd" released by "delete_volume" :: held 1.705s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:26:35 devstack cinder-volume[84448]: WARNING cinder.quota [None req-d3b26211-1f09-45c7-8247-b057adda9bbc tempest-TestInstancesWithCinderVolumes-634922416 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1313814717-832662833 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1313814717-832662833, it is now deprecated. Please use the default quota class for default quota. Apr 29 15:26:35 devstack cinder-volume[84448]: WARNING cinder.quota [None req-d3b26211-1f09-45c7-8247-b057adda9bbc tempest-TestInstancesWithCinderVolumes-634922416 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1313814717-832662833 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1313814717-832662833, it is now deprecated. Please use the default quota class for default quota. Apr 29 15:26:35 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-d3b26211-1f09-45c7-8247-b057adda9bbc tempest-TestInstancesWithCinderVolumes-634922416 None] Created reservations ['82e6117a-a62f-4ace-be5c-3e72576b5253', '7898e771-f1ef-4b94-aaaf-3c17b2cadd6f', '9fdf837e-1371-4317-b9d0-1d160aeb12e3', '3d28de72-361f-460f-b0fd-57f79fdc37a4'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:26:35 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-d3b26211-1f09-45c7-8247-b057adda9bbc tempest-TestInstancesWithCinderVolumes-634922416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:26:35 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-d3b26211-1f09-45c7-8247-b057adda9bbc tempest-TestInstancesWithCinderVolumes-634922416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:26:35 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-d3b26211-1f09-45c7-8247-b057adda9bbc tempest-TestInstancesWithCinderVolumes-634922416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:26:35 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-d3b26211-1f09-45c7-8247-b057adda9bbc tempest-TestInstancesWithCinderVolumes-634922416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:26:35 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-d3b26211-1f09-45c7-8247-b057adda9bbc tempest-TestInstancesWithCinderVolumes-634922416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:26:35 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-d3b26211-1f09-45c7-8247-b057adda9bbc tempest-TestInstancesWithCinderVolumes-634922416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:26:35 devstack sudo[106210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:26:35 devstack sudo[106210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:26:36 devstack sudo[106210]: pam_unix(sudo:session): session closed for user root Apr 29 15:26:36 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-d3b26211-1f09-45c7-8247-b057adda9bbc tempest-TestInstancesWithCinderVolumes-634922416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.681s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:26:36 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-d3b26211-1f09-45c7-8247-b057adda9bbc tempest-TestInstancesWithCinderVolumes-634922416 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:26:36 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-d3b26211-1f09-45c7-8247-b057adda9bbc tempest-TestInstancesWithCinderVolumes-634922416 None] Deleted volume successfully. Apr 29 15:26:36 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-d3b26211-1f09-45c7-8247-b057adda9bbc tempest-TestInstancesWithCinderVolumes-634922416 None] Lock "cinder-72578478-516d-4a91-ae69-d068d73653cd-delete_volume" released by "delete_volume" :: held 2.636s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:26:39 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-dd429074-3ca7-41d5-a535-15b82c7d55e3 req-5bcdde59-6f9b-4a66-84ac-3708a6c00adc tempest-TestInstancesWithCinderVolumes-634922416 None] Terminate volume connection completed successfully. Apr 29 15:26:39 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-dd429074-3ca7-41d5-a535-15b82c7d55e3 req-5bcdde59-6f9b-4a66-84ac-3708a6c00adc tempest-TestInstancesWithCinderVolumes-634922416 None] Deleting attachment a459e1a2-3e62-476f-acd5-fa7acb8473fe. {{(pid=84448) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 15:26:40 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-8da94ce2-946a-4090-ac95-f6a10c16786f tempest-TestInstancesWithCinderVolumes-634922416 None] Acquiring lock "cinder-61771c01-1179-41e9-8c96-337301e21803-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:26:40 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-8da94ce2-946a-4090-ac95-f6a10c16786f tempest-TestInstancesWithCinderVolumes-634922416 None] Lock "cinder-61771c01-1179-41e9-8c96-337301e21803-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:26:40 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:INSERT=23,cinder:UPDATE=88,cinder:SELECT=83,cinder:DELETE=4 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:26:40 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:SELECT=81,cinder:INSERT=29,cinder:UPDATE=89,cinder:DELETE=7 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:26:41 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-8da94ce2-946a-4090-ac95-f6a10c16786f tempest-TestInstancesWithCinderVolumes-634922416 None] Acquiring lock "cinder-quobyte-61771c01-1179-41e9-8c96-337301e21803" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:26:41 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-8da94ce2-946a-4090-ac95-f6a10c16786f tempest-TestInstancesWithCinderVolumes-634922416 None] Lock "cinder-quobyte-61771c01-1179-41e9-8c96-337301e21803" acquired by "delete_volume" :: waited 0.018s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:26:41 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ed644e-6561-49f8-a728-c3011f913d5f]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:26:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-8da94ce2-946a-4090-ac95-f6a10c16786f tempest-TestInstancesWithCinderVolumes-634922416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-61771c01-1179-41e9-8c96-337301e21803 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:26:41 devstack sudo[106240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-61771c01-1179-41e9-8c96-337301e21803 Apr 29 15:26:41 devstack sudo[106240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:26:41 devstack sudo[106240]: pam_unix(sudo:session): session closed for user root Apr 29 15:26:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-8da94ce2-946a-4090-ac95-f6a10c16786f tempest-TestInstancesWithCinderVolumes-634922416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-61771c01-1179-41e9-8c96-337301e21803" returned: 0 in 0.904s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:26:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-8da94ce2-946a-4090-ac95-f6a10c16786f tempest-TestInstancesWithCinderVolumes-634922416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-61771c01-1179-41e9-8c96-337301e21803 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:26:42 devstack sudo[106263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-61771c01-1179-41e9-8c96-337301e21803 Apr 29 15:26:42 devstack sudo[106263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:26:42 devstack sudo[106263]: pam_unix(sudo:session): session closed for user root Apr 29 15:26:42 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-8da94ce2-946a-4090-ac95-f6a10c16786f tempest-TestInstancesWithCinderVolumes-634922416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-61771c01-1179-41e9-8c96-337301e21803" returned: 0 in 0.839s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:26:42 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-8da94ce2-946a-4090-ac95-f6a10c16786f tempest-TestInstancesWithCinderVolumes-634922416 None] Lock "cinder-quobyte-61771c01-1179-41e9-8c96-337301e21803" released by "delete_volume" :: held 1.803s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:26:42 devstack cinder-volume[84448]: WARNING cinder.quota [None req-8da94ce2-946a-4090-ac95-f6a10c16786f tempest-TestInstancesWithCinderVolumes-634922416 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-869213358-1699869177 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-869213358-1699869177, it is now deprecated. Please use the default quota class for default quota. Apr 29 15:26:42 devstack cinder-volume[84448]: WARNING cinder.quota [None req-8da94ce2-946a-4090-ac95-f6a10c16786f tempest-TestInstancesWithCinderVolumes-634922416 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-869213358-1699869177 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-869213358-1699869177, it is now deprecated. Please use the default quota class for default quota. Apr 29 15:26:42 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-8da94ce2-946a-4090-ac95-f6a10c16786f tempest-TestInstancesWithCinderVolumes-634922416 None] Created reservations ['1ad06745-517e-4232-92a8-1097e049b458', 'b9badd75-8a3e-4d05-92c8-0ef30431deab', 'f178a966-8655-43f6-be1c-d9aea3a8bff0', '70cc6bce-4336-4e5e-8812-1486c4cd850a'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:26:43 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-8da94ce2-946a-4090-ac95-f6a10c16786f tempest-TestInstancesWithCinderVolumes-634922416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:26:43 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-8da94ce2-946a-4090-ac95-f6a10c16786f tempest-TestInstancesWithCinderVolumes-634922416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:26:43 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-8da94ce2-946a-4090-ac95-f6a10c16786f tempest-TestInstancesWithCinderVolumes-634922416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:26:43 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-8da94ce2-946a-4090-ac95-f6a10c16786f tempest-TestInstancesWithCinderVolumes-634922416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:26:43 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-8da94ce2-946a-4090-ac95-f6a10c16786f tempest-TestInstancesWithCinderVolumes-634922416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:26:43 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-8da94ce2-946a-4090-ac95-f6a10c16786f tempest-TestInstancesWithCinderVolumes-634922416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:26:43 devstack sudo[106278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:26:43 devstack sudo[106278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:26:43 devstack sudo[106278]: pam_unix(sudo:session): session closed for user root Apr 29 15:26:43 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-8da94ce2-946a-4090-ac95-f6a10c16786f tempest-TestInstancesWithCinderVolumes-634922416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.827s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:26:43 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-8da94ce2-946a-4090-ac95-f6a10c16786f tempest-TestInstancesWithCinderVolumes-634922416 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:26:43 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-8da94ce2-946a-4090-ac95-f6a10c16786f tempest-TestInstancesWithCinderVolumes-634922416 None] Deleted volume successfully. Apr 29 15:26:43 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-8da94ce2-946a-4090-ac95-f6a10c16786f tempest-TestInstancesWithCinderVolumes-634922416 None] Lock "cinder-61771c01-1179-41e9-8c96-337301e21803-delete_volume" released by "delete_volume" :: held 2.993s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:26:46 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-07e55f07-39c4-495e-bfbd-489d05d0f968 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:26:46 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-07e55f07-39c4-495e-bfbd-489d05d0f968 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] Flow 'volume_create_manager' (d8170a22-cc4f-4d94-9260-45297a466662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:26:46 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-07e55f07-39c4-495e-bfbd-489d05d0f968 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08da86b2-c1ed-4ffa-8816-28dc7de56fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:26:46 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-07e55f07-39c4-495e-bfbd-489d05d0f968 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08da86b2-c1ed-4ffa-8816-28dc7de56fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:26:46Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9384ce4-e4d3-48b8-8611-880e76867604,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90fde652fa9d442dac39a1451663b7ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:26:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:26:46Z,use_quota=True,user_id='a9f8ae5e2a604f00bb93eb7862c7a76f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1196395-6065-4068-8ec2-2e72ee5bfa73),volume_type_id=b1196395-6065-4068-8ec2-2e72ee5bfa73)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:26:46 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-07e55f07-39c4-495e-bfbd-489d05d0f968 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a9cec72-1500-4ae8-8c08-9e215fc1195c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:26:46 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-07e55f07-39c4-495e-bfbd-489d05d0f968 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a9cec72-1500-4ae8-8c08-9e215fc1195c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:26:46 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-07e55f07-39c4-495e-bfbd-489d05d0f968 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66cd98c3-0d5d-4919-a628-3c146918bd54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:26:46 devstack cinder-volume[84448]: DEBUG cinder.image.glance [None req-07e55f07-39c4-495e-bfbd-489d05d0f968 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] Creating Keystone auth plugin from conf {{(pid=84448) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 29 15:26:46 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-07e55f07-39c4-495e-bfbd-489d05d0f968 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66cd98c3-0d5d-4919-a628-3c146918bd54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f9384ce4-e4d3-48b8-8611-880e76867604', 'volume_name': 'volume-f9384ce4-e4d3-48b8-8611-880e76867604', 'volume_size': 1, 'image_id': '632fe400-152e-446c-9c78-b7615e9f3196', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/632fe400-152e-446c-9c78-b7615e9f3196', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b5cb3d8ac7c8eacf13255feaa3a02f41', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '90fde652fa9d442dac39a1451663b7ae', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '132b98c4d66584b446d9921079ef7f74092872ae74d0de9efb0fdf772b7a1d4856b1116b591470c1db3910b81907db8c21391b4fdeadcd05d680147441a3355e', 'id': '632fe400-152e-446c-9c78-b7615e9f3196', 'created_at': datetime.datetime(2026, 4, 29, 13, 26, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 13, 26, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/632fe400-152e-446c-9c78-b7615e9f3196/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:26:46 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-07e55f07-39c4-495e-bfbd-489d05d0f968 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b6711ee-b87e-4ff0-a7e5-146545994fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:26:46 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-07e55f07-39c4-495e-bfbd-489d05d0f968 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b6711ee-b87e-4ff0-a7e5-146545994fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:26:46 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-07e55f07-39c4-495e-bfbd-489d05d0f968 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7c9c846-e344-4472-b1b0-f5e271ed0f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:26:46 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-07e55f07-39c4-495e-bfbd-489d05d0f968 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] Volume f9384ce4-e4d3-48b8-8611-880e76867604: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f9384ce4-e4d3-48b8-8611-880e76867604', 'volume_size': 1, 'image_id': '632fe400-152e-446c-9c78-b7615e9f3196', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/632fe400-152e-446c-9c78-b7615e9f3196', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b5cb3d8ac7c8eacf13255feaa3a02f41', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '90fde652fa9d442dac39a1451663b7ae', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '132b98c4d66584b446d9921079ef7f74092872ae74d0de9efb0fdf772b7a1d4856b1116b591470c1db3910b81907db8c21391b4fdeadcd05d680147441a3355e', 'id': '632fe400-152e-446c-9c78-b7615e9f3196', 'created_at': datetime.datetime(2026, 4, 29, 13, 26, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 13, 26, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/632fe400-152e-446c-9c78-b7615e9f3196/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Apr 29 15:26:46 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-07e55f07-39c4-495e-bfbd-489d05d0f968 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] Trying to clone f9384ce4-e4d3-48b8-8611-880e76867604 from image 632fe400-152e-446c-9c78-b7615e9f3196 at location (None, [{'url': 'file:///opt/stack/data/glance/images/632fe400-152e-446c-9c78-b7615e9f3196', 'metadata': {}}]). {{(pid=84448) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 29 15:26:46 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [None req-07e55f07-39c4-495e-bfbd-489d05d0f968 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_632fe400-152e-446c-9c78-b7615e9f3196_u0rpmhkpdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=84448) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 29 15:26:46 devstack cinder-volume[84448]: INFO cinder.image.image_utils [None req-07e55f07-39c4-495e-bfbd-489d05d0f968 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] Image download 0.00 MB at 0.00 MB/s Apr 29 15:26:46 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e13b65a-ca21-4072-94c9-f6404dfc3a29]: (4, 'raw') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:26:46 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-07e55f07-39c4-495e-bfbd-489d05d0f968 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_632fe400-152e-446c-9c78-b7615e9f3196_u0rpmhkpdevstack@QuobyteHD {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:26:46 devstack sudo[106343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_632fe400-152e-446c-9c78-b7615e9f3196_u0rpmhkpdevstack@QuobyteHD Apr 29 15:26:46 devstack sudo[106343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:26:47 devstack sudo[106343]: pam_unix(sudo:session): session closed for user root Apr 29 15:26:47 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-07e55f07-39c4-495e-bfbd-489d05d0f968 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_632fe400-152e-446c-9c78-b7615e9f3196_u0rpmhkpdevstack@QuobyteHD" returned: 0 in 0.717s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:26:47 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-07e55f07-39c4-495e-bfbd-489d05d0f968 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_632fe400-152e-446c-9c78-b7615e9f3196_u0rpmhkpdevstack@QuobyteHD {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:26:47 devstack sudo[106348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_632fe400-152e-446c-9c78-b7615e9f3196_u0rpmhkpdevstack@QuobyteHD Apr 29 15:26:47 devstack sudo[106348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:26:47 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-61f39dc9-a6ec-4ec5-93f9-3c6a06ad8db0 req-3c3c5341-15af-47b9-8be9-02990cebd131 tempest-TestInstancesWithCinderVolumes-634922416 None] Terminate volume connection completed successfully. Apr 29 15:26:47 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-61f39dc9-a6ec-4ec5-93f9-3c6a06ad8db0 req-3c3c5341-15af-47b9-8be9-02990cebd131 tempest-TestInstancesWithCinderVolumes-634922416 None] Deleting attachment ad2de756-7906-4639-8a9d-a72190b8de39. {{(pid=84448) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 15:26:47 devstack sudo[106348]: pam_unix(sudo:session): session closed for user root Apr 29 15:26:47 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-07e55f07-39c4-495e-bfbd-489d05d0f968 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_632fe400-152e-446c-9c78-b7615e9f3196_u0rpmhkpdevstack@QuobyteHD" returned: 1 in 0.698s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:26:47 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-07e55f07-39c4-495e-bfbd-489d05d0f968 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_632fe400-152e-446c-9c78-b7615e9f3196_u0rpmhkpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 15:26:47 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [None req-07e55f07-39c4-495e-bfbd-489d05d0f968 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] Temporary image 632fe400-152e-446c-9c78-b7615e9f3196 is fetched for user a9f8ae5e2a604f00bb93eb7862c7a76f. {{(pid=84448) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 29 15:26:48 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[af70f7da-15d6-4201-b944-1178cec9b383]: (4, 'raw') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:26:48 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-07e55f07-39c4-495e-bfbd-489d05d0f968 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_632fe400-152e-446c-9c78-b7615e9f3196_u0rpmhkpdevstack@QuobyteHD {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:26:48 devstack sudo[106353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_632fe400-152e-446c-9c78-b7615e9f3196_u0rpmhkpdevstack@QuobyteHD Apr 29 15:26:48 devstack sudo[106353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:26:48 devstack sudo[106353]: pam_unix(sudo:session): session closed for user root Apr 29 15:26:48 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-07e55f07-39c4-495e-bfbd-489d05d0f968 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_632fe400-152e-446c-9c78-b7615e9f3196_u0rpmhkpdevstack@QuobyteHD" returned: 0 in 0.682s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:26:48 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-07e55f07-39c4-495e-bfbd-489d05d0f968 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_632fe400-152e-446c-9c78-b7615e9f3196_u0rpmhkpdevstack@QuobyteHD {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:26:48 devstack sudo[106357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_632fe400-152e-446c-9c78-b7615e9f3196_u0rpmhkpdevstack@QuobyteHD Apr 29 15:26:48 devstack sudo[106357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:26:49 devstack sudo[106357]: pam_unix(sudo:session): session closed for user root Apr 29 15:26:49 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-07e55f07-39c4-495e-bfbd-489d05d0f968 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_632fe400-152e-446c-9c78-b7615e9f3196_u0rpmhkpdevstack@QuobyteHD" returned: 1 in 0.674s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:26:49 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-07e55f07-39c4-495e-bfbd-489d05d0f968 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_632fe400-152e-446c-9c78-b7615e9f3196_u0rpmhkpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 15:26:49 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-07e55f07-39c4-495e-bfbd-489d05d0f968 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:26:49 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-07e55f07-39c4-495e-bfbd-489d05d0f968 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:26:49 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-07e55f07-39c4-495e-bfbd-489d05d0f968 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:26:46Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9384ce4-e4d3-48b8-8611-880e76867604,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90fde652fa9d442dac39a1451663b7ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:26:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:26:46Z,use_quota=True,user_id='a9f8ae5e2a604f00bb93eb7862c7a76f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1196395-6065-4068-8ec2-2e72ee5bfa73),volume_type_id=b1196395-6065-4068-8ec2-2e72ee5bfa73)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:26:49 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-07e55f07-39c4-495e-bfbd-489d05d0f968 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] Creating volume f9384ce4-e4d3-48b8-8611-880e76867604 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:26:49 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-07e55f07-39c4-495e-bfbd-489d05d0f968 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:26:49 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-07e55f07-39c4-495e-bfbd-489d05d0f968 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:26:49 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-07e55f07-39c4-495e-bfbd-489d05d0f968 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:26:49 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-07e55f07-39c4-495e-bfbd-489d05d0f968 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:26:49 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-07e55f07-39c4-495e-bfbd-489d05d0f968 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:26:49 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-07e55f07-39c4-495e-bfbd-489d05d0f968 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:26:49 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-07e55f07-39c4-495e-bfbd-489d05d0f968 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:26:49 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-07e55f07-39c4-495e-bfbd-489d05d0f968 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f9384ce4-e4d3-48b8-8611-880e76867604 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:26:49 devstack sudo[106362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f9384ce4-e4d3-48b8-8611-880e76867604 1073741824 Apr 29 15:26:49 devstack sudo[106362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:26:50 devstack sudo[106362]: pam_unix(sudo:session): session closed for user root Apr 29 15:26:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-07e55f07-39c4-495e-bfbd-489d05d0f968 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f9384ce4-e4d3-48b8-8611-880e76867604 1073741824" returned: 0 in 0.789s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:26:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-07e55f07-39c4-495e-bfbd-489d05d0f968 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f9384ce4-e4d3-48b8-8611-880e76867604 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:26:50 devstack sudo[106368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f9384ce4-e4d3-48b8-8611-880e76867604 Apr 29 15:26:50 devstack sudo[106368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:26:50 devstack sudo[106368]: pam_unix(sudo:session): session closed for user root Apr 29 15:26:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-07e55f07-39c4-495e-bfbd-489d05d0f968 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f9384ce4-e4d3-48b8-8611-880e76867604" returned: 0 in 0.602s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:26:50 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-07e55f07-39c4-495e-bfbd-489d05d0f968 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] <== create_volume: return (1434ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:26:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-07e55f07-39c4-495e-bfbd-489d05d0f968 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.437s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:26:50 devstack cinder-volume[84448]: DEBUG cinder.volume.volume_utils [None req-07e55f07-39c4-495e-bfbd-489d05d0f968 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] Attempting download of 632fe400-152e-446c-9c78-b7615e9f3196 ((None, [{'url': 'file:///opt/stack/data/glance/images/632fe400-152e-446c-9c78-b7615e9f3196', 'metadata': {}}])) to volume f9384ce4-e4d3-48b8-8611-880e76867604. {{(pid=84448) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 29 15:26:50 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[95505c29-30e5-48a8-9977-184c23e7244b]: (4, 'raw') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:26:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-07e55f07-39c4-495e-bfbd-489d05d0f968 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_632fe400-152e-446c-9c78-b7615e9f3196_0e_6q51b {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:26:50 devstack sudo[106371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_632fe400-152e-446c-9c78-b7615e9f3196_0e_6q51b Apr 29 15:26:50 devstack sudo[106371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:26:51 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-86da1421-291a-4559-a970-e1ff85c31eec tempest-TestInstancesWithCinderVolumes-634922416 None] Acquiring lock "cinder-55d9a812-0a88-4ae0-8a9a-82254ec66c2d-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:26:51 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-86da1421-291a-4559-a970-e1ff85c31eec tempest-TestInstancesWithCinderVolumes-634922416 None] Lock "cinder-55d9a812-0a88-4ae0-8a9a-82254ec66c2d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:26:51 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-86da1421-291a-4559-a970-e1ff85c31eec tempest-TestInstancesWithCinderVolumes-634922416 None] Acquiring lock "cinder-quobyte-55d9a812-0a88-4ae0-8a9a-82254ec66c2d" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:26:51 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-86da1421-291a-4559-a970-e1ff85c31eec tempest-TestInstancesWithCinderVolumes-634922416 None] Lock "cinder-quobyte-55d9a812-0a88-4ae0-8a9a-82254ec66c2d" acquired by "delete_volume" :: waited 0.015s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:26:51 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[057d62e8-e1b3-4b95-9642-84d404fed0fc]: (4, 'raw') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:26:51 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-86da1421-291a-4559-a970-e1ff85c31eec tempest-TestInstancesWithCinderVolumes-634922416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-55d9a812-0a88-4ae0-8a9a-82254ec66c2d {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:26:51 devstack sudo[106373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-55d9a812-0a88-4ae0-8a9a-82254ec66c2d Apr 29 15:26:51 devstack sudo[106373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:26:51 devstack sudo[106371]: pam_unix(sudo:session): session closed for user root Apr 29 15:26:51 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-07e55f07-39c4-495e-bfbd-489d05d0f968 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_632fe400-152e-446c-9c78-b7615e9f3196_0e_6q51b" returned: 0 in 0.686s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:26:51 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-07e55f07-39c4-495e-bfbd-489d05d0f968 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_632fe400-152e-446c-9c78-b7615e9f3196_0e_6q51b {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:26:51 devstack sudo[106377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_632fe400-152e-446c-9c78-b7615e9f3196_0e_6q51b Apr 29 15:26:51 devstack sudo[106377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:26:52 devstack sudo[106373]: pam_unix(sudo:session): session closed for user root Apr 29 15:26:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-86da1421-291a-4559-a970-e1ff85c31eec tempest-TestInstancesWithCinderVolumes-634922416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-55d9a812-0a88-4ae0-8a9a-82254ec66c2d" returned: 0 in 0.730s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:26:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-86da1421-291a-4559-a970-e1ff85c31eec tempest-TestInstancesWithCinderVolumes-634922416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-55d9a812-0a88-4ae0-8a9a-82254ec66c2d {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:26:52 devstack sudo[106381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-55d9a812-0a88-4ae0-8a9a-82254ec66c2d Apr 29 15:26:52 devstack sudo[106381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:26:52 devstack sudo[106377]: pam_unix(sudo:session): session closed for user root Apr 29 15:26:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-07e55f07-39c4-495e-bfbd-489d05d0f968 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_632fe400-152e-446c-9c78-b7615e9f3196_0e_6q51b" returned: 1 in 0.662s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:26:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-07e55f07-39c4-495e-bfbd-489d05d0f968 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_632fe400-152e-446c-9c78-b7615e9f3196_0e_6q51b' failed. Not Retrying. {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 15:26:52 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2bc99c-7be1-4c77-9ada-af26a947981d]: (4, 'raw') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:26:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-07e55f07-39c4-495e-bfbd-489d05d0f968 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_632fe400-152e-446c-9c78-b7615e9f3196_u0rpmhkpdevstack@QuobyteHD {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:26:52 devstack sudo[106385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_632fe400-152e-446c-9c78-b7615e9f3196_u0rpmhkpdevstack@QuobyteHD Apr 29 15:26:52 devstack sudo[106385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:26:52 devstack sudo[106381]: pam_unix(sudo:session): session closed for user root Apr 29 15:26:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-86da1421-291a-4559-a970-e1ff85c31eec tempest-TestInstancesWithCinderVolumes-634922416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-55d9a812-0a88-4ae0-8a9a-82254ec66c2d" returned: 1 in 0.735s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:26:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-86da1421-291a-4559-a970-e1ff85c31eec tempest-TestInstancesWithCinderVolumes-634922416 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-55d9a812-0a88-4ae0-8a9a-82254ec66c2d' failed. Not Retrying. {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 15:26:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-86da1421-291a-4559-a970-e1ff85c31eec tempest-TestInstancesWithCinderVolumes-634922416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-55d9a812-0a88-4ae0-8a9a-82254ec66c2d {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:26:52 devstack sudo[106390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-55d9a812-0a88-4ae0-8a9a-82254ec66c2d Apr 29 15:26:52 devstack sudo[106390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:26:52 devstack sudo[106385]: pam_unix(sudo:session): session closed for user root Apr 29 15:26:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-07e55f07-39c4-495e-bfbd-489d05d0f968 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_632fe400-152e-446c-9c78-b7615e9f3196_u0rpmhkpdevstack@QuobyteHD" returned: 0 in 0.689s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:26:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-07e55f07-39c4-495e-bfbd-489d05d0f968 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_632fe400-152e-446c-9c78-b7615e9f3196_u0rpmhkpdevstack@QuobyteHD {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:26:53 devstack sudo[106394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_632fe400-152e-446c-9c78-b7615e9f3196_u0rpmhkpdevstack@QuobyteHD Apr 29 15:26:53 devstack sudo[106394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:26:53 devstack sudo[106390]: pam_unix(sudo:session): session closed for user root Apr 29 15:26:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-86da1421-291a-4559-a970-e1ff85c31eec tempest-TestInstancesWithCinderVolumes-634922416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-55d9a812-0a88-4ae0-8a9a-82254ec66c2d" returned: 0 in 0.599s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:26:53 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-86da1421-291a-4559-a970-e1ff85c31eec tempest-TestInstancesWithCinderVolumes-634922416 None] Lock "cinder-quobyte-55d9a812-0a88-4ae0-8a9a-82254ec66c2d" released by "delete_volume" :: held 2.131s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:26:53 devstack cinder-volume[84448]: WARNING cinder.quota [None req-86da1421-291a-4559-a970-e1ff85c31eec tempest-TestInstancesWithCinderVolumes-634922416 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-812334214-1936977832 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-812334214-1936977832, it is now deprecated. Please use the default quota class for default quota. Apr 29 15:26:53 devstack cinder-volume[84448]: WARNING cinder.quota [None req-86da1421-291a-4559-a970-e1ff85c31eec tempest-TestInstancesWithCinderVolumes-634922416 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-812334214-1936977832 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-812334214-1936977832, it is now deprecated. Please use the default quota class for default quota. Apr 29 15:26:53 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-86da1421-291a-4559-a970-e1ff85c31eec tempest-TestInstancesWithCinderVolumes-634922416 None] Created reservations ['9474a1bb-ef78-49ae-9506-037f254620d4', 'eaf428c1-eab5-4c2e-8d06-4176b38ca35e', '6393558b-94ba-46fe-b01a-74d21fcfaf5e', '5c824291-cc3d-46a7-8719-2b2b37ea9aaa'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:26:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-86da1421-291a-4559-a970-e1ff85c31eec tempest-TestInstancesWithCinderVolumes-634922416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:26:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-86da1421-291a-4559-a970-e1ff85c31eec tempest-TestInstancesWithCinderVolumes-634922416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:26:53 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-86da1421-291a-4559-a970-e1ff85c31eec tempest-TestInstancesWithCinderVolumes-634922416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:26:53 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-86da1421-291a-4559-a970-e1ff85c31eec tempest-TestInstancesWithCinderVolumes-634922416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:26:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-86da1421-291a-4559-a970-e1ff85c31eec tempest-TestInstancesWithCinderVolumes-634922416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:26:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-86da1421-291a-4559-a970-e1ff85c31eec tempest-TestInstancesWithCinderVolumes-634922416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:26:53 devstack sudo[106399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:26:53 devstack sudo[106399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:26:53 devstack sudo[106394]: pam_unix(sudo:session): session closed for user root Apr 29 15:26:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-07e55f07-39c4-495e-bfbd-489d05d0f968 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_632fe400-152e-446c-9c78-b7615e9f3196_u0rpmhkpdevstack@QuobyteHD" returned: 1 in 0.688s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:26:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-07e55f07-39c4-495e-bfbd-489d05d0f968 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_632fe400-152e-446c-9c78-b7615e9f3196_u0rpmhkpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 15:26:53 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [None req-07e55f07-39c4-495e-bfbd-489d05d0f968 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] 632fe400-152e-446c-9c78-b7615e9f3196 was raw, converting to raw {{(pid=84448) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 29 15:26:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-07e55f07-39c4-495e-bfbd-489d05d0f968 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_632fe400-152e-446c-9c78-b7615e9f3196_u0rpmhkpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f9384ce4-e4d3-48b8-8611-880e76867604 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:26:53 devstack sudo[106402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_632fe400-152e-446c-9c78-b7615e9f3196_u0rpmhkpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f9384ce4-e4d3-48b8-8611-880e76867604 Apr 29 15:26:53 devstack sudo[106402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:26:54 devstack sudo[106399]: pam_unix(sudo:session): session closed for user root Apr 29 15:26:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-86da1421-291a-4559-a970-e1ff85c31eec tempest-TestInstancesWithCinderVolumes-634922416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.590s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:26:54 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-86da1421-291a-4559-a970-e1ff85c31eec tempest-TestInstancesWithCinderVolumes-634922416 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:26:54 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-86da1421-291a-4559-a970-e1ff85c31eec tempest-TestInstancesWithCinderVolumes-634922416 None] Deleted volume successfully. Apr 29 15:26:54 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-86da1421-291a-4559-a970-e1ff85c31eec tempest-TestInstancesWithCinderVolumes-634922416 None] Lock "cinder-55d9a812-0a88-4ae0-8a9a-82254ec66c2d-delete_volume" released by "delete_volume" :: held 2.956s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:26:54 devstack sudo[106402]: pam_unix(sudo:session): session closed for user root Apr 29 15:26:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-07e55f07-39c4-495e-bfbd-489d05d0f968 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_632fe400-152e-446c-9c78-b7615e9f3196_u0rpmhkpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f9384ce4-e4d3-48b8-8611-880e76867604" returned: 0 in 0.691s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:26:54 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [None req-07e55f07-39c4-495e-bfbd-489d05d0f968 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_632fe400-152e-446c-9c78-b7615e9f3196_u0rpmhkpdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f9384ce4-e4d3-48b8-8611-880e76867604 {{(pid=84448) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 15:26:54 devstack cinder-volume[84448]: INFO cinder.image.image_utils [None req-07e55f07-39c4-495e-bfbd-489d05d0f968 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] Converted 0.00 MB image at 0.00 MB/s Apr 29 15:26:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-07e55f07-39c4-495e-bfbd-489d05d0f968 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f9384ce4-e4d3-48b8-8611-880e76867604 1G {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:26:54 devstack sudo[106408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f9384ce4-e4d3-48b8-8611-880e76867604 1G Apr 29 15:26:54 devstack sudo[106408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:26:54 devstack sudo[106408]: pam_unix(sudo:session): session closed for user root Apr 29 15:26:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-07e55f07-39c4-495e-bfbd-489d05d0f968 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f9384ce4-e4d3-48b8-8611-880e76867604 1G" returned: 0 in 0.674s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:26:55 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[521ea2cc-6a07-492f-953b-33a7bade6cd3]: (4, 'raw') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:26:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-07e55f07-39c4-495e-bfbd-489d05d0f968 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f9384ce4-e4d3-48b8-8611-880e76867604 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:26:55 devstack sudo[106413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f9384ce4-e4d3-48b8-8611-880e76867604 Apr 29 15:26:55 devstack sudo[106413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:26:55 devstack sudo[106413]: pam_unix(sudo:session): session closed for user root Apr 29 15:26:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-07e55f07-39c4-495e-bfbd-489d05d0f968 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f9384ce4-e4d3-48b8-8611-880e76867604" returned: 0 in 0.730s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:26:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-07e55f07-39c4-495e-bfbd-489d05d0f968 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f9384ce4-e4d3-48b8-8611-880e76867604 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:26:55 devstack sudo[106417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f9384ce4-e4d3-48b8-8611-880e76867604 Apr 29 15:26:55 devstack sudo[106417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:26:56 devstack sudo[106417]: pam_unix(sudo:session): session closed for user root Apr 29 15:26:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-07e55f07-39c4-495e-bfbd-489d05d0f968 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f9384ce4-e4d3-48b8-8611-880e76867604" returned: 1 in 0.749s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:26:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-07e55f07-39c4-495e-bfbd-489d05d0f968 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f9384ce4-e4d3-48b8-8611-880e76867604' failed. Not Retrying. {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 15:26:56 devstack cinder-volume[84448]: DEBUG cinder.volume.volume_utils [None req-07e55f07-39c4-495e-bfbd-489d05d0f968 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] Downloaded image 632fe400-152e-446c-9c78-b7615e9f3196 ((None, [{'url': 'file:///opt/stack/data/glance/images/632fe400-152e-446c-9c78-b7615e9f3196', 'metadata': {}}])) to volume f9384ce4-e4d3-48b8-8611-880e76867604 successfully. {{(pid=84448) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 29 15:26:56 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [None req-07e55f07-39c4-495e-bfbd-489d05d0f968 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] Temporary image 632fe400-152e-446c-9c78-b7615e9f3196 for user a9f8ae5e2a604f00bb93eb7862c7a76f is deleted. {{(pid=84448) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 29 15:26:56 devstack cinder-volume[84448]: DEBUG cinder.volume.volume_utils [None req-07e55f07-39c4-495e-bfbd-489d05d0f968 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] Marking volume f9384ce4-e4d3-48b8-8611-880e76867604 as bootable. {{(pid=84448) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 29 15:26:56 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-07e55f07-39c4-495e-bfbd-489d05d0f968 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] Copying metadata from image 632fe400-152e-446c-9c78-b7615e9f3196 to f9384ce4-e4d3-48b8-8611-880e76867604. {{(pid=84448) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 29 15:26:56 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-07e55f07-39c4-495e-bfbd-489d05d0f968 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] Creating volume glance metadata for volume f9384ce4-e4d3-48b8-8611-880e76867604 backed by image 632fe400-152e-446c-9c78-b7615e9f3196 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '632fe400-152e-446c-9c78-b7615e9f3196', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'b5cb3d8ac7c8eacf13255feaa3a02f41', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=84448) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 29 15:26:56 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-07e55f07-39c4-495e-bfbd-489d05d0f968 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7c9c846-e344-4472-b1b0-f5e271ed0f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9384ce4-e4d3-48b8-8611-880e76867604', 'volume_size': 1, 'image_id': '632fe400-152e-446c-9c78-b7615e9f3196', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/632fe400-152e-446c-9c78-b7615e9f3196', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b5cb3d8ac7c8eacf13255feaa3a02f41', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '90fde652fa9d442dac39a1451663b7ae', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '132b98c4d66584b446d9921079ef7f74092872ae74d0de9efb0fdf772b7a1d4856b1116b591470c1db3910b81907db8c21391b4fdeadcd05d680147441a3355e', 'id': '632fe400-152e-446c-9c78-b7615e9f3196', 'created_at': datetime.datetime(2026, 4, 29, 13, 26, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 13, 26, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/632fe400-152e-446c-9c78-b7615e9f3196/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:26:56 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-07e55f07-39c4-495e-bfbd-489d05d0f968 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f0cb9fe-d105-4fa7-a353-3b222816a291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:26:56 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-07e55f07-39c4-495e-bfbd-489d05d0f968 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] Volume volume-f9384ce4-e4d3-48b8-8611-880e76867604 (f9384ce4-e4d3-48b8-8611-880e76867604): created successfully Apr 29 15:26:56 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-07e55f07-39c4-495e-bfbd-489d05d0f968 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f0cb9fe-d105-4fa7-a353-3b222816a291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:26:56 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-07e55f07-39c4-495e-bfbd-489d05d0f968 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] Flow 'volume_create_manager' (d8170a22-cc4f-4d94-9260-45297a466662) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:26:56 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-07e55f07-39c4-495e-bfbd-489d05d0f968 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] Created volume successfully. Apr 29 15:26:56 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-b5622cf2-ddd5-42eb-8f01-9e65b7e16ce0 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] Acquiring lock "cinder-f9384ce4-e4d3-48b8-8611-880e76867604-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:26:56 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-b5622cf2-ddd5-42eb-8f01-9e65b7e16ce0 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] Lock "cinder-f9384ce4-e4d3-48b8-8611-880e76867604-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:26:56 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-b5622cf2-ddd5-42eb-8f01-9e65b7e16ce0 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] Acquiring lock "cinder-quobyte-f9384ce4-e4d3-48b8-8611-880e76867604" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:26:56 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-b5622cf2-ddd5-42eb-8f01-9e65b7e16ce0 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] Lock "cinder-quobyte-f9384ce4-e4d3-48b8-8611-880e76867604" acquired by "delete_volume" :: waited 0.017s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:26:56 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[14302a63-39b6-4b56-94bf-b92899988ad5]: (4, 'raw') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:26:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-b5622cf2-ddd5-42eb-8f01-9e65b7e16ce0 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f9384ce4-e4d3-48b8-8611-880e76867604 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:26:56 devstack sudo[106423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f9384ce4-e4d3-48b8-8611-880e76867604 Apr 29 15:26:56 devstack sudo[106423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:26:57 devstack sudo[106423]: pam_unix(sudo:session): session closed for user root Apr 29 15:26:57 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-b5622cf2-ddd5-42eb-8f01-9e65b7e16ce0 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f9384ce4-e4d3-48b8-8611-880e76867604" returned: 0 in 0.746s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:26:57 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-b5622cf2-ddd5-42eb-8f01-9e65b7e16ce0 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f9384ce4-e4d3-48b8-8611-880e76867604 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:26:57 devstack sudo[106428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f9384ce4-e4d3-48b8-8611-880e76867604 Apr 29 15:26:57 devstack sudo[106428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:26:58 devstack sudo[106428]: pam_unix(sudo:session): session closed for user root Apr 29 15:26:58 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-b5622cf2-ddd5-42eb-8f01-9e65b7e16ce0 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f9384ce4-e4d3-48b8-8611-880e76867604" returned: 1 in 0.699s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:26:58 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-b5622cf2-ddd5-42eb-8f01-9e65b7e16ce0 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f9384ce4-e4d3-48b8-8611-880e76867604' failed. Not Retrying. {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 15:26:58 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-b5622cf2-ddd5-42eb-8f01-9e65b7e16ce0 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f9384ce4-e4d3-48b8-8611-880e76867604 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:26:58 devstack sudo[106433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f9384ce4-e4d3-48b8-8611-880e76867604 Apr 29 15:26:58 devstack sudo[106433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:26:58 devstack sudo[106433]: pam_unix(sudo:session): session closed for user root Apr 29 15:26:58 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-b5622cf2-ddd5-42eb-8f01-9e65b7e16ce0 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f9384ce4-e4d3-48b8-8611-880e76867604" returned: 0 in 0.652s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:26:59 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-b5622cf2-ddd5-42eb-8f01-9e65b7e16ce0 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] Lock "cinder-quobyte-f9384ce4-e4d3-48b8-8611-880e76867604" released by "delete_volume" :: held 2.177s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:26:59 devstack cinder-volume[84448]: WARNING cinder.quota [None req-b5622cf2-ddd5-42eb-8f01-9e65b7e16ce0 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Apr 29 15:26:59 devstack cinder-volume[84448]: WARNING cinder.quota [None req-b5622cf2-ddd5-42eb-8f01-9e65b7e16ce0 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Apr 29 15:26:59 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-b5622cf2-ddd5-42eb-8f01-9e65b7e16ce0 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] Created reservations ['aba0309f-019f-4c4c-a1d6-7446164ede1b', '43542923-2130-4263-bcb6-38e11cbd7ade', '764febc5-1749-4665-975c-6368b8d815de', 'b6063d50-b1e7-4795-80de-197f8eb950ee'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:26:59 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-b5622cf2-ddd5-42eb-8f01-9e65b7e16ce0 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:26:59 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-b5622cf2-ddd5-42eb-8f01-9e65b7e16ce0 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:26:59 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-b5622cf2-ddd5-42eb-8f01-9e65b7e16ce0 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:26:59 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-b5622cf2-ddd5-42eb-8f01-9e65b7e16ce0 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:26:59 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-b5622cf2-ddd5-42eb-8f01-9e65b7e16ce0 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:26:59 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-b5622cf2-ddd5-42eb-8f01-9e65b7e16ce0 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:26:59 devstack sudo[106437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:26:59 devstack sudo[106437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:26:59 devstack sudo[106437]: pam_unix(sudo:session): session closed for user root Apr 29 15:26:59 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-b5622cf2-ddd5-42eb-8f01-9e65b7e16ce0 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.606s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:26:59 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-b5622cf2-ddd5-42eb-8f01-9e65b7e16ce0 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:26:59 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-b5622cf2-ddd5-42eb-8f01-9e65b7e16ce0 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] Deleted volume successfully. Apr 29 15:26:59 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-b5622cf2-ddd5-42eb-8f01-9e65b7e16ce0 tempest-VolumeAndVolumeTypeFromImageTest-476615565 None] Lock "cinder-f9384ce4-e4d3-48b8-8611-880e76867604-delete_volume" released by "delete_volume" :: held 3.008s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:27:04 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdb91516-33fa-4512-8d05-34476e91e413 tempest-VolumeDependencyTests-1281317412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:27:04 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-bdb91516-33fa-4512-8d05-34476e91e413 tempest-VolumeDependencyTests-1281317412 None] Flow 'volume_create_manager' (bc3f0599-ac08-4d75-9064-502a7690e085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:27:04 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-bdb91516-33fa-4512-8d05-34476e91e413 tempest-VolumeDependencyTests-1281317412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e59ae61-bd9d-4e08-b803-a151f1eca72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:27:04 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-bdb91516-33fa-4512-8d05-34476e91e413 tempest-VolumeDependencyTests-1281317412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e59ae61-bd9d-4e08-b803-a151f1eca72b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:27:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-327366176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9593e044-74d0-4b31-8664-5adde3d3d3a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd2268507a14412f9b4590627e08ae07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:27:05Z,use_quota=True,user_id='7a7caf49add14c63af5b4a46792964d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:27:04 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-bdb91516-33fa-4512-8d05-34476e91e413 tempest-VolumeDependencyTests-1281317412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e7f0a6e-c5cb-4bec-807b-c593709755e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:27:04 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-bdb91516-33fa-4512-8d05-34476e91e413 tempest-VolumeDependencyTests-1281317412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e7f0a6e-c5cb-4bec-807b-c593709755e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:27:04 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-bdb91516-33fa-4512-8d05-34476e91e413 tempest-VolumeDependencyTests-1281317412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58a497de-040c-4d28-aa35-574ecfc468a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:27:04 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-bdb91516-33fa-4512-8d05-34476e91e413 tempest-VolumeDependencyTests-1281317412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58a497de-040c-4d28-aa35-574ecfc468a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9593e044-74d0-4b31-8664-5adde3d3d3a7', 'volume_name': 'volume-9593e044-74d0-4b31-8664-5adde3d3d3a7', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:27:04 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-bdb91516-33fa-4512-8d05-34476e91e413 tempest-VolumeDependencyTests-1281317412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40ca9ae5-9763-4777-86d1-146ef3285f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:27:04 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-bdb91516-33fa-4512-8d05-34476e91e413 tempest-VolumeDependencyTests-1281317412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40ca9ae5-9763-4777-86d1-146ef3285f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:27:04 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-bdb91516-33fa-4512-8d05-34476e91e413 tempest-VolumeDependencyTests-1281317412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (004a8863-d005-48d4-9e59-1c6cff0a4a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:27:04 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-bdb91516-33fa-4512-8d05-34476e91e413 tempest-VolumeDependencyTests-1281317412 None] Volume 9593e044-74d0-4b31-8664-5adde3d3d3a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9593e044-74d0-4b31-8664-5adde3d3d3a7', 'volume_size': 1} Apr 29 15:27:04 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-bdb91516-33fa-4512-8d05-34476e91e413 tempest-VolumeDependencyTests-1281317412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:27:04 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-bdb91516-33fa-4512-8d05-34476e91e413 tempest-VolumeDependencyTests-1281317412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:27:04 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-bdb91516-33fa-4512-8d05-34476e91e413 tempest-VolumeDependencyTests-1281317412 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:27:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-327366176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9593e044-74d0-4b31-8664-5adde3d3d3a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd2268507a14412f9b4590627e08ae07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:27:05Z,use_quota=True,user_id='7a7caf49add14c63af5b4a46792964d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:27:04 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-bdb91516-33fa-4512-8d05-34476e91e413 tempest-VolumeDependencyTests-1281317412 None] Creating volume 9593e044-74d0-4b31-8664-5adde3d3d3a7 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:27:04 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-bdb91516-33fa-4512-8d05-34476e91e413 tempest-VolumeDependencyTests-1281317412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:27:04 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-bdb91516-33fa-4512-8d05-34476e91e413 tempest-VolumeDependencyTests-1281317412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:27:04 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-bdb91516-33fa-4512-8d05-34476e91e413 tempest-VolumeDependencyTests-1281317412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:27:04 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-bdb91516-33fa-4512-8d05-34476e91e413 tempest-VolumeDependencyTests-1281317412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:27:04 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-bdb91516-33fa-4512-8d05-34476e91e413 tempest-VolumeDependencyTests-1281317412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:27:04 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-bdb91516-33fa-4512-8d05-34476e91e413 tempest-VolumeDependencyTests-1281317412 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:27:04 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-bdb91516-33fa-4512-8d05-34476e91e413 tempest-VolumeDependencyTests-1281317412 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:27:04 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-bdb91516-33fa-4512-8d05-34476e91e413 tempest-VolumeDependencyTests-1281317412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9593e044-74d0-4b31-8664-5adde3d3d3a7 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:27:04 devstack sudo[106442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9593e044-74d0-4b31-8664-5adde3d3d3a7 1073741824 Apr 29 15:27:04 devstack sudo[106442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:27:05 devstack sudo[106442]: pam_unix(sudo:session): session closed for user root Apr 29 15:27:05 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-bdb91516-33fa-4512-8d05-34476e91e413 tempest-VolumeDependencyTests-1281317412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9593e044-74d0-4b31-8664-5adde3d3d3a7 1073741824" returned: 0 in 0.824s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:27:05 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-bdb91516-33fa-4512-8d05-34476e91e413 tempest-VolumeDependencyTests-1281317412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9593e044-74d0-4b31-8664-5adde3d3d3a7 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:27:05 devstack sudo[106448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9593e044-74d0-4b31-8664-5adde3d3d3a7 Apr 29 15:27:05 devstack sudo[106448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:27:06 devstack sudo[106448]: pam_unix(sudo:session): session closed for user root Apr 29 15:27:06 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-bdb91516-33fa-4512-8d05-34476e91e413 tempest-VolumeDependencyTests-1281317412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9593e044-74d0-4b31-8664-5adde3d3d3a7" returned: 0 in 0.650s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:27:06 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-bdb91516-33fa-4512-8d05-34476e91e413 tempest-VolumeDependencyTests-1281317412 None] <== create_volume: return (1525ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:27:06 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-bdb91516-33fa-4512-8d05-34476e91e413 tempest-VolumeDependencyTests-1281317412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.528s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:27:06 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-bdb91516-33fa-4512-8d05-34476e91e413 tempest-VolumeDependencyTests-1281317412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (004a8863-d005-48d4-9e59-1c6cff0a4a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9593e044-74d0-4b31-8664-5adde3d3d3a7', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:27:06 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-bdb91516-33fa-4512-8d05-34476e91e413 tempest-VolumeDependencyTests-1281317412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da4e74a6-c4e6-4351-9658-587c91c5adc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:27:06 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-bdb91516-33fa-4512-8d05-34476e91e413 tempest-VolumeDependencyTests-1281317412 None] Volume volume-9593e044-74d0-4b31-8664-5adde3d3d3a7 (9593e044-74d0-4b31-8664-5adde3d3d3a7): created successfully Apr 29 15:27:06 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-bdb91516-33fa-4512-8d05-34476e91e413 tempest-VolumeDependencyTests-1281317412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da4e74a6-c4e6-4351-9658-587c91c5adc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:27:06 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-bdb91516-33fa-4512-8d05-34476e91e413 tempest-VolumeDependencyTests-1281317412 None] Flow 'volume_create_manager' (bc3f0599-ac08-4d75-9064-502a7690e085) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:27:06 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-bdb91516-33fa-4512-8d05-34476e91e413 tempest-VolumeDependencyTests-1281317412 None] Created volume successfully. Apr 29 15:27:07 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-915f717f-d314-43cb-a5b2-f91b187958fe tempest-VolumeDependencyTests-1281317412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:27:07 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-915f717f-d314-43cb-a5b2-f91b187958fe tempest-VolumeDependencyTests-1281317412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:27:07 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-915f717f-d314-43cb-a5b2-f91b187958fe tempest-VolumeDependencyTests-1281317412 None] Creating offline snapshot 9ab610d2-58bb-40c2-bd4c-1b22c9cb502d of volume 9593e044-74d0-4b31-8664-5adde3d3d3a7 {{(pid=84448) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 15:27:07 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9813917-f8bd-4731-af86-b00ffe1ca42f]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:27:07 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-915f717f-d314-43cb-a5b2-f91b187958fe tempest-VolumeDependencyTests-1281317412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9593e044-74d0-4b31-8664-5adde3d3d3a7 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:27:07 devstack sudo[106453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9593e044-74d0-4b31-8664-5adde3d3d3a7 Apr 29 15:27:07 devstack sudo[106453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:27:07 devstack sudo[106453]: pam_unix(sudo:session): session closed for user root Apr 29 15:27:07 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-915f717f-d314-43cb-a5b2-f91b187958fe tempest-VolumeDependencyTests-1281317412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9593e044-74d0-4b31-8664-5adde3d3d3a7" returned: 0 in 0.711s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:27:07 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-915f717f-d314-43cb-a5b2-f91b187958fe tempest-VolumeDependencyTests-1281317412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9593e044-74d0-4b31-8664-5adde3d3d3a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9593e044-74d0-4b31-8664-5adde3d3d3a7.9ab610d2-58bb-40c2-bd4c-1b22c9cb502d 1G {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:27:07 devstack sudo[106458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9593e044-74d0-4b31-8664-5adde3d3d3a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9593e044-74d0-4b31-8664-5adde3d3d3a7.9ab610d2-58bb-40c2-bd4c-1b22c9cb502d 1G Apr 29 15:27:07 devstack sudo[106458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:27:08 devstack sudo[106458]: pam_unix(sudo:session): session closed for user root Apr 29 15:27:08 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-915f717f-d314-43cb-a5b2-f91b187958fe tempest-VolumeDependencyTests-1281317412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9593e044-74d0-4b31-8664-5adde3d3d3a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9593e044-74d0-4b31-8664-5adde3d3d3a7.9ab610d2-58bb-40c2-bd4c-1b22c9cb502d 1G" returned: 0 in 0.784s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:27:08 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-915f717f-d314-43cb-a5b2-f91b187958fe tempest-VolumeDependencyTests-1281317412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9593e044-74d0-4b31-8664-5adde3d3d3a7 -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9593e044-74d0-4b31-8664-5adde3d3d3a7.9ab610d2-58bb-40c2-bd4c-1b22c9cb502d {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:27:08 devstack sudo[106464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9593e044-74d0-4b31-8664-5adde3d3d3a7 -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9593e044-74d0-4b31-8664-5adde3d3d3a7.9ab610d2-58bb-40c2-bd4c-1b22c9cb502d Apr 29 15:27:08 devstack sudo[106464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:27:09 devstack sudo[106464]: pam_unix(sudo:session): session closed for user root Apr 29 15:27:09 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-915f717f-d314-43cb-a5b2-f91b187958fe tempest-VolumeDependencyTests-1281317412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9593e044-74d0-4b31-8664-5adde3d3d3a7 -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9593e044-74d0-4b31-8664-5adde3d3d3a7.9ab610d2-58bb-40c2-bd4c-1b22c9cb502d" returned: 0 in 0.661s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:27:09 devstack cinder-volume[84448]: WARNING cinder.volume.drivers.remotefs [None req-915f717f-d314-43cb-a5b2-f91b187958fe tempest-VolumeDependencyTests-1281317412 None] /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9593e044-74d0-4b31-8664-5adde3d3d3a7.9ab610d2-58bb-40c2-bd4c-1b22c9cb502d is being set with open permissions: ugo+rw Apr 29 15:27:09 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-915f717f-d314-43cb-a5b2-f91b187958fe tempest-VolumeDependencyTests-1281317412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9593e044-74d0-4b31-8664-5adde3d3d3a7.9ab610d2-58bb-40c2-bd4c-1b22c9cb502d {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:27:09 devstack sudo[106469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9593e044-74d0-4b31-8664-5adde3d3d3a7.9ab610d2-58bb-40c2-bd4c-1b22c9cb502d Apr 29 15:27:09 devstack sudo[106469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:27:10 devstack sudo[106469]: pam_unix(sudo:session): session closed for user root Apr 29 15:27:10 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-915f717f-d314-43cb-a5b2-f91b187958fe tempest-VolumeDependencyTests-1281317412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9593e044-74d0-4b31-8664-5adde3d3d3a7.9ab610d2-58bb-40c2-bd4c-1b22c9cb502d" returned: 0 in 0.748s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:27:10 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-915f717f-d314-43cb-a5b2-f91b187958fe tempest-VolumeDependencyTests-1281317412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9593e044-74d0-4b31-8664-5adde3d3d3a7.info {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:27:10 devstack sudo[106472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9593e044-74d0-4b31-8664-5adde3d3d3a7.info Apr 29 15:27:10 devstack sudo[106472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:27:10 devstack sudo[106472]: pam_unix(sudo:session): session closed for user root Apr 29 15:27:10 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-915f717f-d314-43cb-a5b2-f91b187958fe tempest-VolumeDependencyTests-1281317412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9593e044-74d0-4b31-8664-5adde3d3d3a7.info" returned: 0 in 0.646s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:27:10 devstack cinder-volume[84448]: WARNING cinder.volume.drivers.remotefs [None req-915f717f-d314-43cb-a5b2-f91b187958fe tempest-VolumeDependencyTests-1281317412 None] /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9593e044-74d0-4b31-8664-5adde3d3d3a7.info is being set with open permissions: ugo+rw Apr 29 15:27:10 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-915f717f-d314-43cb-a5b2-f91b187958fe tempest-VolumeDependencyTests-1281317412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9593e044-74d0-4b31-8664-5adde3d3d3a7.info {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:27:10 devstack sudo[106475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9593e044-74d0-4b31-8664-5adde3d3d3a7.info Apr 29 15:27:10 devstack sudo[106475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:27:11 devstack sudo[106475]: pam_unix(sudo:session): session closed for user root Apr 29 15:27:11 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-915f717f-d314-43cb-a5b2-f91b187958fe tempest-VolumeDependencyTests-1281317412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9593e044-74d0-4b31-8664-5adde3d3d3a7.info" returned: 0 in 0.698s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:27:11 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-915f717f-d314-43cb-a5b2-f91b187958fe tempest-VolumeDependencyTests-1281317412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.356s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:27:11 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-915f717f-d314-43cb-a5b2-f91b187958fe tempest-VolumeDependencyTests-1281317412 None] Create snapshot completed successfully Apr 29 15:27:12 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bdc6a31-0c03-4bc5-9f83-6cf45a2e6d2a tempest-VolumeDependencyTests-1281317412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:27:12 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-3bdc6a31-0c03-4bc5-9f83-6cf45a2e6d2a tempest-VolumeDependencyTests-1281317412 None] Flow 'volume_create_manager' (b5dbc44f-562c-4901-9379-4052fd660ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:27:12 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-3bdc6a31-0c03-4bc5-9f83-6cf45a2e6d2a tempest-VolumeDependencyTests-1281317412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0439b61b-b14b-49d5-b909-bcd6b4ab6be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:27:12 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-3bdc6a31-0c03-4bc5-9f83-6cf45a2e6d2a tempest-VolumeDependencyTests-1281317412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0439b61b-b14b-49d5-b909-bcd6b4ab6be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:27:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1454724852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a286014-cee9-4a23-9279-23d2e2a076b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd2268507a14412f9b4590627e08ae07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:27:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9ab610d2-58bb-40c2-bd4c-1b22c9cb502d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:27:13Z,use_quota=True,user_id='7a7caf49add14c63af5b4a46792964d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:27:12 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-3bdc6a31-0c03-4bc5-9f83-6cf45a2e6d2a tempest-VolumeDependencyTests-1281317412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aff311da-6bab-4f9c-8dba-ad1bb5421ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:27:12 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-3bdc6a31-0c03-4bc5-9f83-6cf45a2e6d2a tempest-VolumeDependencyTests-1281317412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aff311da-6bab-4f9c-8dba-ad1bb5421ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:27:12 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-3bdc6a31-0c03-4bc5-9f83-6cf45a2e6d2a tempest-VolumeDependencyTests-1281317412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4435b8e-974b-4ca3-a55f-9316dcb3b34b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:27:12 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-3bdc6a31-0c03-4bc5-9f83-6cf45a2e6d2a tempest-VolumeDependencyTests-1281317412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4435b8e-974b-4ca3-a55f-9316dcb3b34b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3a286014-cee9-4a23-9279-23d2e2a076b1', 'volume_name': 'volume-3a286014-cee9-4a23-9279-23d2e2a076b1', 'volume_size': 1, 'snapshot_id': '9ab610d2-58bb-40c2-bd4c-1b22c9cb502d'}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:27:12 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-3bdc6a31-0c03-4bc5-9f83-6cf45a2e6d2a tempest-VolumeDependencyTests-1281317412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6db46f4f-7e8f-4ea7-a0b9-4ae58f03aa2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:27:12 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-3bdc6a31-0c03-4bc5-9f83-6cf45a2e6d2a tempest-VolumeDependencyTests-1281317412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6db46f4f-7e8f-4ea7-a0b9-4ae58f03aa2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:27:12 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-3bdc6a31-0c03-4bc5-9f83-6cf45a2e6d2a tempest-VolumeDependencyTests-1281317412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (256ff9d9-8f24-448a-8a57-3fa37f7af784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:27:12 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-3bdc6a31-0c03-4bc5-9f83-6cf45a2e6d2a tempest-VolumeDependencyTests-1281317412 None] Volume 3a286014-cee9-4a23-9279-23d2e2a076b1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3a286014-cee9-4a23-9279-23d2e2a076b1', 'volume_size': 1, 'snapshot_id': '9ab610d2-58bb-40c2-bd4c-1b22c9cb502d'} Apr 29 15:27:12 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-3bdc6a31-0c03-4bc5-9f83-6cf45a2e6d2a tempest-VolumeDependencyTests-1281317412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:27:12 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-3bdc6a31-0c03-4bc5-9f83-6cf45a2e6d2a tempest-VolumeDependencyTests-1281317412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:27:12 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-3bdc6a31-0c03-4bc5-9f83-6cf45a2e6d2a tempest-VolumeDependencyTests-1281317412 None] Acquiring lock "cinder-quobyte-9ab610d2-58bb-40c2-bd4c-1b22c9cb502d-3a286014-cee9-4a23-9279-23d2e2a076b1" by "_create_volume_from_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:27:12 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-3bdc6a31-0c03-4bc5-9f83-6cf45a2e6d2a tempest-VolumeDependencyTests-1281317412 None] Lock "cinder-quobyte-9ab610d2-58bb-40c2-bd4c-1b22c9cb502d-3a286014-cee9-4a23-9279-23d2e2a076b1" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:27:12 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-3bdc6a31-0c03-4bc5-9f83-6cf45a2e6d2a tempest-VolumeDependencyTests-1281317412 None] Creating volume 3a286014-cee9-4a23-9279-23d2e2a076b1 from snapshot 9ab610d2-58bb-40c2-bd4c-1b22c9cb502d {{(pid=84448) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 15:27:12 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-3bdc6a31-0c03-4bc5-9f83-6cf45a2e6d2a tempest-VolumeDependencyTests-1281317412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:27:12 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-3bdc6a31-0c03-4bc5-9f83-6cf45a2e6d2a tempest-VolumeDependencyTests-1281317412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:27:12 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-3bdc6a31-0c03-4bc5-9f83-6cf45a2e6d2a tempest-VolumeDependencyTests-1281317412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:27:13 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-3bdc6a31-0c03-4bc5-9f83-6cf45a2e6d2a tempest-VolumeDependencyTests-1281317412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:27:13 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-3bdc6a31-0c03-4bc5-9f83-6cf45a2e6d2a tempest-VolumeDependencyTests-1281317412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:27:13 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-3bdc6a31-0c03-4bc5-9f83-6cf45a2e6d2a tempest-VolumeDependencyTests-1281317412 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:27:13 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-3bdc6a31-0c03-4bc5-9f83-6cf45a2e6d2a tempest-VolumeDependencyTests-1281317412 None] Acquiring lock "cinder-quobyte-3a286014-cee9-4a23-9279-23d2e2a076b1" by "_copy_volume_from_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:27:13 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-3bdc6a31-0c03-4bc5-9f83-6cf45a2e6d2a tempest-VolumeDependencyTests-1281317412 None] Lock "cinder-quobyte-3a286014-cee9-4a23-9279-23d2e2a076b1" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:27:13 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-3bdc6a31-0c03-4bc5-9f83-6cf45a2e6d2a tempest-VolumeDependencyTests-1281317412 None] snapshot: 9ab610d2-58bb-40c2-bd4c-1b22c9cb502d, volume: 3a286014-cee9-4a23-9279-23d2e2a076b1, {{(pid=84448) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 15:27:13 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-3bdc6a31-0c03-4bc5-9f83-6cf45a2e6d2a tempest-VolumeDependencyTests-1281317412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:27:13 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-3bdc6a31-0c03-4bc5-9f83-6cf45a2e6d2a tempest-VolumeDependencyTests-1281317412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:27:13 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-3bdc6a31-0c03-4bc5-9f83-6cf45a2e6d2a tempest-VolumeDependencyTests-1281317412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:27:13 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-3bdc6a31-0c03-4bc5-9f83-6cf45a2e6d2a tempest-VolumeDependencyTests-1281317412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:27:13 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-3bdc6a31-0c03-4bc5-9f83-6cf45a2e6d2a tempest-VolumeDependencyTests-1281317412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:27:13 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[824d34eb-ccac-4eac-8f9e-91c577d23694]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:27:13 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-3bdc6a31-0c03-4bc5-9f83-6cf45a2e6d2a tempest-VolumeDependencyTests-1281317412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9593e044-74d0-4b31-8664-5adde3d3d3a7.9ab610d2-58bb-40c2-bd4c-1b22c9cb502d {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:27:13 devstack sudo[106478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9593e044-74d0-4b31-8664-5adde3d3d3a7.9ab610d2-58bb-40c2-bd4c-1b22c9cb502d Apr 29 15:27:13 devstack sudo[106478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:27:13 devstack sudo[106478]: pam_unix(sudo:session): session closed for user root Apr 29 15:27:13 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-3bdc6a31-0c03-4bc5-9f83-6cf45a2e6d2a tempest-VolumeDependencyTests-1281317412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9593e044-74d0-4b31-8664-5adde3d3d3a7.9ab610d2-58bb-40c2-bd4c-1b22c9cb502d" returned: 0 in 0.869s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:27:13 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-3bdc6a31-0c03-4bc5-9f83-6cf45a2e6d2a tempest-VolumeDependencyTests-1281317412 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9593e044-74d0-4b31-8664-5adde3d3d3a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84448) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 15:27:13 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-3bdc6a31-0c03-4bc5-9f83-6cf45a2e6d2a tempest-VolumeDependencyTests-1281317412 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9593e044-74d0-4b31-8664-5adde3d3d3a7 {{(pid=84448) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 15:27:13 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-3bdc6a31-0c03-4bc5-9f83-6cf45a2e6d2a tempest-VolumeDependencyTests-1281317412 None] Creating direct copy from snapshot {{(pid=84448) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 15:27:13 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[deec3845-48bd-424a-8d11-ba00bc858ea4]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:27:13 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-3bdc6a31-0c03-4bc5-9f83-6cf45a2e6d2a tempest-VolumeDependencyTests-1281317412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9593e044-74d0-4b31-8664-5adde3d3d3a7 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:27:14 devstack sudo[106483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9593e044-74d0-4b31-8664-5adde3d3d3a7 Apr 29 15:27:14 devstack sudo[106483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:27:14 devstack sudo[106483]: pam_unix(sudo:session): session closed for user root Apr 29 15:27:14 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-3bdc6a31-0c03-4bc5-9f83-6cf45a2e6d2a tempest-VolumeDependencyTests-1281317412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9593e044-74d0-4b31-8664-5adde3d3d3a7" returned: 0 in 0.746s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:27:14 devstack cinder-volume[84448]: DEBUG cinder.utils [None req-3bdc6a31-0c03-4bc5-9f83-6cf45a2e6d2a tempest-VolumeDependencyTests-1281317412 None] Path /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3a286014-cee9-4a23-9279-23d2e2a076b1 not found in is_blk_device check {{(pid=84448) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 15:27:14 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-3bdc6a31-0c03-4bc5-9f83-6cf45a2e6d2a tempest-VolumeDependencyTests-1281317412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9593e044-74d0-4b31-8664-5adde3d3d3a7 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3a286014-cee9-4a23-9279-23d2e2a076b1 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:27:14 devstack sudo[106488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9593e044-74d0-4b31-8664-5adde3d3d3a7 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3a286014-cee9-4a23-9279-23d2e2a076b1 Apr 29 15:27:14 devstack sudo[106488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:27:20 devstack sudo[106488]: pam_unix(sudo:session): session closed for user root Apr 29 15:27:20 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-3bdc6a31-0c03-4bc5-9f83-6cf45a2e6d2a tempest-VolumeDependencyTests-1281317412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9593e044-74d0-4b31-8664-5adde3d3d3a7 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3a286014-cee9-4a23-9279-23d2e2a076b1" returned: 0 in 5.505s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:27:20 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a302ff1-c917-48e3-9a4c-6814882c89cf]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:27:20 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-3bdc6a31-0c03-4bc5-9f83-6cf45a2e6d2a tempest-VolumeDependencyTests-1281317412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9593e044-74d0-4b31-8664-5adde3d3d3a7 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:27:20 devstack sudo[106502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9593e044-74d0-4b31-8664-5adde3d3d3a7 Apr 29 15:27:20 devstack sudo[106502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:27:21 devstack sudo[106502]: pam_unix(sudo:session): session closed for user root Apr 29 15:27:21 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-3bdc6a31-0c03-4bc5-9f83-6cf45a2e6d2a tempest-VolumeDependencyTests-1281317412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9593e044-74d0-4b31-8664-5adde3d3d3a7" returned: 0 in 0.899s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:27:21 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [None req-3bdc6a31-0c03-4bc5-9f83-6cf45a2e6d2a tempest-VolumeDependencyTests-1281317412 None] Image conversion details: src /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9593e044-74d0-4b31-8664-5adde3d3d3a7, size 1024.00 MB, duration 5.51 sec, destination /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3a286014-cee9-4a23-9279-23d2e2a076b1 {{(pid=84448) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 15:27:21 devstack cinder-volume[84448]: INFO cinder.image.image_utils [None req-3bdc6a31-0c03-4bc5-9f83-6cf45a2e6d2a tempest-VolumeDependencyTests-1281317412 None] Converted 1024.00 MB image at 185.98 MB/s Apr 29 15:27:21 devstack cinder-volume[84448]: WARNING cinder.volume.drivers.remotefs [None req-3bdc6a31-0c03-4bc5-9f83-6cf45a2e6d2a tempest-VolumeDependencyTests-1281317412 None] /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3a286014-cee9-4a23-9279-23d2e2a076b1 is being set with open permissions: ugo+rw Apr 29 15:27:21 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-3bdc6a31-0c03-4bc5-9f83-6cf45a2e6d2a tempest-VolumeDependencyTests-1281317412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3a286014-cee9-4a23-9279-23d2e2a076b1 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:27:21 devstack sudo[106507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3a286014-cee9-4a23-9279-23d2e2a076b1 Apr 29 15:27:21 devstack sudo[106507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:27:21 devstack sudo[106507]: pam_unix(sudo:session): session closed for user root Apr 29 15:27:21 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-3bdc6a31-0c03-4bc5-9f83-6cf45a2e6d2a tempest-VolumeDependencyTests-1281317412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3a286014-cee9-4a23-9279-23d2e2a076b1" returned: 0 in 0.634s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:27:21 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-3bdc6a31-0c03-4bc5-9f83-6cf45a2e6d2a tempest-VolumeDependencyTests-1281317412 None] Lock "cinder-quobyte-3a286014-cee9-4a23-9279-23d2e2a076b1" released by "_copy_volume_from_snapshot" :: held 8.769s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:27:21 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-3bdc6a31-0c03-4bc5-9f83-6cf45a2e6d2a tempest-VolumeDependencyTests-1281317412 None] Lock "cinder-quobyte-9ab610d2-58bb-40c2-bd4c-1b22c9cb502d-3a286014-cee9-4a23-9279-23d2e2a076b1" released by "_create_volume_from_snapshot" :: held 8.804s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:27:21 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-3bdc6a31-0c03-4bc5-9f83-6cf45a2e6d2a tempest-VolumeDependencyTests-1281317412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.819s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:27:21 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-3bdc6a31-0c03-4bc5-9f83-6cf45a2e6d2a tempest-VolumeDependencyTests-1281317412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (256ff9d9-8f24-448a-8a57-3fa37f7af784) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a286014-cee9-4a23-9279-23d2e2a076b1', 'volume_size': 1, 'snapshot_id': '9ab610d2-58bb-40c2-bd4c-1b22c9cb502d'}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:27:21 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-3bdc6a31-0c03-4bc5-9f83-6cf45a2e6d2a tempest-VolumeDependencyTests-1281317412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f5b00ec-76bf-4bf0-8e80-742e480ea505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:27:21 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-3bdc6a31-0c03-4bc5-9f83-6cf45a2e6d2a tempest-VolumeDependencyTests-1281317412 None] Volume volume-3a286014-cee9-4a23-9279-23d2e2a076b1 (3a286014-cee9-4a23-9279-23d2e2a076b1): created successfully Apr 29 15:27:21 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-3bdc6a31-0c03-4bc5-9f83-6cf45a2e6d2a tempest-VolumeDependencyTests-1281317412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f5b00ec-76bf-4bf0-8e80-742e480ea505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:27:21 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-3bdc6a31-0c03-4bc5-9f83-6cf45a2e6d2a tempest-VolumeDependencyTests-1281317412 None] Flow 'volume_create_manager' (b5dbc44f-562c-4901-9379-4052fd660ad8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:27:21 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-3bdc6a31-0c03-4bc5-9f83-6cf45a2e6d2a tempest-VolumeDependencyTests-1281317412 None] Created volume successfully. Apr 29 15:27:22 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-0e850749-090d-4a07-b458-1a31eb00867c tempest-VolumeDependencyTests-1281317412 None] Acquiring lock "cinder-9ab610d2-58bb-40c2-bd4c-1b22c9cb502d-delete_snapshot" by "delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:27:22 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-0e850749-090d-4a07-b458-1a31eb00867c tempest-VolumeDependencyTests-1281317412 None] Lock "cinder-9ab610d2-58bb-40c2-bd4c-1b22c9cb502d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:27:22 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-0e850749-090d-4a07-b458-1a31eb00867c tempest-VolumeDependencyTests-1281317412 None] Acquiring lock "cinder-quobyte-9593e044-74d0-4b31-8664-5adde3d3d3a7" by "delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:27:22 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-0e850749-090d-4a07-b458-1a31eb00867c tempest-VolumeDependencyTests-1281317412 None] Lock "cinder-quobyte-9593e044-74d0-4b31-8664-5adde3d3d3a7" acquired by "delete_snapshot" :: waited 0.018s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:27:22 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-0e850749-090d-4a07-b458-1a31eb00867c tempest-VolumeDependencyTests-1281317412 None] Acquiring lock "cinder-quobyte-9ab610d2-58bb-40c2-bd4c-1b22c9cb502d" by "_delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:27:22 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-0e850749-090d-4a07-b458-1a31eb00867c tempest-VolumeDependencyTests-1281317412 None] Lock "cinder-quobyte-9ab610d2-58bb-40c2-bd4c-1b22c9cb502d" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:27:22 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-0e850749-090d-4a07-b458-1a31eb00867c tempest-VolumeDependencyTests-1281317412 None] Deleting offline snapshot 9ab610d2-58bb-40c2-bd4c-1b22c9cb502d of volume 9593e044-74d0-4b31-8664-5adde3d3d3a7 {{(pid=84448) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 15:27:22 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-0e850749-090d-4a07-b458-1a31eb00867c tempest-VolumeDependencyTests-1281317412 None] snapshot_file for this snap is: volume-9593e044-74d0-4b31-8664-5adde3d3d3a7.9ab610d2-58bb-40c2-bd4c-1b22c9cb502d {{(pid=84448) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 15:27:22 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[306fa1b2-faca-4168-9210-ab1c8d32878d]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:27:22 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-0e850749-090d-4a07-b458-1a31eb00867c tempest-VolumeDependencyTests-1281317412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9593e044-74d0-4b31-8664-5adde3d3d3a7.9ab610d2-58bb-40c2-bd4c-1b22c9cb502d {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:27:23 devstack sudo[106510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9593e044-74d0-4b31-8664-5adde3d3d3a7.9ab610d2-58bb-40c2-bd4c-1b22c9cb502d Apr 29 15:27:23 devstack sudo[106510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:27:23 devstack sudo[106510]: pam_unix(sudo:session): session closed for user root Apr 29 15:27:23 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-0e850749-090d-4a07-b458-1a31eb00867c tempest-VolumeDependencyTests-1281317412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9593e044-74d0-4b31-8664-5adde3d3d3a7.9ab610d2-58bb-40c2-bd4c-1b22c9cb502d" returned: 0 in 0.768s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:27:23 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-0e850749-090d-4a07-b458-1a31eb00867c tempest-VolumeDependencyTests-1281317412 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9593e044-74d0-4b31-8664-5adde3d3d3a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84448) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 15:27:23 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb0d3b8-a4a9-4c16-80c3-35d4da98cfd4]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:27:23 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-0e850749-090d-4a07-b458-1a31eb00867c tempest-VolumeDependencyTests-1281317412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9593e044-74d0-4b31-8664-5adde3d3d3a7 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:27:23 devstack sudo[106515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9593e044-74d0-4b31-8664-5adde3d3d3a7 Apr 29 15:27:23 devstack sudo[106515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:27:24 devstack sudo[106515]: pam_unix(sudo:session): session closed for user root Apr 29 15:27:24 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-0e850749-090d-4a07-b458-1a31eb00867c tempest-VolumeDependencyTests-1281317412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9593e044-74d0-4b31-8664-5adde3d3d3a7" returned: 0 in 0.701s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:27:24 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-0e850749-090d-4a07-b458-1a31eb00867c tempest-VolumeDependencyTests-1281317412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9593e044-74d0-4b31-8664-5adde3d3d3a7.9ab610d2-58bb-40c2-bd4c-1b22c9cb502d {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:27:24 devstack sudo[106520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9593e044-74d0-4b31-8664-5adde3d3d3a7.9ab610d2-58bb-40c2-bd4c-1b22c9cb502d Apr 29 15:27:24 devstack sudo[106520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:27:25 devstack sudo[106520]: pam_unix(sudo:session): session closed for user root Apr 29 15:27:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-0e850749-090d-4a07-b458-1a31eb00867c tempest-VolumeDependencyTests-1281317412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9593e044-74d0-4b31-8664-5adde3d3d3a7.9ab610d2-58bb-40c2-bd4c-1b22c9cb502d" returned: 0 in 0.818s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:27:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-0e850749-090d-4a07-b458-1a31eb00867c tempest-VolumeDependencyTests-1281317412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9593e044-74d0-4b31-8664-5adde3d3d3a7.9ab610d2-58bb-40c2-bd4c-1b22c9cb502d {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:27:25 devstack sudo[106526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9593e044-74d0-4b31-8664-5adde3d3d3a7.9ab610d2-58bb-40c2-bd4c-1b22c9cb502d Apr 29 15:27:25 devstack sudo[106526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:27:25 devstack sudo[106526]: pam_unix(sudo:session): session closed for user root Apr 29 15:27:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-0e850749-090d-4a07-b458-1a31eb00867c tempest-VolumeDependencyTests-1281317412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9593e044-74d0-4b31-8664-5adde3d3d3a7.9ab610d2-58bb-40c2-bd4c-1b22c9cb502d" returned: 0 in 0.644s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:27:25 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-0e850749-090d-4a07-b458-1a31eb00867c tempest-VolumeDependencyTests-1281317412 None] Lock "cinder-quobyte-9ab610d2-58bb-40c2-bd4c-1b22c9cb502d" released by "_delete_snapshot" :: held 3.044s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:27:25 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-0e850749-090d-4a07-b458-1a31eb00867c tempest-VolumeDependencyTests-1281317412 None] Lock "cinder-quobyte-9593e044-74d0-4b31-8664-5adde3d3d3a7" released by "delete_snapshot" :: held 3.079s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:27:26 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-0e850749-090d-4a07-b458-1a31eb00867c tempest-VolumeDependencyTests-1281317412 None] Created reservations ['2f333b7a-0a7e-412c-b3d2-52421c3c0521', '26ce1a99-08e3-404a-bee6-8eae06560add', '099ff686-015f-4d2f-8bbc-8188dec87ea9', '9e2a9705-2bb7-4206-92df-9bda2e4de2ce'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:27:26 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-0e850749-090d-4a07-b458-1a31eb00867c tempest-VolumeDependencyTests-1281317412 None] Delete snapshot completed successfully. Apr 29 15:27:26 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-0e850749-090d-4a07-b458-1a31eb00867c tempest-VolumeDependencyTests-1281317412 None] Lock "cinder-9ab610d2-58bb-40c2-bd4c-1b22c9cb502d-delete_snapshot" released by "delete_snapshot" :: held 3.246s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:27:27 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-43d29e94-3b9b-491e-956c-7c0266c8f84a tempest-VolumeDependencyTests-1281317412 None] Acquiring lock "cinder-9593e044-74d0-4b31-8664-5adde3d3d3a7-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:27:27 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-43d29e94-3b9b-491e-956c-7c0266c8f84a tempest-VolumeDependencyTests-1281317412 None] Lock "cinder-9593e044-74d0-4b31-8664-5adde3d3d3a7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:27:27 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-43d29e94-3b9b-491e-956c-7c0266c8f84a tempest-VolumeDependencyTests-1281317412 None] Acquiring lock "cinder-quobyte-9593e044-74d0-4b31-8664-5adde3d3d3a7" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:27:27 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-43d29e94-3b9b-491e-956c-7c0266c8f84a tempest-VolumeDependencyTests-1281317412 None] Lock "cinder-quobyte-9593e044-74d0-4b31-8664-5adde3d3d3a7" acquired by "delete_volume" :: waited 0.016s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:27:27 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[d08648c4-4684-4894-b3b6-85b5b7eb1579]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:27:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-43d29e94-3b9b-491e-956c-7c0266c8f84a tempest-VolumeDependencyTests-1281317412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9593e044-74d0-4b31-8664-5adde3d3d3a7 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:27:27 devstack sudo[106530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9593e044-74d0-4b31-8664-5adde3d3d3a7 Apr 29 15:27:27 devstack sudo[106530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:27:27 devstack sudo[106530]: pam_unix(sudo:session): session closed for user root Apr 29 15:27:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-43d29e94-3b9b-491e-956c-7c0266c8f84a tempest-VolumeDependencyTests-1281317412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9593e044-74d0-4b31-8664-5adde3d3d3a7" returned: 0 in 0.750s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:27:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-43d29e94-3b9b-491e-956c-7c0266c8f84a tempest-VolumeDependencyTests-1281317412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9593e044-74d0-4b31-8664-5adde3d3d3a7 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:27:27 devstack sudo[106535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9593e044-74d0-4b31-8664-5adde3d3d3a7 Apr 29 15:27:27 devstack sudo[106535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:27:28 devstack sudo[106535]: pam_unix(sudo:session): session closed for user root Apr 29 15:27:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-43d29e94-3b9b-491e-956c-7c0266c8f84a tempest-VolumeDependencyTests-1281317412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-9593e044-74d0-4b31-8664-5adde3d3d3a7" returned: 0 in 0.611s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:27:28 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-43d29e94-3b9b-491e-956c-7c0266c8f84a tempest-VolumeDependencyTests-1281317412 None] Lock "cinder-quobyte-9593e044-74d0-4b31-8664-5adde3d3d3a7" released by "delete_volume" :: held 1.434s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:27:28 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-43d29e94-3b9b-491e-956c-7c0266c8f84a tempest-VolumeDependencyTests-1281317412 None] Created reservations ['ab02ee4a-880d-4295-a1db-72b43eab38e0', 'b9e2026d-9117-4fed-a274-f485709e4d5d', 'ac9e70cd-c6b2-4f01-9d8b-4fd9c278a6fc', '93ddd06b-bc91-4905-a1cf-f673e53f2405'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:27:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-43d29e94-3b9b-491e-956c-7c0266c8f84a tempest-VolumeDependencyTests-1281317412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:27:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-43d29e94-3b9b-491e-956c-7c0266c8f84a tempest-VolumeDependencyTests-1281317412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:27:28 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-43d29e94-3b9b-491e-956c-7c0266c8f84a tempest-VolumeDependencyTests-1281317412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:27:28 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-43d29e94-3b9b-491e-956c-7c0266c8f84a tempest-VolumeDependencyTests-1281317412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:27:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-43d29e94-3b9b-491e-956c-7c0266c8f84a tempest-VolumeDependencyTests-1281317412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:27:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-43d29e94-3b9b-491e-956c-7c0266c8f84a tempest-VolumeDependencyTests-1281317412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:27:28 devstack sudo[106540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:27:28 devstack sudo[106540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:27:29 devstack sudo[106540]: pam_unix(sudo:session): session closed for user root Apr 29 15:27:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-43d29e94-3b9b-491e-956c-7c0266c8f84a tempest-VolumeDependencyTests-1281317412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.621s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:27:29 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-43d29e94-3b9b-491e-956c-7c0266c8f84a tempest-VolumeDependencyTests-1281317412 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:27:29 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-43d29e94-3b9b-491e-956c-7c0266c8f84a tempest-VolumeDependencyTests-1281317412 None] Deleted volume successfully. Apr 29 15:27:29 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-43d29e94-3b9b-491e-956c-7c0266c8f84a tempest-VolumeDependencyTests-1281317412 None] Lock "cinder-9593e044-74d0-4b31-8664-5adde3d3d3a7-delete_volume" released by "delete_volume" :: held 2.292s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:27:29 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-0039359a-7a6f-44fc-8eb4-a5337e2f16f4 tempest-VolumeDependencyTests-1281317412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:27:29 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-0039359a-7a6f-44fc-8eb4-a5337e2f16f4 tempest-VolumeDependencyTests-1281317412 None] Flow 'volume_create_manager' (1ebf4b52-3ce6-421a-9417-f125e3572547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:27:29 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-0039359a-7a6f-44fc-8eb4-a5337e2f16f4 tempest-VolumeDependencyTests-1281317412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17cd6241-9469-4fbd-8e4c-b20aa6864696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:27:29 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-0039359a-7a6f-44fc-8eb4-a5337e2f16f4 tempest-VolumeDependencyTests-1281317412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17cd6241-9469-4fbd-8e4c-b20aa6864696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:27:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1879651667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e387278-7b12-47f2-88b4-2cdeb669bb02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd2268507a14412f9b4590627e08ae07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:27:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:27:30Z,use_quota=True,user_id='7a7caf49add14c63af5b4a46792964d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:27:29 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-0039359a-7a6f-44fc-8eb4-a5337e2f16f4 tempest-VolumeDependencyTests-1281317412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c1bfc88-eb6e-4f1c-9f21-9443f9a132cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:27:29 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-0039359a-7a6f-44fc-8eb4-a5337e2f16f4 tempest-VolumeDependencyTests-1281317412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c1bfc88-eb6e-4f1c-9f21-9443f9a132cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:27:29 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-0039359a-7a6f-44fc-8eb4-a5337e2f16f4 tempest-VolumeDependencyTests-1281317412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae43995e-f2d5-4449-a804-73e654b6780d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:27:29 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-0039359a-7a6f-44fc-8eb4-a5337e2f16f4 tempest-VolumeDependencyTests-1281317412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae43995e-f2d5-4449-a804-73e654b6780d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e387278-7b12-47f2-88b4-2cdeb669bb02', 'volume_name': 'volume-3e387278-7b12-47f2-88b4-2cdeb669bb02', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:27:29 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-0039359a-7a6f-44fc-8eb4-a5337e2f16f4 tempest-VolumeDependencyTests-1281317412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8750312-047e-43c8-ab7a-8116ad62a9f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:27:29 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-0039359a-7a6f-44fc-8eb4-a5337e2f16f4 tempest-VolumeDependencyTests-1281317412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8750312-047e-43c8-ab7a-8116ad62a9f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:27:29 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-0039359a-7a6f-44fc-8eb4-a5337e2f16f4 tempest-VolumeDependencyTests-1281317412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9ef5a28-85e6-463e-a9bc-d03a3e4987bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:27:29 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-0039359a-7a6f-44fc-8eb4-a5337e2f16f4 tempest-VolumeDependencyTests-1281317412 None] Volume 3e387278-7b12-47f2-88b4-2cdeb669bb02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e387278-7b12-47f2-88b4-2cdeb669bb02', 'volume_size': 1} Apr 29 15:27:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-0039359a-7a6f-44fc-8eb4-a5337e2f16f4 tempest-VolumeDependencyTests-1281317412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:27:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-0039359a-7a6f-44fc-8eb4-a5337e2f16f4 tempest-VolumeDependencyTests-1281317412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:27:29 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-0039359a-7a6f-44fc-8eb4-a5337e2f16f4 tempest-VolumeDependencyTests-1281317412 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:27:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1879651667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e387278-7b12-47f2-88b4-2cdeb669bb02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd2268507a14412f9b4590627e08ae07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:27:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:27:30Z,use_quota=True,user_id='7a7caf49add14c63af5b4a46792964d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:27:29 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-0039359a-7a6f-44fc-8eb4-a5337e2f16f4 tempest-VolumeDependencyTests-1281317412 None] Creating volume 3e387278-7b12-47f2-88b4-2cdeb669bb02 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:27:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-0039359a-7a6f-44fc-8eb4-a5337e2f16f4 tempest-VolumeDependencyTests-1281317412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:27:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-0039359a-7a6f-44fc-8eb4-a5337e2f16f4 tempest-VolumeDependencyTests-1281317412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:27:29 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-0039359a-7a6f-44fc-8eb4-a5337e2f16f4 tempest-VolumeDependencyTests-1281317412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:27:29 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-0039359a-7a6f-44fc-8eb4-a5337e2f16f4 tempest-VolumeDependencyTests-1281317412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:27:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-0039359a-7a6f-44fc-8eb4-a5337e2f16f4 tempest-VolumeDependencyTests-1281317412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:27:29 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-0039359a-7a6f-44fc-8eb4-a5337e2f16f4 tempest-VolumeDependencyTests-1281317412 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:27:29 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-0039359a-7a6f-44fc-8eb4-a5337e2f16f4 tempest-VolumeDependencyTests-1281317412 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:27:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-0039359a-7a6f-44fc-8eb4-a5337e2f16f4 tempest-VolumeDependencyTests-1281317412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3e387278-7b12-47f2-88b4-2cdeb669bb02 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:27:29 devstack sudo[106543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3e387278-7b12-47f2-88b4-2cdeb669bb02 1073741824 Apr 29 15:27:29 devstack sudo[106543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:27:30 devstack cinder-volume[84448]: DEBUG oslo_service.periodic_task [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84448) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 15:27:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:27:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:27:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:27:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:27:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:27:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:27:30 devstack sudo[106548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:27:30 devstack sudo[106548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:27:30 devstack sudo[106543]: pam_unix(sudo:session): session closed for user root Apr 29 15:27:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-0039359a-7a6f-44fc-8eb4-a5337e2f16f4 tempest-VolumeDependencyTests-1281317412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3e387278-7b12-47f2-88b4-2cdeb669bb02 1073741824" returned: 0 in 0.857s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:27:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-0039359a-7a6f-44fc-8eb4-a5337e2f16f4 tempest-VolumeDependencyTests-1281317412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3e387278-7b12-47f2-88b4-2cdeb669bb02 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:27:30 devstack sudo[106550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3e387278-7b12-47f2-88b4-2cdeb669bb02 Apr 29 15:27:30 devstack sudo[106550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:27:31 devstack sudo[106548]: pam_unix(sudo:session): session closed for user root Apr 29 15:27:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.636s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:27:31 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:27:31 devstack sudo[106550]: pam_unix(sudo:session): session closed for user root Apr 29 15:27:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-0039359a-7a6f-44fc-8eb4-a5337e2f16f4 tempest-VolumeDependencyTests-1281317412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3e387278-7b12-47f2-88b4-2cdeb669bb02" returned: 0 in 0.600s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:27:31 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-0039359a-7a6f-44fc-8eb4-a5337e2f16f4 tempest-VolumeDependencyTests-1281317412 None] <== create_volume: return (1500ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:27:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-0039359a-7a6f-44fc-8eb4-a5337e2f16f4 tempest-VolumeDependencyTests-1281317412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.503s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:27:31 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-0039359a-7a6f-44fc-8eb4-a5337e2f16f4 tempest-VolumeDependencyTests-1281317412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9ef5a28-85e6-463e-a9bc-d03a3e4987bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e387278-7b12-47f2-88b4-2cdeb669bb02', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:27:31 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-0039359a-7a6f-44fc-8eb4-a5337e2f16f4 tempest-VolumeDependencyTests-1281317412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d092ac86-3c31-42d3-9ebf-a38455a0d16e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:27:31 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-0039359a-7a6f-44fc-8eb4-a5337e2f16f4 tempest-VolumeDependencyTests-1281317412 None] Volume volume-3e387278-7b12-47f2-88b4-2cdeb669bb02 (3e387278-7b12-47f2-88b4-2cdeb669bb02): created successfully Apr 29 15:27:31 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-0039359a-7a6f-44fc-8eb4-a5337e2f16f4 tempest-VolumeDependencyTests-1281317412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d092ac86-3c31-42d3-9ebf-a38455a0d16e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:27:31 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-0039359a-7a6f-44fc-8eb4-a5337e2f16f4 tempest-VolumeDependencyTests-1281317412 None] Flow 'volume_create_manager' (1ebf4b52-3ce6-421a-9417-f125e3572547) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:27:31 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-0039359a-7a6f-44fc-8eb4-a5337e2f16f4 tempest-VolumeDependencyTests-1281317412 None] Created volume successfully. Apr 29 15:27:32 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9532c7f-eaf9-4b59-8795-ef89a2fb1a68 tempest-VolumeDependencyTests-1281317412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:27:32 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c9532c7f-eaf9-4b59-8795-ef89a2fb1a68 tempest-VolumeDependencyTests-1281317412 None] Flow 'volume_create_manager' (dd4bc581-8ccb-45a2-bc07-dbc88f65d43f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:27:32 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c9532c7f-eaf9-4b59-8795-ef89a2fb1a68 tempest-VolumeDependencyTests-1281317412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43a48b78-8ce1-4ca8-a5d8-96996917a17d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:27:32 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c9532c7f-eaf9-4b59-8795-ef89a2fb1a68 tempest-VolumeDependencyTests-1281317412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43a48b78-8ce1-4ca8-a5d8-96996917a17d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:27:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-448859002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61798196-b348-4dd9-ad3c-bb77e19497b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd2268507a14412f9b4590627e08ae07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:27:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=3e387278-7b12-47f2-88b4-2cdeb669bb02,status='creating',terminated_at=None,updated_at=2026-04-29T13:27:32Z,use_quota=True,user_id='7a7caf49add14c63af5b4a46792964d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:27:32 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c9532c7f-eaf9-4b59-8795-ef89a2fb1a68 tempest-VolumeDependencyTests-1281317412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (091806c5-e024-4ff3-a372-2bc1f9cf031e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:27:32 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c9532c7f-eaf9-4b59-8795-ef89a2fb1a68 tempest-VolumeDependencyTests-1281317412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (091806c5-e024-4ff3-a372-2bc1f9cf031e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:27:32 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c9532c7f-eaf9-4b59-8795-ef89a2fb1a68 tempest-VolumeDependencyTests-1281317412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccd41eb1-c8f0-40bd-8e79-cbf237d6711f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:27:32 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c9532c7f-eaf9-4b59-8795-ef89a2fb1a68 tempest-VolumeDependencyTests-1281317412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccd41eb1-c8f0-40bd-8e79-cbf237d6711f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '61798196-b348-4dd9-ad3c-bb77e19497b0', 'volume_name': 'volume-61798196-b348-4dd9-ad3c-bb77e19497b0', 'volume_size': 1, 'source_volid': '3e387278-7b12-47f2-88b4-2cdeb669bb02', 'source_volstatus': 'available'}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:27:32 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c9532c7f-eaf9-4b59-8795-ef89a2fb1a68 tempest-VolumeDependencyTests-1281317412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51da82d7-3ea8-44ee-83c9-e54303b93f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:27:32 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c9532c7f-eaf9-4b59-8795-ef89a2fb1a68 tempest-VolumeDependencyTests-1281317412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51da82d7-3ea8-44ee-83c9-e54303b93f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:27:32 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c9532c7f-eaf9-4b59-8795-ef89a2fb1a68 tempest-VolumeDependencyTests-1281317412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc6a0e16-e130-4213-af51-6eedce8db1b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:27:32 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-c9532c7f-eaf9-4b59-8795-ef89a2fb1a68 tempest-VolumeDependencyTests-1281317412 None] Volume 61798196-b348-4dd9-ad3c-bb77e19497b0: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-61798196-b348-4dd9-ad3c-bb77e19497b0', 'volume_size': 1, 'source_volid': '3e387278-7b12-47f2-88b4-2cdeb669bb02', 'source_volstatus': 'available'} Apr 29 15:27:32 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-c9532c7f-eaf9-4b59-8795-ef89a2fb1a68 tempest-VolumeDependencyTests-1281317412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:27:32 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-c9532c7f-eaf9-4b59-8795-ef89a2fb1a68 tempest-VolumeDependencyTests-1281317412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:27:32 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-c9532c7f-eaf9-4b59-8795-ef89a2fb1a68 tempest-VolumeDependencyTests-1281317412 None] Cloning volume 3e387278-7b12-47f2-88b4-2cdeb669bb02 to volume 61798196-b348-4dd9-ad3c-bb77e19497b0 Apr 29 15:27:32 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-c9532c7f-eaf9-4b59-8795-ef89a2fb1a68 tempest-VolumeDependencyTests-1281317412 None] Creating offline snapshot ce465cf6-9c13-42e2-970a-6d91e9ac1e36 of volume 3e387278-7b12-47f2-88b4-2cdeb669bb02 {{(pid=84448) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 15:27:32 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[d16c5fbf-1200-4668-aef3-1f3e95b85947]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:27:32 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c9532c7f-eaf9-4b59-8795-ef89a2fb1a68 tempest-VolumeDependencyTests-1281317412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3e387278-7b12-47f2-88b4-2cdeb669bb02 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:27:32 devstack sudo[106560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3e387278-7b12-47f2-88b4-2cdeb669bb02 Apr 29 15:27:32 devstack sudo[106560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:27:33 devstack sudo[106560]: pam_unix(sudo:session): session closed for user root Apr 29 15:27:33 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c9532c7f-eaf9-4b59-8795-ef89a2fb1a68 tempest-VolumeDependencyTests-1281317412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3e387278-7b12-47f2-88b4-2cdeb669bb02" returned: 0 in 0.741s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:27:33 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c9532c7f-eaf9-4b59-8795-ef89a2fb1a68 tempest-VolumeDependencyTests-1281317412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3e387278-7b12-47f2-88b4-2cdeb669bb02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3e387278-7b12-47f2-88b4-2cdeb669bb02.ce465cf6-9c13-42e2-970a-6d91e9ac1e36 1G {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:27:33 devstack sudo[106565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3e387278-7b12-47f2-88b4-2cdeb669bb02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3e387278-7b12-47f2-88b4-2cdeb669bb02.ce465cf6-9c13-42e2-970a-6d91e9ac1e36 1G Apr 29 15:27:33 devstack sudo[106565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:27:34 devstack sudo[106565]: pam_unix(sudo:session): session closed for user root Apr 29 15:27:34 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c9532c7f-eaf9-4b59-8795-ef89a2fb1a68 tempest-VolumeDependencyTests-1281317412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3e387278-7b12-47f2-88b4-2cdeb669bb02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3e387278-7b12-47f2-88b4-2cdeb669bb02.ce465cf6-9c13-42e2-970a-6d91e9ac1e36 1G" returned: 0 in 0.924s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:27:34 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c9532c7f-eaf9-4b59-8795-ef89a2fb1a68 tempest-VolumeDependencyTests-1281317412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e387278-7b12-47f2-88b4-2cdeb669bb02 -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3e387278-7b12-47f2-88b4-2cdeb669bb02.ce465cf6-9c13-42e2-970a-6d91e9ac1e36 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:27:34 devstack sudo[106606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e387278-7b12-47f2-88b4-2cdeb669bb02 -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3e387278-7b12-47f2-88b4-2cdeb669bb02.ce465cf6-9c13-42e2-970a-6d91e9ac1e36 Apr 29 15:27:34 devstack sudo[106606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:27:34 devstack sudo[106606]: pam_unix(sudo:session): session closed for user root Apr 29 15:27:34 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c9532c7f-eaf9-4b59-8795-ef89a2fb1a68 tempest-VolumeDependencyTests-1281317412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e387278-7b12-47f2-88b4-2cdeb669bb02 -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3e387278-7b12-47f2-88b4-2cdeb669bb02.ce465cf6-9c13-42e2-970a-6d91e9ac1e36" returned: 0 in 0.701s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:27:34 devstack cinder-volume[84448]: WARNING cinder.volume.drivers.remotefs [None req-c9532c7f-eaf9-4b59-8795-ef89a2fb1a68 tempest-VolumeDependencyTests-1281317412 None] /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3e387278-7b12-47f2-88b4-2cdeb669bb02.ce465cf6-9c13-42e2-970a-6d91e9ac1e36 is being set with open permissions: ugo+rw Apr 29 15:27:34 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c9532c7f-eaf9-4b59-8795-ef89a2fb1a68 tempest-VolumeDependencyTests-1281317412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3e387278-7b12-47f2-88b4-2cdeb669bb02.ce465cf6-9c13-42e2-970a-6d91e9ac1e36 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:27:34 devstack sudo[106616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3e387278-7b12-47f2-88b4-2cdeb669bb02.ce465cf6-9c13-42e2-970a-6d91e9ac1e36 Apr 29 15:27:34 devstack sudo[106616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:27:35 devstack sudo[106616]: pam_unix(sudo:session): session closed for user root Apr 29 15:27:35 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c9532c7f-eaf9-4b59-8795-ef89a2fb1a68 tempest-VolumeDependencyTests-1281317412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3e387278-7b12-47f2-88b4-2cdeb669bb02.ce465cf6-9c13-42e2-970a-6d91e9ac1e36" returned: 0 in 0.616s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:27:35 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c9532c7f-eaf9-4b59-8795-ef89a2fb1a68 tempest-VolumeDependencyTests-1281317412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3e387278-7b12-47f2-88b4-2cdeb669bb02.info {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:27:35 devstack sudo[106631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3e387278-7b12-47f2-88b4-2cdeb669bb02.info Apr 29 15:27:35 devstack sudo[106631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:27:35 devstack sudo[106631]: pam_unix(sudo:session): session closed for user root Apr 29 15:27:35 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c9532c7f-eaf9-4b59-8795-ef89a2fb1a68 tempest-VolumeDependencyTests-1281317412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3e387278-7b12-47f2-88b4-2cdeb669bb02.info" returned: 0 in 0.580s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:27:35 devstack cinder-volume[84448]: WARNING cinder.volume.drivers.remotefs [None req-c9532c7f-eaf9-4b59-8795-ef89a2fb1a68 tempest-VolumeDependencyTests-1281317412 None] /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3e387278-7b12-47f2-88b4-2cdeb669bb02.info is being set with open permissions: ugo+rw Apr 29 15:27:35 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c9532c7f-eaf9-4b59-8795-ef89a2fb1a68 tempest-VolumeDependencyTests-1281317412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3e387278-7b12-47f2-88b4-2cdeb669bb02.info {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:27:36 devstack sudo[106635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3e387278-7b12-47f2-88b4-2cdeb669bb02.info Apr 29 15:27:36 devstack sudo[106635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:27:36 devstack sudo[106635]: pam_unix(sudo:session): session closed for user root Apr 29 15:27:36 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c9532c7f-eaf9-4b59-8795-ef89a2fb1a68 tempest-VolumeDependencyTests-1281317412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3e387278-7b12-47f2-88b4-2cdeb669bb02.info" returned: 0 in 0.618s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:27:36 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-c9532c7f-eaf9-4b59-8795-ef89a2fb1a68 tempest-VolumeDependencyTests-1281317412 None] Acquiring lock "cinder-quobyte-61798196-b348-4dd9-ad3c-bb77e19497b0" by "_copy_volume_from_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:27:36 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-c9532c7f-eaf9-4b59-8795-ef89a2fb1a68 tempest-VolumeDependencyTests-1281317412 None] Lock "cinder-quobyte-61798196-b348-4dd9-ad3c-bb77e19497b0" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:27:36 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-c9532c7f-eaf9-4b59-8795-ef89a2fb1a68 tempest-VolumeDependencyTests-1281317412 None] snapshot: ce465cf6-9c13-42e2-970a-6d91e9ac1e36, volume: 61798196-b348-4dd9-ad3c-bb77e19497b0, {{(pid=84448) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 15:27:36 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-c9532c7f-eaf9-4b59-8795-ef89a2fb1a68 tempest-VolumeDependencyTests-1281317412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:27:36 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-c9532c7f-eaf9-4b59-8795-ef89a2fb1a68 tempest-VolumeDependencyTests-1281317412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:27:36 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-c9532c7f-eaf9-4b59-8795-ef89a2fb1a68 tempest-VolumeDependencyTests-1281317412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:27:36 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-c9532c7f-eaf9-4b59-8795-ef89a2fb1a68 tempest-VolumeDependencyTests-1281317412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:27:36 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-c9532c7f-eaf9-4b59-8795-ef89a2fb1a68 tempest-VolumeDependencyTests-1281317412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:27:36 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[482e645f-cdc1-4063-bab4-f3dca09bb1f0]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:27:36 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c9532c7f-eaf9-4b59-8795-ef89a2fb1a68 tempest-VolumeDependencyTests-1281317412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3e387278-7b12-47f2-88b4-2cdeb669bb02.ce465cf6-9c13-42e2-970a-6d91e9ac1e36 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:27:36 devstack sudo[106638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3e387278-7b12-47f2-88b4-2cdeb669bb02.ce465cf6-9c13-42e2-970a-6d91e9ac1e36 Apr 29 15:27:36 devstack sudo[106638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:27:37 devstack sudo[106638]: pam_unix(sudo:session): session closed for user root Apr 29 15:27:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c9532c7f-eaf9-4b59-8795-ef89a2fb1a68 tempest-VolumeDependencyTests-1281317412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3e387278-7b12-47f2-88b4-2cdeb669bb02.ce465cf6-9c13-42e2-970a-6d91e9ac1e36" returned: 0 in 0.739s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:27:37 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-c9532c7f-eaf9-4b59-8795-ef89a2fb1a68 tempest-VolumeDependencyTests-1281317412 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e387278-7b12-47f2-88b4-2cdeb669bb02(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84448) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 15:27:37 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-c9532c7f-eaf9-4b59-8795-ef89a2fb1a68 tempest-VolumeDependencyTests-1281317412 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3e387278-7b12-47f2-88b4-2cdeb669bb02 {{(pid=84448) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 15:27:37 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-c9532c7f-eaf9-4b59-8795-ef89a2fb1a68 tempest-VolumeDependencyTests-1281317412 None] Creating direct copy from snapshot {{(pid=84448) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 15:27:37 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[11111073-5893-417a-aacb-2620fa379c42]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:27:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c9532c7f-eaf9-4b59-8795-ef89a2fb1a68 tempest-VolumeDependencyTests-1281317412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3e387278-7b12-47f2-88b4-2cdeb669bb02 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:27:37 devstack sudo[106643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3e387278-7b12-47f2-88b4-2cdeb669bb02 Apr 29 15:27:37 devstack sudo[106643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:27:38 devstack sudo[106643]: pam_unix(sudo:session): session closed for user root Apr 29 15:27:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c9532c7f-eaf9-4b59-8795-ef89a2fb1a68 tempest-VolumeDependencyTests-1281317412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3e387278-7b12-47f2-88b4-2cdeb669bb02" returned: 0 in 0.730s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:27:38 devstack cinder-volume[84448]: DEBUG cinder.utils [None req-c9532c7f-eaf9-4b59-8795-ef89a2fb1a68 tempest-VolumeDependencyTests-1281317412 None] Path /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-61798196-b348-4dd9-ad3c-bb77e19497b0 not found in is_blk_device check {{(pid=84448) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 15:27:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c9532c7f-eaf9-4b59-8795-ef89a2fb1a68 tempest-VolumeDependencyTests-1281317412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3e387278-7b12-47f2-88b4-2cdeb669bb02 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-61798196-b348-4dd9-ad3c-bb77e19497b0 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:27:38 devstack sudo[106656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3e387278-7b12-47f2-88b4-2cdeb669bb02 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-61798196-b348-4dd9-ad3c-bb77e19497b0 Apr 29 15:27:38 devstack sudo[106656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:27:45 devstack sudo[106656]: pam_unix(sudo:session): session closed for user root Apr 29 15:27:45 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c9532c7f-eaf9-4b59-8795-ef89a2fb1a68 tempest-VolumeDependencyTests-1281317412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3e387278-7b12-47f2-88b4-2cdeb669bb02 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-61798196-b348-4dd9-ad3c-bb77e19497b0" returned: 0 in 7.159s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:27:45 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad97834d-f7b9-439a-81c9-6bd648835216]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:27:45 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c9532c7f-eaf9-4b59-8795-ef89a2fb1a68 tempest-VolumeDependencyTests-1281317412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3e387278-7b12-47f2-88b4-2cdeb669bb02 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:27:45 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:SELECT=45,cinder:INSERT=22,cinder:UPDATE=54,cinder:DELETE=4 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:27:45 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:SELECT=52,cinder:INSERT=14,cinder:UPDATE=51,cinder:DELETE=5 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:27:45 devstack sudo[106789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3e387278-7b12-47f2-88b4-2cdeb669bb02 Apr 29 15:27:45 devstack sudo[106789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:27:46 devstack sudo[106789]: pam_unix(sudo:session): session closed for user root Apr 29 15:27:46 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c9532c7f-eaf9-4b59-8795-ef89a2fb1a68 tempest-VolumeDependencyTests-1281317412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3e387278-7b12-47f2-88b4-2cdeb669bb02" returned: 0 in 1.127s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:27:46 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [None req-c9532c7f-eaf9-4b59-8795-ef89a2fb1a68 tempest-VolumeDependencyTests-1281317412 None] Image conversion details: src /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3e387278-7b12-47f2-88b4-2cdeb669bb02, size 1024.00 MB, duration 7.16 sec, destination /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-61798196-b348-4dd9-ad3c-bb77e19497b0 {{(pid=84448) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 15:27:46 devstack cinder-volume[84448]: INFO cinder.image.image_utils [None req-c9532c7f-eaf9-4b59-8795-ef89a2fb1a68 tempest-VolumeDependencyTests-1281317412 None] Converted 1024.00 MB image at 143.01 MB/s Apr 29 15:27:46 devstack cinder-volume[84448]: WARNING cinder.volume.drivers.remotefs [None req-c9532c7f-eaf9-4b59-8795-ef89a2fb1a68 tempest-VolumeDependencyTests-1281317412 None] /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-61798196-b348-4dd9-ad3c-bb77e19497b0 is being set with open permissions: ugo+rw Apr 29 15:27:46 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c9532c7f-eaf9-4b59-8795-ef89a2fb1a68 tempest-VolumeDependencyTests-1281317412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-61798196-b348-4dd9-ad3c-bb77e19497b0 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:27:46 devstack sudo[106806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-61798196-b348-4dd9-ad3c-bb77e19497b0 Apr 29 15:27:46 devstack sudo[106806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:27:47 devstack sudo[106806]: pam_unix(sudo:session): session closed for user root Apr 29 15:27:47 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c9532c7f-eaf9-4b59-8795-ef89a2fb1a68 tempest-VolumeDependencyTests-1281317412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-61798196-b348-4dd9-ad3c-bb77e19497b0" returned: 0 in 0.617s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:27:47 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-c9532c7f-eaf9-4b59-8795-ef89a2fb1a68 tempest-VolumeDependencyTests-1281317412 None] Lock "cinder-quobyte-61798196-b348-4dd9-ad3c-bb77e19497b0" released by "_copy_volume_from_snapshot" :: held 10.464s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:27:47 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-c9532c7f-eaf9-4b59-8795-ef89a2fb1a68 tempest-VolumeDependencyTests-1281317412 None] Acquiring lock "cinder-quobyte-ce465cf6-9c13-42e2-970a-6d91e9ac1e36" by "_delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:27:47 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-c9532c7f-eaf9-4b59-8795-ef89a2fb1a68 tempest-VolumeDependencyTests-1281317412 None] Lock "cinder-quobyte-ce465cf6-9c13-42e2-970a-6d91e9ac1e36" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:27:47 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-c9532c7f-eaf9-4b59-8795-ef89a2fb1a68 tempest-VolumeDependencyTests-1281317412 None] Deleting offline snapshot ce465cf6-9c13-42e2-970a-6d91e9ac1e36 of volume 3e387278-7b12-47f2-88b4-2cdeb669bb02 {{(pid=84448) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 15:27:47 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-c9532c7f-eaf9-4b59-8795-ef89a2fb1a68 tempest-VolumeDependencyTests-1281317412 None] snapshot_file for this snap is: volume-3e387278-7b12-47f2-88b4-2cdeb669bb02.ce465cf6-9c13-42e2-970a-6d91e9ac1e36 {{(pid=84448) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 15:27:47 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[b11cb9cc-16ca-4389-b5b4-23c518b6a936]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:27:47 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c9532c7f-eaf9-4b59-8795-ef89a2fb1a68 tempest-VolumeDependencyTests-1281317412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3e387278-7b12-47f2-88b4-2cdeb669bb02.ce465cf6-9c13-42e2-970a-6d91e9ac1e36 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:27:47 devstack sudo[106809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3e387278-7b12-47f2-88b4-2cdeb669bb02.ce465cf6-9c13-42e2-970a-6d91e9ac1e36 Apr 29 15:27:47 devstack sudo[106809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:27:47 devstack sudo[106809]: pam_unix(sudo:session): session closed for user root Apr 29 15:27:47 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c9532c7f-eaf9-4b59-8795-ef89a2fb1a68 tempest-VolumeDependencyTests-1281317412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3e387278-7b12-47f2-88b4-2cdeb669bb02.ce465cf6-9c13-42e2-970a-6d91e9ac1e36" returned: 0 in 0.733s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:27:47 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-c9532c7f-eaf9-4b59-8795-ef89a2fb1a68 tempest-VolumeDependencyTests-1281317412 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e387278-7b12-47f2-88b4-2cdeb669bb02(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84448) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 15:27:47 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ce6847-1041-463a-b037-8cd0cdb9adad]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:27:47 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c9532c7f-eaf9-4b59-8795-ef89a2fb1a68 tempest-VolumeDependencyTests-1281317412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3e387278-7b12-47f2-88b4-2cdeb669bb02 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:27:48 devstack sudo[106814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3e387278-7b12-47f2-88b4-2cdeb669bb02 Apr 29 15:27:48 devstack sudo[106814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:27:48 devstack sudo[106814]: pam_unix(sudo:session): session closed for user root Apr 29 15:27:48 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c9532c7f-eaf9-4b59-8795-ef89a2fb1a68 tempest-VolumeDependencyTests-1281317412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3e387278-7b12-47f2-88b4-2cdeb669bb02" returned: 0 in 0.747s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:27:48 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c9532c7f-eaf9-4b59-8795-ef89a2fb1a68 tempest-VolumeDependencyTests-1281317412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3e387278-7b12-47f2-88b4-2cdeb669bb02.ce465cf6-9c13-42e2-970a-6d91e9ac1e36 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:27:48 devstack sudo[106819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3e387278-7b12-47f2-88b4-2cdeb669bb02.ce465cf6-9c13-42e2-970a-6d91e9ac1e36 Apr 29 15:27:48 devstack sudo[106819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:27:49 devstack sudo[106819]: pam_unix(sudo:session): session closed for user root Apr 29 15:27:49 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c9532c7f-eaf9-4b59-8795-ef89a2fb1a68 tempest-VolumeDependencyTests-1281317412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3e387278-7b12-47f2-88b4-2cdeb669bb02.ce465cf6-9c13-42e2-970a-6d91e9ac1e36" returned: 0 in 0.695s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:27:49 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c9532c7f-eaf9-4b59-8795-ef89a2fb1a68 tempest-VolumeDependencyTests-1281317412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3e387278-7b12-47f2-88b4-2cdeb669bb02.ce465cf6-9c13-42e2-970a-6d91e9ac1e36 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:27:49 devstack sudo[106824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3e387278-7b12-47f2-88b4-2cdeb669bb02.ce465cf6-9c13-42e2-970a-6d91e9ac1e36 Apr 29 15:27:49 devstack sudo[106824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:27:50 devstack sudo[106824]: pam_unix(sudo:session): session closed for user root Apr 29 15:27:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c9532c7f-eaf9-4b59-8795-ef89a2fb1a68 tempest-VolumeDependencyTests-1281317412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3e387278-7b12-47f2-88b4-2cdeb669bb02.ce465cf6-9c13-42e2-970a-6d91e9ac1e36" returned: 0 in 0.618s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:27:50 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-c9532c7f-eaf9-4b59-8795-ef89a2fb1a68 tempest-VolumeDependencyTests-1281317412 None] Lock "cinder-quobyte-ce465cf6-9c13-42e2-970a-6d91e9ac1e36" released by "_delete_snapshot" :: held 2.901s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:27:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-c9532c7f-eaf9-4b59-8795-ef89a2fb1a68 tempest-VolumeDependencyTests-1281317412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.748s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:27:50 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c9532c7f-eaf9-4b59-8795-ef89a2fb1a68 tempest-VolumeDependencyTests-1281317412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc6a0e16-e130-4213-af51-6eedce8db1b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61798196-b348-4dd9-ad3c-bb77e19497b0', 'volume_size': 1, 'source_volid': '3e387278-7b12-47f2-88b4-2cdeb669bb02', 'source_volstatus': 'available'}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:27:50 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c9532c7f-eaf9-4b59-8795-ef89a2fb1a68 tempest-VolumeDependencyTests-1281317412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea045dd3-ee1c-4807-9e30-aa0585ef495f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:27:50 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-c9532c7f-eaf9-4b59-8795-ef89a2fb1a68 tempest-VolumeDependencyTests-1281317412 None] Volume volume-61798196-b348-4dd9-ad3c-bb77e19497b0 (61798196-b348-4dd9-ad3c-bb77e19497b0): created successfully Apr 29 15:27:50 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c9532c7f-eaf9-4b59-8795-ef89a2fb1a68 tempest-VolumeDependencyTests-1281317412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea045dd3-ee1c-4807-9e30-aa0585ef495f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:27:50 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c9532c7f-eaf9-4b59-8795-ef89a2fb1a68 tempest-VolumeDependencyTests-1281317412 None] Flow 'volume_create_manager' (dd4bc581-8ccb-45a2-bc07-dbc88f65d43f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:27:50 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-c9532c7f-eaf9-4b59-8795-ef89a2fb1a68 tempest-VolumeDependencyTests-1281317412 None] Created volume successfully. Apr 29 15:27:51 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-2f37e618-386d-460e-a117-f7ae75c538cf tempest-VolumeDependencyTests-1281317412 None] Acquiring lock "cinder-3e387278-7b12-47f2-88b4-2cdeb669bb02-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:27:51 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-2f37e618-386d-460e-a117-f7ae75c538cf tempest-VolumeDependencyTests-1281317412 None] Lock "cinder-3e387278-7b12-47f2-88b4-2cdeb669bb02-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:27:51 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-2f37e618-386d-460e-a117-f7ae75c538cf tempest-VolumeDependencyTests-1281317412 None] Acquiring lock "cinder-quobyte-3e387278-7b12-47f2-88b4-2cdeb669bb02" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:27:51 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-2f37e618-386d-460e-a117-f7ae75c538cf tempest-VolumeDependencyTests-1281317412 None] Lock "cinder-quobyte-3e387278-7b12-47f2-88b4-2cdeb669bb02" acquired by "delete_volume" :: waited 0.023s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:27:51 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca53c3a5-1fcb-49c9-a584-852cfb4d1baa]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:27:51 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-2f37e618-386d-460e-a117-f7ae75c538cf tempest-VolumeDependencyTests-1281317412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3e387278-7b12-47f2-88b4-2cdeb669bb02 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:27:51 devstack sudo[106827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3e387278-7b12-47f2-88b4-2cdeb669bb02 Apr 29 15:27:51 devstack sudo[106827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:27:51 devstack sudo[106827]: pam_unix(sudo:session): session closed for user root Apr 29 15:27:51 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-2f37e618-386d-460e-a117-f7ae75c538cf tempest-VolumeDependencyTests-1281317412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3e387278-7b12-47f2-88b4-2cdeb669bb02" returned: 0 in 0.725s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:27:51 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-2f37e618-386d-460e-a117-f7ae75c538cf tempest-VolumeDependencyTests-1281317412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3e387278-7b12-47f2-88b4-2cdeb669bb02 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:27:51 devstack sudo[106832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3e387278-7b12-47f2-88b4-2cdeb669bb02 Apr 29 15:27:51 devstack sudo[106832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:27:52 devstack sudo[106832]: pam_unix(sudo:session): session closed for user root Apr 29 15:27:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-2f37e618-386d-460e-a117-f7ae75c538cf tempest-VolumeDependencyTests-1281317412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3e387278-7b12-47f2-88b4-2cdeb669bb02" returned: 0 in 0.636s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:27:52 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-2f37e618-386d-460e-a117-f7ae75c538cf tempest-VolumeDependencyTests-1281317412 None] Lock "cinder-quobyte-3e387278-7b12-47f2-88b4-2cdeb669bb02" released by "delete_volume" :: held 1.420s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:27:52 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-2f37e618-386d-460e-a117-f7ae75c538cf tempest-VolumeDependencyTests-1281317412 None] Created reservations ['3d28751f-842a-4885-a716-01d31eea548d', 'b78c9877-262a-42fd-bc8f-838c1348df08', 'ddee8573-41bd-42da-b765-d9afd73bba51', '3fd7b73c-1468-4232-a25e-4f873ac44e70'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:27:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-2f37e618-386d-460e-a117-f7ae75c538cf tempest-VolumeDependencyTests-1281317412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:27:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-2f37e618-386d-460e-a117-f7ae75c538cf tempest-VolumeDependencyTests-1281317412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:27:52 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-2f37e618-386d-460e-a117-f7ae75c538cf tempest-VolumeDependencyTests-1281317412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:27:52 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-2f37e618-386d-460e-a117-f7ae75c538cf tempest-VolumeDependencyTests-1281317412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:27:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-2f37e618-386d-460e-a117-f7ae75c538cf tempest-VolumeDependencyTests-1281317412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:27:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-2f37e618-386d-460e-a117-f7ae75c538cf tempest-VolumeDependencyTests-1281317412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:27:52 devstack sudo[106835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:27:52 devstack sudo[106835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:27:53 devstack sudo[106835]: pam_unix(sudo:session): session closed for user root Apr 29 15:27:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-2f37e618-386d-460e-a117-f7ae75c538cf tempest-VolumeDependencyTests-1281317412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.608s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:27:53 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-2f37e618-386d-460e-a117-f7ae75c538cf tempest-VolumeDependencyTests-1281317412 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:27:53 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-2f37e618-386d-460e-a117-f7ae75c538cf tempest-VolumeDependencyTests-1281317412 None] Deleted volume successfully. Apr 29 15:27:53 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-2f37e618-386d-460e-a117-f7ae75c538cf tempest-VolumeDependencyTests-1281317412 None] Lock "cinder-3e387278-7b12-47f2-88b4-2cdeb669bb02-delete_volume" released by "delete_volume" :: held 2.244s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:27:53 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-c48fdd4d-a5eb-40ea-98d4-331b01650e53 tempest-VolumeDependencyTests-1281317412 None] Acquiring lock "cinder-61798196-b348-4dd9-ad3c-bb77e19497b0-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:27:53 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-c48fdd4d-a5eb-40ea-98d4-331b01650e53 tempest-VolumeDependencyTests-1281317412 None] Lock "cinder-61798196-b348-4dd9-ad3c-bb77e19497b0-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:27:53 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-c48fdd4d-a5eb-40ea-98d4-331b01650e53 tempest-VolumeDependencyTests-1281317412 None] Acquiring lock "cinder-quobyte-61798196-b348-4dd9-ad3c-bb77e19497b0" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:27:53 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-c48fdd4d-a5eb-40ea-98d4-331b01650e53 tempest-VolumeDependencyTests-1281317412 None] Lock "cinder-quobyte-61798196-b348-4dd9-ad3c-bb77e19497b0" acquired by "delete_volume" :: waited 0.023s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:27:53 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[da7f6496-3f34-4f7a-8a17-f49f1a9cf028]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:27:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c48fdd4d-a5eb-40ea-98d4-331b01650e53 tempest-VolumeDependencyTests-1281317412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-61798196-b348-4dd9-ad3c-bb77e19497b0 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:27:53 devstack sudo[106838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-61798196-b348-4dd9-ad3c-bb77e19497b0 Apr 29 15:27:53 devstack sudo[106838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:27:54 devstack sudo[106838]: pam_unix(sudo:session): session closed for user root Apr 29 15:27:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c48fdd4d-a5eb-40ea-98d4-331b01650e53 tempest-VolumeDependencyTests-1281317412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-61798196-b348-4dd9-ad3c-bb77e19497b0" returned: 0 in 0.745s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:27:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c48fdd4d-a5eb-40ea-98d4-331b01650e53 tempest-VolumeDependencyTests-1281317412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-61798196-b348-4dd9-ad3c-bb77e19497b0 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:27:54 devstack sudo[106869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-61798196-b348-4dd9-ad3c-bb77e19497b0 Apr 29 15:27:54 devstack sudo[106869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:27:54 devstack sudo[106869]: pam_unix(sudo:session): session closed for user root Apr 29 15:27:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c48fdd4d-a5eb-40ea-98d4-331b01650e53 tempest-VolumeDependencyTests-1281317412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-61798196-b348-4dd9-ad3c-bb77e19497b0" returned: 0 in 0.610s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:27:55 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-c48fdd4d-a5eb-40ea-98d4-331b01650e53 tempest-VolumeDependencyTests-1281317412 None] Lock "cinder-quobyte-61798196-b348-4dd9-ad3c-bb77e19497b0" released by "delete_volume" :: held 1.394s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:27:55 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-c48fdd4d-a5eb-40ea-98d4-331b01650e53 tempest-VolumeDependencyTests-1281317412 None] Created reservations ['298ed6c0-bc13-4755-beb8-8a997068df44', 'c22bb1d0-87bf-405f-9047-24bb0e4f4d49', '1c28e050-35b1-407a-a704-cf213b8662bc', 'bbbbda45-a8af-4c6c-ae61-dc6c4d064e7a'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:27:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-c48fdd4d-a5eb-40ea-98d4-331b01650e53 tempest-VolumeDependencyTests-1281317412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:27:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-c48fdd4d-a5eb-40ea-98d4-331b01650e53 tempest-VolumeDependencyTests-1281317412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:27:55 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-c48fdd4d-a5eb-40ea-98d4-331b01650e53 tempest-VolumeDependencyTests-1281317412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:27:55 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-c48fdd4d-a5eb-40ea-98d4-331b01650e53 tempest-VolumeDependencyTests-1281317412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:27:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-c48fdd4d-a5eb-40ea-98d4-331b01650e53 tempest-VolumeDependencyTests-1281317412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:27:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c48fdd4d-a5eb-40ea-98d4-331b01650e53 tempest-VolumeDependencyTests-1281317412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:27:55 devstack sudo[106872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:27:55 devstack sudo[106872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:27:55 devstack sudo[106872]: pam_unix(sudo:session): session closed for user root Apr 29 15:27:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c48fdd4d-a5eb-40ea-98d4-331b01650e53 tempest-VolumeDependencyTests-1281317412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.594s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:27:55 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-c48fdd4d-a5eb-40ea-98d4-331b01650e53 tempest-VolumeDependencyTests-1281317412 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:27:55 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-c48fdd4d-a5eb-40ea-98d4-331b01650e53 tempest-VolumeDependencyTests-1281317412 None] Deleted volume successfully. Apr 29 15:27:55 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-c48fdd4d-a5eb-40ea-98d4-331b01650e53 tempest-VolumeDependencyTests-1281317412 None] Lock "cinder-61798196-b348-4dd9-ad3c-bb77e19497b0-delete_volume" released by "delete_volume" :: held 2.187s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:27:55 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-2384225d-0622-4d36-8b13-621fc763a1b7 tempest-VolumeDependencyTests-1281317412 None] Acquiring lock "cinder-3a286014-cee9-4a23-9279-23d2e2a076b1-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:27:55 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-2384225d-0622-4d36-8b13-621fc763a1b7 tempest-VolumeDependencyTests-1281317412 None] Lock "cinder-3a286014-cee9-4a23-9279-23d2e2a076b1-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:27:55 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-2384225d-0622-4d36-8b13-621fc763a1b7 tempest-VolumeDependencyTests-1281317412 None] Acquiring lock "cinder-quobyte-3a286014-cee9-4a23-9279-23d2e2a076b1" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:27:55 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-2384225d-0622-4d36-8b13-621fc763a1b7 tempest-VolumeDependencyTests-1281317412 None] Lock "cinder-quobyte-3a286014-cee9-4a23-9279-23d2e2a076b1" acquired by "delete_volume" :: waited 0.014s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:27:55 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[423b6e63-b89f-4af2-aa73-f5139e1c059c]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:27:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-2384225d-0622-4d36-8b13-621fc763a1b7 tempest-VolumeDependencyTests-1281317412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3a286014-cee9-4a23-9279-23d2e2a076b1 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:27:56 devstack sudo[106876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3a286014-cee9-4a23-9279-23d2e2a076b1 Apr 29 15:27:56 devstack sudo[106876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:27:56 devstack sudo[106876]: pam_unix(sudo:session): session closed for user root Apr 29 15:27:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-2384225d-0622-4d36-8b13-621fc763a1b7 tempest-VolumeDependencyTests-1281317412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3a286014-cee9-4a23-9279-23d2e2a076b1" returned: 0 in 0.702s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:27:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-2384225d-0622-4d36-8b13-621fc763a1b7 tempest-VolumeDependencyTests-1281317412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3a286014-cee9-4a23-9279-23d2e2a076b1 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:27:56 devstack sudo[106881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3a286014-cee9-4a23-9279-23d2e2a076b1 Apr 29 15:27:56 devstack sudo[106881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:27:57 devstack sudo[106881]: pam_unix(sudo:session): session closed for user root Apr 29 15:27:57 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-2384225d-0622-4d36-8b13-621fc763a1b7 tempest-VolumeDependencyTests-1281317412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3a286014-cee9-4a23-9279-23d2e2a076b1" returned: 0 in 0.595s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:27:57 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-2384225d-0622-4d36-8b13-621fc763a1b7 tempest-VolumeDependencyTests-1281317412 None] Lock "cinder-quobyte-3a286014-cee9-4a23-9279-23d2e2a076b1" released by "delete_volume" :: held 1.335s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:27:57 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-2384225d-0622-4d36-8b13-621fc763a1b7 tempest-VolumeDependencyTests-1281317412 None] Created reservations ['0f1cb77a-466e-4e61-9858-7c26d50f8965', 'ceb6dcd1-8c31-4e47-8b48-0ee5e7c64855', '4f8fed2a-98ad-4e61-a305-526ff5c446a3', 'd44caf1e-bc7a-4023-a114-4d93d215fc39'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:27:57 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-2384225d-0622-4d36-8b13-621fc763a1b7 tempest-VolumeDependencyTests-1281317412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:27:57 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-2384225d-0622-4d36-8b13-621fc763a1b7 tempest-VolumeDependencyTests-1281317412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:27:57 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-2384225d-0622-4d36-8b13-621fc763a1b7 tempest-VolumeDependencyTests-1281317412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:27:57 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-2384225d-0622-4d36-8b13-621fc763a1b7 tempest-VolumeDependencyTests-1281317412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:27:57 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-2384225d-0622-4d36-8b13-621fc763a1b7 tempest-VolumeDependencyTests-1281317412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:27:57 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-2384225d-0622-4d36-8b13-621fc763a1b7 tempest-VolumeDependencyTests-1281317412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:27:57 devstack sudo[106884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:27:57 devstack sudo[106884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:27:57 devstack sudo[106884]: pam_unix(sudo:session): session closed for user root Apr 29 15:27:57 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-2384225d-0622-4d36-8b13-621fc763a1b7 tempest-VolumeDependencyTests-1281317412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.593s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:27:57 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-2384225d-0622-4d36-8b13-621fc763a1b7 tempest-VolumeDependencyTests-1281317412 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:27:57 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-2384225d-0622-4d36-8b13-621fc763a1b7 tempest-VolumeDependencyTests-1281317412 None] Deleted volume successfully. Apr 29 15:27:57 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-2384225d-0622-4d36-8b13-621fc763a1b7 tempest-VolumeDependencyTests-1281317412 None] Lock "cinder-3a286014-cee9-4a23-9279-23d2e2a076b1-delete_volume" released by "delete_volume" :: held 2.120s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:28:00 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-06a46989-df5e-4525-82c4-c283b5cf0f78 tempest-CinderUnicodeTest-1365691319 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:28:00 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-06a46989-df5e-4525-82c4-c283b5cf0f78 tempest-CinderUnicodeTest-1365691319 None] Flow 'volume_create_manager' (49ab9668-ee31-42f5-bfbf-f51cf4255e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:28:00 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-06a46989-df5e-4525-82c4-c283b5cf0f78 tempest-CinderUnicodeTest-1365691319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c16186a0-334a-49bb-9422-062a2752e575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:28:00 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-06a46989-df5e-4525-82c4-c283b5cf0f78 tempest-CinderUnicodeTest-1365691319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c16186a0-334a-49bb-9422-062a2752e575) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:28:00Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f81d9e47-69b8-429e-bb46-0e3097a57612,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2cd55a0eb384af48519db38b28d8e39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:28:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:28:01Z,use_quota=True,user_id='867a1d7fb5bb466ea549dfa9df5ec467',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:28:00 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-06a46989-df5e-4525-82c4-c283b5cf0f78 tempest-CinderUnicodeTest-1365691319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db940813-0a6b-43e1-a849-c3da4075d756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:28:00 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-06a46989-df5e-4525-82c4-c283b5cf0f78 tempest-CinderUnicodeTest-1365691319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db940813-0a6b-43e1-a849-c3da4075d756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:28:00 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-06a46989-df5e-4525-82c4-c283b5cf0f78 tempest-CinderUnicodeTest-1365691319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4a06237-0fb2-4f2d-a767-74a4c8da38ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:28:00 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-06a46989-df5e-4525-82c4-c283b5cf0f78 tempest-CinderUnicodeTest-1365691319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4a06237-0fb2-4f2d-a767-74a4c8da38ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f81d9e47-69b8-429e-bb46-0e3097a57612', 'volume_name': 'volume-f81d9e47-69b8-429e-bb46-0e3097a57612', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:28:00 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-06a46989-df5e-4525-82c4-c283b5cf0f78 tempest-CinderUnicodeTest-1365691319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1474b853-f931-42a9-a70d-0684f172ab8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:28:00 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-06a46989-df5e-4525-82c4-c283b5cf0f78 tempest-CinderUnicodeTest-1365691319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1474b853-f931-42a9-a70d-0684f172ab8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:28:00 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-06a46989-df5e-4525-82c4-c283b5cf0f78 tempest-CinderUnicodeTest-1365691319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b489694-b2b7-43b4-a14c-9e37cff293e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:28:00 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-06a46989-df5e-4525-82c4-c283b5cf0f78 tempest-CinderUnicodeTest-1365691319 None] Volume f81d9e47-69b8-429e-bb46-0e3097a57612: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f81d9e47-69b8-429e-bb46-0e3097a57612', 'volume_size': 1} Apr 29 15:28:00 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-06a46989-df5e-4525-82c4-c283b5cf0f78 tempest-CinderUnicodeTest-1365691319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:28:00 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-06a46989-df5e-4525-82c4-c283b5cf0f78 tempest-CinderUnicodeTest-1365691319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:28:00 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-06a46989-df5e-4525-82c4-c283b5cf0f78 tempest-CinderUnicodeTest-1365691319 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:28:00Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f81d9e47-69b8-429e-bb46-0e3097a57612,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2cd55a0eb384af48519db38b28d8e39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:28:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:28:01Z,use_quota=True,user_id='867a1d7fb5bb466ea549dfa9df5ec467',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:28:00 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-06a46989-df5e-4525-82c4-c283b5cf0f78 tempest-CinderUnicodeTest-1365691319 None] Creating volume f81d9e47-69b8-429e-bb46-0e3097a57612 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:28:00 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-06a46989-df5e-4525-82c4-c283b5cf0f78 tempest-CinderUnicodeTest-1365691319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:28:00 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-06a46989-df5e-4525-82c4-c283b5cf0f78 tempest-CinderUnicodeTest-1365691319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:28:00 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-06a46989-df5e-4525-82c4-c283b5cf0f78 tempest-CinderUnicodeTest-1365691319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:28:00 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-06a46989-df5e-4525-82c4-c283b5cf0f78 tempest-CinderUnicodeTest-1365691319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:28:00 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-06a46989-df5e-4525-82c4-c283b5cf0f78 tempest-CinderUnicodeTest-1365691319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:28:00 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-06a46989-df5e-4525-82c4-c283b5cf0f78 tempest-CinderUnicodeTest-1365691319 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:28:00 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-06a46989-df5e-4525-82c4-c283b5cf0f78 tempest-CinderUnicodeTest-1365691319 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:28:00 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-06a46989-df5e-4525-82c4-c283b5cf0f78 tempest-CinderUnicodeTest-1365691319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f81d9e47-69b8-429e-bb46-0e3097a57612 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:28:00 devstack sudo[106887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f81d9e47-69b8-429e-bb46-0e3097a57612 1073741824 Apr 29 15:28:00 devstack sudo[106887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:28:01 devstack sudo[106887]: pam_unix(sudo:session): session closed for user root Apr 29 15:28:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-06a46989-df5e-4525-82c4-c283b5cf0f78 tempest-CinderUnicodeTest-1365691319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f81d9e47-69b8-429e-bb46-0e3097a57612 1073741824" returned: 0 in 0.809s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:28:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-06a46989-df5e-4525-82c4-c283b5cf0f78 tempest-CinderUnicodeTest-1365691319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f81d9e47-69b8-429e-bb46-0e3097a57612 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:28:01 devstack sudo[106893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f81d9e47-69b8-429e-bb46-0e3097a57612 Apr 29 15:28:01 devstack sudo[106893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:28:02 devstack sudo[106893]: pam_unix(sudo:session): session closed for user root Apr 29 15:28:02 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-06a46989-df5e-4525-82c4-c283b5cf0f78 tempest-CinderUnicodeTest-1365691319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f81d9e47-69b8-429e-bb46-0e3097a57612" returned: 0 in 0.630s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:28:02 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-06a46989-df5e-4525-82c4-c283b5cf0f78 tempest-CinderUnicodeTest-1365691319 None] <== create_volume: return (1485ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:28:02 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-06a46989-df5e-4525-82c4-c283b5cf0f78 tempest-CinderUnicodeTest-1365691319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.489s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:28:02 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-06a46989-df5e-4525-82c4-c283b5cf0f78 tempest-CinderUnicodeTest-1365691319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b489694-b2b7-43b4-a14c-9e37cff293e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f81d9e47-69b8-429e-bb46-0e3097a57612', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:28:02 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-06a46989-df5e-4525-82c4-c283b5cf0f78 tempest-CinderUnicodeTest-1365691319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54f415d7-e44d-4fbd-98a8-267cc87150f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:28:02 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-06a46989-df5e-4525-82c4-c283b5cf0f78 tempest-CinderUnicodeTest-1365691319 None] Volume volume-f81d9e47-69b8-429e-bb46-0e3097a57612 (f81d9e47-69b8-429e-bb46-0e3097a57612): created successfully Apr 29 15:28:02 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-06a46989-df5e-4525-82c4-c283b5cf0f78 tempest-CinderUnicodeTest-1365691319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54f415d7-e44d-4fbd-98a8-267cc87150f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:28:02 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-06a46989-df5e-4525-82c4-c283b5cf0f78 tempest-CinderUnicodeTest-1365691319 None] Flow 'volume_create_manager' (49ab9668-ee31-42f5-bfbf-f51cf4255e6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:28:02 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-06a46989-df5e-4525-82c4-c283b5cf0f78 tempest-CinderUnicodeTest-1365691319 None] Created volume successfully. Apr 29 15:28:03 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0cd1ccc-3575-4931-bad8-742f36430c33 tempest-CinderUnicodeTest-1365691319 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:28:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b0cd1ccc-3575-4931-bad8-742f36430c33 tempest-CinderUnicodeTest-1365691319 None] Flow 'volume_create_manager' (06ca3bcd-080b-4970-9c6d-23a7dd63113f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:28:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b0cd1ccc-3575-4931-bad8-742f36430c33 tempest-CinderUnicodeTest-1365691319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bed7b8c8-587d-44cf-8582-edc27d35fcb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:28:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b0cd1ccc-3575-4931-bad8-742f36430c33 tempest-CinderUnicodeTest-1365691319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bed7b8c8-587d-44cf-8582-edc27d35fcb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:28:03Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1883350117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=553bc95a-15f9-447a-9ded-7a74b061b9f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2cd55a0eb384af48519db38b28d8e39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:28:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:28:03Z,use_quota=True,user_id='867a1d7fb5bb466ea549dfa9df5ec467',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:28:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b0cd1ccc-3575-4931-bad8-742f36430c33 tempest-CinderUnicodeTest-1365691319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7279809-a476-4988-97e4-3f0229e8530c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:28:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b0cd1ccc-3575-4931-bad8-742f36430c33 tempest-CinderUnicodeTest-1365691319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7279809-a476-4988-97e4-3f0229e8530c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:28:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b0cd1ccc-3575-4931-bad8-742f36430c33 tempest-CinderUnicodeTest-1365691319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a42c5a87-9237-4d35-81d0-d4ab4ac30b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:28:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b0cd1ccc-3575-4931-bad8-742f36430c33 tempest-CinderUnicodeTest-1365691319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a42c5a87-9237-4d35-81d0-d4ab4ac30b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '553bc95a-15f9-447a-9ded-7a74b061b9f7', 'volume_name': 'volume-553bc95a-15f9-447a-9ded-7a74b061b9f7', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:28:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b0cd1ccc-3575-4931-bad8-742f36430c33 tempest-CinderUnicodeTest-1365691319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d2f89f9-cf9f-4a47-84cc-5e238ad58ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:28:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b0cd1ccc-3575-4931-bad8-742f36430c33 tempest-CinderUnicodeTest-1365691319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d2f89f9-cf9f-4a47-84cc-5e238ad58ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:28:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b0cd1ccc-3575-4931-bad8-742f36430c33 tempest-CinderUnicodeTest-1365691319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e728ad0-32da-466f-875f-4fe12460aaab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:28:03 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-b0cd1ccc-3575-4931-bad8-742f36430c33 tempest-CinderUnicodeTest-1365691319 None] Volume 553bc95a-15f9-447a-9ded-7a74b061b9f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-553bc95a-15f9-447a-9ded-7a74b061b9f7', 'volume_size': 1} Apr 29 15:28:03 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-b0cd1ccc-3575-4931-bad8-742f36430c33 tempest-CinderUnicodeTest-1365691319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:28:03 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-b0cd1ccc-3575-4931-bad8-742f36430c33 tempest-CinderUnicodeTest-1365691319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:28:03 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-b0cd1ccc-3575-4931-bad8-742f36430c33 tempest-CinderUnicodeTest-1365691319 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:28:03Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1883350117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=553bc95a-15f9-447a-9ded-7a74b061b9f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2cd55a0eb384af48519db38b28d8e39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:28:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:28:03Z,use_quota=True,user_id='867a1d7fb5bb466ea549dfa9df5ec467',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:28:03 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-b0cd1ccc-3575-4931-bad8-742f36430c33 tempest-CinderUnicodeTest-1365691319 None] Creating volume 553bc95a-15f9-447a-9ded-7a74b061b9f7 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:28:03 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-b0cd1ccc-3575-4931-bad8-742f36430c33 tempest-CinderUnicodeTest-1365691319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:28:03 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-b0cd1ccc-3575-4931-bad8-742f36430c33 tempest-CinderUnicodeTest-1365691319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:28:03 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-b0cd1ccc-3575-4931-bad8-742f36430c33 tempest-CinderUnicodeTest-1365691319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:28:03 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-b0cd1ccc-3575-4931-bad8-742f36430c33 tempest-CinderUnicodeTest-1365691319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:28:03 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-b0cd1ccc-3575-4931-bad8-742f36430c33 tempest-CinderUnicodeTest-1365691319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:28:03 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-b0cd1ccc-3575-4931-bad8-742f36430c33 tempest-CinderUnicodeTest-1365691319 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:28:03 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-b0cd1ccc-3575-4931-bad8-742f36430c33 tempest-CinderUnicodeTest-1365691319 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:28:03 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-b0cd1ccc-3575-4931-bad8-742f36430c33 tempest-CinderUnicodeTest-1365691319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-553bc95a-15f9-447a-9ded-7a74b061b9f7 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:28:03 devstack sudo[106896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-553bc95a-15f9-447a-9ded-7a74b061b9f7 1073741824 Apr 29 15:28:03 devstack sudo[106896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:28:04 devstack sudo[106896]: pam_unix(sudo:session): session closed for user root Apr 29 15:28:04 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-b0cd1ccc-3575-4931-bad8-742f36430c33 tempest-CinderUnicodeTest-1365691319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-553bc95a-15f9-447a-9ded-7a74b061b9f7 1073741824" returned: 0 in 0.759s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:28:04 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-b0cd1ccc-3575-4931-bad8-742f36430c33 tempest-CinderUnicodeTest-1365691319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-553bc95a-15f9-447a-9ded-7a74b061b9f7 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:28:04 devstack sudo[106901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-553bc95a-15f9-447a-9ded-7a74b061b9f7 Apr 29 15:28:04 devstack sudo[106901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:28:04 devstack sudo[106901]: pam_unix(sudo:session): session closed for user root Apr 29 15:28:04 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-b0cd1ccc-3575-4931-bad8-742f36430c33 tempest-CinderUnicodeTest-1365691319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-553bc95a-15f9-447a-9ded-7a74b061b9f7" returned: 0 in 0.598s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:28:04 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-b0cd1ccc-3575-4931-bad8-742f36430c33 tempest-CinderUnicodeTest-1365691319 None] <== create_volume: return (1396ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:28:04 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-b0cd1ccc-3575-4931-bad8-742f36430c33 tempest-CinderUnicodeTest-1365691319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.399s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:28:04 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b0cd1ccc-3575-4931-bad8-742f36430c33 tempest-CinderUnicodeTest-1365691319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e728ad0-32da-466f-875f-4fe12460aaab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-553bc95a-15f9-447a-9ded-7a74b061b9f7', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:28:04 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b0cd1ccc-3575-4931-bad8-742f36430c33 tempest-CinderUnicodeTest-1365691319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12a95887-2b02-4d58-8c35-4de4ea0a0f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:28:04 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-b0cd1ccc-3575-4931-bad8-742f36430c33 tempest-CinderUnicodeTest-1365691319 None] Volume volume-553bc95a-15f9-447a-9ded-7a74b061b9f7 (553bc95a-15f9-447a-9ded-7a74b061b9f7): created successfully Apr 29 15:28:04 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b0cd1ccc-3575-4931-bad8-742f36430c33 tempest-CinderUnicodeTest-1365691319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12a95887-2b02-4d58-8c35-4de4ea0a0f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:28:04 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b0cd1ccc-3575-4931-bad8-742f36430c33 tempest-CinderUnicodeTest-1365691319 None] Flow 'volume_create_manager' (06ca3bcd-080b-4970-9c6d-23a7dd63113f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:28:04 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-b0cd1ccc-3575-4931-bad8-742f36430c33 tempest-CinderUnicodeTest-1365691319 None] Created volume successfully. Apr 29 15:28:05 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-a1a4bb5d-a48b-4ef4-9f07-e0c9d4cda536 tempest-CinderUnicodeTest-1365691319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:28:05 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-a1a4bb5d-a48b-4ef4-9f07-e0c9d4cda536 tempest-CinderUnicodeTest-1365691319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:28:05 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-a1a4bb5d-a48b-4ef4-9f07-e0c9d4cda536 tempest-CinderUnicodeTest-1365691319 None] Creating offline snapshot e6e55d03-91e2-4be6-a82b-4af71f468231 of volume 553bc95a-15f9-447a-9ded-7a74b061b9f7 {{(pid=84448) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 15:28:05 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b3f75d-b042-430c-8878-8291474858de]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:28:05 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a1a4bb5d-a48b-4ef4-9f07-e0c9d4cda536 tempest-CinderUnicodeTest-1365691319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-553bc95a-15f9-447a-9ded-7a74b061b9f7 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:28:05 devstack sudo[106904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-553bc95a-15f9-447a-9ded-7a74b061b9f7 Apr 29 15:28:05 devstack sudo[106904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:28:06 devstack sudo[106904]: pam_unix(sudo:session): session closed for user root Apr 29 15:28:06 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a1a4bb5d-a48b-4ef4-9f07-e0c9d4cda536 tempest-CinderUnicodeTest-1365691319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-553bc95a-15f9-447a-9ded-7a74b061b9f7" returned: 0 in 0.732s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:28:06 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a1a4bb5d-a48b-4ef4-9f07-e0c9d4cda536 tempest-CinderUnicodeTest-1365691319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-553bc95a-15f9-447a-9ded-7a74b061b9f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-553bc95a-15f9-447a-9ded-7a74b061b9f7.e6e55d03-91e2-4be6-a82b-4af71f468231 1G {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:28:06 devstack sudo[106912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-553bc95a-15f9-447a-9ded-7a74b061b9f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-553bc95a-15f9-447a-9ded-7a74b061b9f7.e6e55d03-91e2-4be6-a82b-4af71f468231 1G Apr 29 15:28:06 devstack sudo[106912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:28:06 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9c8728f-0bdf-4500-9fde-72ab53561905 tempest-TestServerVolumeAttachScenarioOldVersion-136038078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:28:06 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-f9c8728f-0bdf-4500-9fde-72ab53561905 tempest-TestServerVolumeAttachScenarioOldVersion-136038078 None] Flow 'volume_create_manager' (fa0e6b56-b587-437c-9ff1-63ebb5a0d752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:28:06 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-f9c8728f-0bdf-4500-9fde-72ab53561905 tempest-TestServerVolumeAttachScenarioOldVersion-136038078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b611a386-50df-4a6d-8af7-2f99871c77fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:28:06 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-f9c8728f-0bdf-4500-9fde-72ab53561905 tempest-TestServerVolumeAttachScenarioOldVersion-136038078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b611a386-50df-4a6d-8af7-2f99871c77fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:28:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-869187383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcba171f-4bb7-40de-a989-9f2c3c5ae1e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f6057c5ca6743fd938a149999449700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:28:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:28:07Z,use_quota=True,user_id='de7b09ca03214420812f9ceb28d31ae0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:28:06 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-f9c8728f-0bdf-4500-9fde-72ab53561905 tempest-TestServerVolumeAttachScenarioOldVersion-136038078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49867fe6-caee-4936-9917-f1ef09b29775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:28:07 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-f9c8728f-0bdf-4500-9fde-72ab53561905 tempest-TestServerVolumeAttachScenarioOldVersion-136038078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49867fe6-caee-4936-9917-f1ef09b29775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:28:07 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-f9c8728f-0bdf-4500-9fde-72ab53561905 tempest-TestServerVolumeAttachScenarioOldVersion-136038078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7150da05-72bf-4770-88e4-e8da1c2ef4fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:28:07 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-f9c8728f-0bdf-4500-9fde-72ab53561905 tempest-TestServerVolumeAttachScenarioOldVersion-136038078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7150da05-72bf-4770-88e4-e8da1c2ef4fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fcba171f-4bb7-40de-a989-9f2c3c5ae1e1', 'volume_name': 'volume-fcba171f-4bb7-40de-a989-9f2c3c5ae1e1', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:28:07 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-f9c8728f-0bdf-4500-9fde-72ab53561905 tempest-TestServerVolumeAttachScenarioOldVersion-136038078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (034e8d73-b325-4820-abf4-5dc258712be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:28:07 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-f9c8728f-0bdf-4500-9fde-72ab53561905 tempest-TestServerVolumeAttachScenarioOldVersion-136038078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (034e8d73-b325-4820-abf4-5dc258712be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:28:07 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-f9c8728f-0bdf-4500-9fde-72ab53561905 tempest-TestServerVolumeAttachScenarioOldVersion-136038078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e404df7-f518-458f-837a-c993b4a5bd7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:28:07 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-f9c8728f-0bdf-4500-9fde-72ab53561905 tempest-TestServerVolumeAttachScenarioOldVersion-136038078 None] Volume fcba171f-4bb7-40de-a989-9f2c3c5ae1e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fcba171f-4bb7-40de-a989-9f2c3c5ae1e1', 'volume_size': 1} Apr 29 15:28:07 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-f9c8728f-0bdf-4500-9fde-72ab53561905 tempest-TestServerVolumeAttachScenarioOldVersion-136038078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:28:07 devstack sudo[106912]: pam_unix(sudo:session): session closed for user root Apr 29 15:28:07 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a1a4bb5d-a48b-4ef4-9f07-e0c9d4cda536 tempest-CinderUnicodeTest-1365691319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-553bc95a-15f9-447a-9ded-7a74b061b9f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-553bc95a-15f9-447a-9ded-7a74b061b9f7.e6e55d03-91e2-4be6-a82b-4af71f468231 1G" returned: 0 in 0.795s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:28:07 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a1a4bb5d-a48b-4ef4-9f07-e0c9d4cda536 tempest-CinderUnicodeTest-1365691319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-553bc95a-15f9-447a-9ded-7a74b061b9f7 -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-553bc95a-15f9-447a-9ded-7a74b061b9f7.e6e55d03-91e2-4be6-a82b-4af71f468231 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:28:07 devstack sudo[106919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-553bc95a-15f9-447a-9ded-7a74b061b9f7 -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-553bc95a-15f9-447a-9ded-7a74b061b9f7.e6e55d03-91e2-4be6-a82b-4af71f468231 Apr 29 15:28:07 devstack sudo[106919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:28:07 devstack sudo[106919]: pam_unix(sudo:session): session closed for user root Apr 29 15:28:07 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a1a4bb5d-a48b-4ef4-9f07-e0c9d4cda536 tempest-CinderUnicodeTest-1365691319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-553bc95a-15f9-447a-9ded-7a74b061b9f7 -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-553bc95a-15f9-447a-9ded-7a74b061b9f7.e6e55d03-91e2-4be6-a82b-4af71f468231" returned: 0 in 0.645s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:28:07 devstack cinder-volume[84448]: WARNING cinder.volume.drivers.remotefs [None req-a1a4bb5d-a48b-4ef4-9f07-e0c9d4cda536 tempest-CinderUnicodeTest-1365691319 None] /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-553bc95a-15f9-447a-9ded-7a74b061b9f7.e6e55d03-91e2-4be6-a82b-4af71f468231 is being set with open permissions: ugo+rw Apr 29 15:28:07 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a1a4bb5d-a48b-4ef4-9f07-e0c9d4cda536 tempest-CinderUnicodeTest-1365691319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-553bc95a-15f9-447a-9ded-7a74b061b9f7.e6e55d03-91e2-4be6-a82b-4af71f468231 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:28:07 devstack sudo[106924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-553bc95a-15f9-447a-9ded-7a74b061b9f7.e6e55d03-91e2-4be6-a82b-4af71f468231 Apr 29 15:28:07 devstack sudo[106924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:28:08 devstack sudo[106924]: pam_unix(sudo:session): session closed for user root Apr 29 15:28:08 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a1a4bb5d-a48b-4ef4-9f07-e0c9d4cda536 tempest-CinderUnicodeTest-1365691319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-553bc95a-15f9-447a-9ded-7a74b061b9f7.e6e55d03-91e2-4be6-a82b-4af71f468231" returned: 0 in 0.577s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:28:08 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a1a4bb5d-a48b-4ef4-9f07-e0c9d4cda536 tempest-CinderUnicodeTest-1365691319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-553bc95a-15f9-447a-9ded-7a74b061b9f7.info {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:28:08 devstack sudo[106927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-553bc95a-15f9-447a-9ded-7a74b061b9f7.info Apr 29 15:28:08 devstack sudo[106927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:28:08 devstack sudo[106927]: pam_unix(sudo:session): session closed for user root Apr 29 15:28:08 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a1a4bb5d-a48b-4ef4-9f07-e0c9d4cda536 tempest-CinderUnicodeTest-1365691319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-553bc95a-15f9-447a-9ded-7a74b061b9f7.info" returned: 0 in 0.606s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:28:08 devstack cinder-volume[84448]: WARNING cinder.volume.drivers.remotefs [None req-a1a4bb5d-a48b-4ef4-9f07-e0c9d4cda536 tempest-CinderUnicodeTest-1365691319 None] /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-553bc95a-15f9-447a-9ded-7a74b061b9f7.info is being set with open permissions: ugo+rw Apr 29 15:28:08 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a1a4bb5d-a48b-4ef4-9f07-e0c9d4cda536 tempest-CinderUnicodeTest-1365691319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-553bc95a-15f9-447a-9ded-7a74b061b9f7.info {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:28:08 devstack sudo[106930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-553bc95a-15f9-447a-9ded-7a74b061b9f7.info Apr 29 15:28:08 devstack sudo[106930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:28:09 devstack sudo[106930]: pam_unix(sudo:session): session closed for user root Apr 29 15:28:09 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a1a4bb5d-a48b-4ef4-9f07-e0c9d4cda536 tempest-CinderUnicodeTest-1365691319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-553bc95a-15f9-447a-9ded-7a74b061b9f7.info" returned: 0 in 0.598s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:28:09 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-a1a4bb5d-a48b-4ef4-9f07-e0c9d4cda536 tempest-CinderUnicodeTest-1365691319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.035s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:28:09 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-f9c8728f-0bdf-4500-9fde-72ab53561905 tempest-TestServerVolumeAttachScenarioOldVersion-136038078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.520s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:28:09 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-f9c8728f-0bdf-4500-9fde-72ab53561905 tempest-TestServerVolumeAttachScenarioOldVersion-136038078 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:28:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-869187383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcba171f-4bb7-40de-a989-9f2c3c5ae1e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f6057c5ca6743fd938a149999449700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:28:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:28:07Z,use_quota=True,user_id='de7b09ca03214420812f9ceb28d31ae0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:28:09 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-f9c8728f-0bdf-4500-9fde-72ab53561905 tempest-TestServerVolumeAttachScenarioOldVersion-136038078 None] Creating volume fcba171f-4bb7-40de-a989-9f2c3c5ae1e1 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:28:09 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-f9c8728f-0bdf-4500-9fde-72ab53561905 tempest-TestServerVolumeAttachScenarioOldVersion-136038078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:28:09 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-f9c8728f-0bdf-4500-9fde-72ab53561905 tempest-TestServerVolumeAttachScenarioOldVersion-136038078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:28:09 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-f9c8728f-0bdf-4500-9fde-72ab53561905 tempest-TestServerVolumeAttachScenarioOldVersion-136038078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:28:09 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-f9c8728f-0bdf-4500-9fde-72ab53561905 tempest-TestServerVolumeAttachScenarioOldVersion-136038078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:28:09 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-f9c8728f-0bdf-4500-9fde-72ab53561905 tempest-TestServerVolumeAttachScenarioOldVersion-136038078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:28:09 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-f9c8728f-0bdf-4500-9fde-72ab53561905 tempest-TestServerVolumeAttachScenarioOldVersion-136038078 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:28:09 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-f9c8728f-0bdf-4500-9fde-72ab53561905 tempest-TestServerVolumeAttachScenarioOldVersion-136038078 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:28:09 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f9c8728f-0bdf-4500-9fde-72ab53561905 tempest-TestServerVolumeAttachScenarioOldVersion-136038078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-fcba171f-4bb7-40de-a989-9f2c3c5ae1e1 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:28:09 devstack sudo[106933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-fcba171f-4bb7-40de-a989-9f2c3c5ae1e1 1073741824 Apr 29 15:28:09 devstack sudo[106933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:28:09 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-a1a4bb5d-a48b-4ef4-9f07-e0c9d4cda536 tempest-CinderUnicodeTest-1365691319 None] Create snapshot completed successfully Apr 29 15:28:09 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-f99b4ca2-7cf4-49f1-a838-32d8a926ec24 tempest-CinderUnicodeTest-1365691319 None] Acquiring lock "cinder-e6e55d03-91e2-4be6-a82b-4af71f468231-delete_snapshot" by "delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:28:09 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-f99b4ca2-7cf4-49f1-a838-32d8a926ec24 tempest-CinderUnicodeTest-1365691319 None] Lock "cinder-e6e55d03-91e2-4be6-a82b-4af71f468231-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:28:09 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-f99b4ca2-7cf4-49f1-a838-32d8a926ec24 tempest-CinderUnicodeTest-1365691319 None] Acquiring lock "cinder-quobyte-553bc95a-15f9-447a-9ded-7a74b061b9f7" by "delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:28:09 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-f99b4ca2-7cf4-49f1-a838-32d8a926ec24 tempest-CinderUnicodeTest-1365691319 None] Lock "cinder-quobyte-553bc95a-15f9-447a-9ded-7a74b061b9f7" acquired by "delete_snapshot" :: waited 0.022s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:28:09 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-f99b4ca2-7cf4-49f1-a838-32d8a926ec24 tempest-CinderUnicodeTest-1365691319 None] Acquiring lock "cinder-quobyte-e6e55d03-91e2-4be6-a82b-4af71f468231" by "_delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:28:09 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-f99b4ca2-7cf4-49f1-a838-32d8a926ec24 tempest-CinderUnicodeTest-1365691319 None] Lock "cinder-quobyte-e6e55d03-91e2-4be6-a82b-4af71f468231" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:28:09 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-f99b4ca2-7cf4-49f1-a838-32d8a926ec24 tempest-CinderUnicodeTest-1365691319 None] Deleting offline snapshot e6e55d03-91e2-4be6-a82b-4af71f468231 of volume 553bc95a-15f9-447a-9ded-7a74b061b9f7 {{(pid=84448) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 15:28:09 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-f99b4ca2-7cf4-49f1-a838-32d8a926ec24 tempest-CinderUnicodeTest-1365691319 None] snapshot_file for this snap is: volume-553bc95a-15f9-447a-9ded-7a74b061b9f7.e6e55d03-91e2-4be6-a82b-4af71f468231 {{(pid=84448) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 15:28:09 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c00b4a-dbc0-4493-a749-b52b70643ebe]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:28:09 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f99b4ca2-7cf4-49f1-a838-32d8a926ec24 tempest-CinderUnicodeTest-1365691319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-553bc95a-15f9-447a-9ded-7a74b061b9f7.e6e55d03-91e2-4be6-a82b-4af71f468231 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:28:09 devstack sudo[106935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-553bc95a-15f9-447a-9ded-7a74b061b9f7.e6e55d03-91e2-4be6-a82b-4af71f468231 Apr 29 15:28:09 devstack sudo[106935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:28:10 devstack sudo[106933]: pam_unix(sudo:session): session closed for user root Apr 29 15:28:10 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f9c8728f-0bdf-4500-9fde-72ab53561905 tempest-TestServerVolumeAttachScenarioOldVersion-136038078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-fcba171f-4bb7-40de-a989-9f2c3c5ae1e1 1073741824" returned: 0 in 0.822s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:28:10 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f9c8728f-0bdf-4500-9fde-72ab53561905 tempest-TestServerVolumeAttachScenarioOldVersion-136038078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-fcba171f-4bb7-40de-a989-9f2c3c5ae1e1 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:28:10 devstack sudo[106940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-fcba171f-4bb7-40de-a989-9f2c3c5ae1e1 Apr 29 15:28:10 devstack sudo[106940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:28:10 devstack sudo[106935]: pam_unix(sudo:session): session closed for user root Apr 29 15:28:10 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f99b4ca2-7cf4-49f1-a838-32d8a926ec24 tempest-CinderUnicodeTest-1365691319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-553bc95a-15f9-447a-9ded-7a74b061b9f7.e6e55d03-91e2-4be6-a82b-4af71f468231" returned: 0 in 0.790s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:28:10 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-f99b4ca2-7cf4-49f1-a838-32d8a926ec24 tempest-CinderUnicodeTest-1365691319 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-553bc95a-15f9-447a-9ded-7a74b061b9f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84448) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 15:28:10 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f5c150-e0ec-4942-ba91-4d521739dd3c]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:28:10 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f99b4ca2-7cf4-49f1-a838-32d8a926ec24 tempest-CinderUnicodeTest-1365691319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-553bc95a-15f9-447a-9ded-7a74b061b9f7 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:28:10 devstack sudo[106945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-553bc95a-15f9-447a-9ded-7a74b061b9f7 Apr 29 15:28:10 devstack sudo[106945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:28:11 devstack sudo[106940]: pam_unix(sudo:session): session closed for user root Apr 29 15:28:11 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f9c8728f-0bdf-4500-9fde-72ab53561905 tempest-TestServerVolumeAttachScenarioOldVersion-136038078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-fcba171f-4bb7-40de-a989-9f2c3c5ae1e1" returned: 0 in 0.626s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:28:11 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-f9c8728f-0bdf-4500-9fde-72ab53561905 tempest-TestServerVolumeAttachScenarioOldVersion-136038078 None] <== create_volume: return (1488ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:28:11 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-f9c8728f-0bdf-4500-9fde-72ab53561905 tempest-TestServerVolumeAttachScenarioOldVersion-136038078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.491s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:28:11 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-f9c8728f-0bdf-4500-9fde-72ab53561905 tempest-TestServerVolumeAttachScenarioOldVersion-136038078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e404df7-f518-458f-837a-c993b4a5bd7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcba171f-4bb7-40de-a989-9f2c3c5ae1e1', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:28:11 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-f9c8728f-0bdf-4500-9fde-72ab53561905 tempest-TestServerVolumeAttachScenarioOldVersion-136038078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f531f68-f349-4519-b6f3-ca578f4ff44a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:28:11 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-f9c8728f-0bdf-4500-9fde-72ab53561905 tempest-TestServerVolumeAttachScenarioOldVersion-136038078 None] Volume volume-fcba171f-4bb7-40de-a989-9f2c3c5ae1e1 (fcba171f-4bb7-40de-a989-9f2c3c5ae1e1): created successfully Apr 29 15:28:11 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-f9c8728f-0bdf-4500-9fde-72ab53561905 tempest-TestServerVolumeAttachScenarioOldVersion-136038078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f531f68-f349-4519-b6f3-ca578f4ff44a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:28:11 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-f9c8728f-0bdf-4500-9fde-72ab53561905 tempest-TestServerVolumeAttachScenarioOldVersion-136038078 None] Flow 'volume_create_manager' (fa0e6b56-b587-437c-9ff1-63ebb5a0d752) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:28:11 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-f9c8728f-0bdf-4500-9fde-72ab53561905 tempest-TestServerVolumeAttachScenarioOldVersion-136038078 None] Created volume successfully. Apr 29 15:28:11 devstack sudo[106945]: pam_unix(sudo:session): session closed for user root Apr 29 15:28:11 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f99b4ca2-7cf4-49f1-a838-32d8a926ec24 tempest-CinderUnicodeTest-1365691319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-553bc95a-15f9-447a-9ded-7a74b061b9f7" returned: 0 in 0.733s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:28:11 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f99b4ca2-7cf4-49f1-a838-32d8a926ec24 tempest-CinderUnicodeTest-1365691319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-553bc95a-15f9-447a-9ded-7a74b061b9f7.e6e55d03-91e2-4be6-a82b-4af71f468231 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:28:11 devstack sudo[106951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-553bc95a-15f9-447a-9ded-7a74b061b9f7.e6e55d03-91e2-4be6-a82b-4af71f468231 Apr 29 15:28:11 devstack sudo[106951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:28:12 devstack sudo[106951]: pam_unix(sudo:session): session closed for user root Apr 29 15:28:12 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f99b4ca2-7cf4-49f1-a838-32d8a926ec24 tempest-CinderUnicodeTest-1365691319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-553bc95a-15f9-447a-9ded-7a74b061b9f7.e6e55d03-91e2-4be6-a82b-4af71f468231" returned: 0 in 0.662s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:28:12 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f99b4ca2-7cf4-49f1-a838-32d8a926ec24 tempest-CinderUnicodeTest-1365691319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-553bc95a-15f9-447a-9ded-7a74b061b9f7.e6e55d03-91e2-4be6-a82b-4af71f468231 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:28:12 devstack sudo[106956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-553bc95a-15f9-447a-9ded-7a74b061b9f7.e6e55d03-91e2-4be6-a82b-4af71f468231 Apr 29 15:28:12 devstack sudo[106956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:28:12 devstack sudo[106956]: pam_unix(sudo:session): session closed for user root Apr 29 15:28:12 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f99b4ca2-7cf4-49f1-a838-32d8a926ec24 tempest-CinderUnicodeTest-1365691319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-553bc95a-15f9-447a-9ded-7a74b061b9f7.e6e55d03-91e2-4be6-a82b-4af71f468231" returned: 0 in 0.595s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:28:12 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-f99b4ca2-7cf4-49f1-a838-32d8a926ec24 tempest-CinderUnicodeTest-1365691319 None] Lock "cinder-quobyte-e6e55d03-91e2-4be6-a82b-4af71f468231" released by "_delete_snapshot" :: held 2.896s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:28:12 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-f99b4ca2-7cf4-49f1-a838-32d8a926ec24 tempest-CinderUnicodeTest-1365691319 None] Lock "cinder-quobyte-553bc95a-15f9-447a-9ded-7a74b061b9f7" released by "delete_snapshot" :: held 2.921s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:28:12 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-f99b4ca2-7cf4-49f1-a838-32d8a926ec24 tempest-CinderUnicodeTest-1365691319 None] Created reservations ['8d0ca9b7-b68b-4dd9-ac09-fb017111b54f', '9499b28b-8190-4d82-b406-895921883831', 'c13dbff7-ef36-412f-ae44-76a0717dab99', '832d0b8a-b9d6-4d5b-9710-f4b7d4ade51c'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:28:12 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-f99b4ca2-7cf4-49f1-a838-32d8a926ec24 tempest-CinderUnicodeTest-1365691319 None] Delete snapshot completed successfully. Apr 29 15:28:12 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-f99b4ca2-7cf4-49f1-a838-32d8a926ec24 tempest-CinderUnicodeTest-1365691319 None] Lock "cinder-e6e55d03-91e2-4be6-a82b-4af71f468231-delete_snapshot" released by "delete_snapshot" :: held 3.052s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:28:12 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-7e60d3bc-816c-417d-a29e-71cd283730dc tempest-CinderUnicodeTest-1365691319 None] Acquiring lock "cinder-553bc95a-15f9-447a-9ded-7a74b061b9f7-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:28:12 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-7e60d3bc-816c-417d-a29e-71cd283730dc tempest-CinderUnicodeTest-1365691319 None] Lock "cinder-553bc95a-15f9-447a-9ded-7a74b061b9f7-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:28:12 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-7e60d3bc-816c-417d-a29e-71cd283730dc tempest-CinderUnicodeTest-1365691319 None] Acquiring lock "cinder-quobyte-553bc95a-15f9-447a-9ded-7a74b061b9f7" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:28:12 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-7e60d3bc-816c-417d-a29e-71cd283730dc tempest-CinderUnicodeTest-1365691319 None] Lock "cinder-quobyte-553bc95a-15f9-447a-9ded-7a74b061b9f7" acquired by "delete_volume" :: waited 0.022s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:28:13 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[6359b530-6185-4571-8738-c695f648badf]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:28:13 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7e60d3bc-816c-417d-a29e-71cd283730dc tempest-CinderUnicodeTest-1365691319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-553bc95a-15f9-447a-9ded-7a74b061b9f7 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:28:13 devstack sudo[106959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-553bc95a-15f9-447a-9ded-7a74b061b9f7 Apr 29 15:28:13 devstack sudo[106959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:28:13 devstack sudo[106959]: pam_unix(sudo:session): session closed for user root Apr 29 15:28:13 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7e60d3bc-816c-417d-a29e-71cd283730dc tempest-CinderUnicodeTest-1365691319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-553bc95a-15f9-447a-9ded-7a74b061b9f7" returned: 0 in 0.706s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:28:13 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7e60d3bc-816c-417d-a29e-71cd283730dc tempest-CinderUnicodeTest-1365691319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-553bc95a-15f9-447a-9ded-7a74b061b9f7 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:28:13 devstack sudo[106964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-553bc95a-15f9-447a-9ded-7a74b061b9f7 Apr 29 15:28:13 devstack sudo[106964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:28:14 devstack sudo[106964]: pam_unix(sudo:session): session closed for user root Apr 29 15:28:14 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7e60d3bc-816c-417d-a29e-71cd283730dc tempest-CinderUnicodeTest-1365691319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-553bc95a-15f9-447a-9ded-7a74b061b9f7" returned: 0 in 0.591s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:28:14 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-7e60d3bc-816c-417d-a29e-71cd283730dc tempest-CinderUnicodeTest-1365691319 None] Lock "cinder-quobyte-553bc95a-15f9-447a-9ded-7a74b061b9f7" released by "delete_volume" :: held 1.355s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:28:14 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-7e60d3bc-816c-417d-a29e-71cd283730dc tempest-CinderUnicodeTest-1365691319 None] Created reservations ['c8171196-9a6e-4721-a133-f77e70cae4db', '5d709ebf-1252-471b-9923-ded7e9b8df32', '2ccbf9e0-5217-4fcb-8b28-de16c640e74b', 'cef19ce7-9187-4bf4-a829-b2d62bc74fab'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:28:14 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-7e60d3bc-816c-417d-a29e-71cd283730dc tempest-CinderUnicodeTest-1365691319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:28:14 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-7e60d3bc-816c-417d-a29e-71cd283730dc tempest-CinderUnicodeTest-1365691319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:28:14 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-7e60d3bc-816c-417d-a29e-71cd283730dc tempest-CinderUnicodeTest-1365691319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:28:14 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-7e60d3bc-816c-417d-a29e-71cd283730dc tempest-CinderUnicodeTest-1365691319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:28:14 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-7e60d3bc-816c-417d-a29e-71cd283730dc tempest-CinderUnicodeTest-1365691319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:28:14 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7e60d3bc-816c-417d-a29e-71cd283730dc tempest-CinderUnicodeTest-1365691319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:28:14 devstack sudo[106967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:28:14 devstack sudo[106967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:28:15 devstack sudo[106967]: pam_unix(sudo:session): session closed for user root Apr 29 15:28:15 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7e60d3bc-816c-417d-a29e-71cd283730dc tempest-CinderUnicodeTest-1365691319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.593s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:28:15 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-7e60d3bc-816c-417d-a29e-71cd283730dc tempest-CinderUnicodeTest-1365691319 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:28:15 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-7e60d3bc-816c-417d-a29e-71cd283730dc tempest-CinderUnicodeTest-1365691319 None] Deleted volume successfully. Apr 29 15:28:15 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-7e60d3bc-816c-417d-a29e-71cd283730dc tempest-CinderUnicodeTest-1365691319 None] Lock "cinder-553bc95a-15f9-447a-9ded-7a74b061b9f7-delete_volume" released by "delete_volume" :: held 2.169s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:28:15 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-9efbb256-b9ec-4eb2-9fee-7344abbdbca6 tempest-CinderUnicodeTest-1365691319 None] Acquiring lock "cinder-f81d9e47-69b8-429e-bb46-0e3097a57612-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:28:15 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-9efbb256-b9ec-4eb2-9fee-7344abbdbca6 tempest-CinderUnicodeTest-1365691319 None] Lock "cinder-f81d9e47-69b8-429e-bb46-0e3097a57612-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:28:15 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-9efbb256-b9ec-4eb2-9fee-7344abbdbca6 tempest-CinderUnicodeTest-1365691319 None] Acquiring lock "cinder-quobyte-f81d9e47-69b8-429e-bb46-0e3097a57612" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:28:15 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-9efbb256-b9ec-4eb2-9fee-7344abbdbca6 tempest-CinderUnicodeTest-1365691319 None] Lock "cinder-quobyte-f81d9e47-69b8-429e-bb46-0e3097a57612" acquired by "delete_volume" :: waited 0.016s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:28:15 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c98e6c7-9af4-46d3-9c14-b9cdc3dcdd98]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:28:15 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-9efbb256-b9ec-4eb2-9fee-7344abbdbca6 tempest-CinderUnicodeTest-1365691319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f81d9e47-69b8-429e-bb46-0e3097a57612 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:28:15 devstack sudo[106975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f81d9e47-69b8-429e-bb46-0e3097a57612 Apr 29 15:28:15 devstack sudo[106975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:28:15 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-4134ae23-163c-4124-a274-3c5aa581075c req-6fc590cf-1c96-41ec-87d5-d1b1d652158b tempest-TestServerVolumeAttachScenarioOldVersion-136038078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:28:15 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-4134ae23-163c-4124-a274-3c5aa581075c req-6fc590cf-1c96-41ec-87d5-d1b1d652158b tempest-TestServerVolumeAttachScenarioOldVersion-136038078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:28:15 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6c8d683-01c3-45ac-8e04-e3e69368269c]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:28:15 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-4134ae23-163c-4124-a274-3c5aa581075c req-6fc590cf-1c96-41ec-87d5-d1b1d652158b tempest-TestServerVolumeAttachScenarioOldVersion-136038078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-fcba171f-4bb7-40de-a989-9f2c3c5ae1e1 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:28:15 devstack sudo[106980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-fcba171f-4bb7-40de-a989-9f2c3c5ae1e1 Apr 29 15:28:15 devstack sudo[106980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:28:15 devstack sudo[106975]: pam_unix(sudo:session): session closed for user root Apr 29 15:28:15 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-9efbb256-b9ec-4eb2-9fee-7344abbdbca6 tempest-CinderUnicodeTest-1365691319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f81d9e47-69b8-429e-bb46-0e3097a57612" returned: 0 in 0.724s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:28:15 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-9efbb256-b9ec-4eb2-9fee-7344abbdbca6 tempest-CinderUnicodeTest-1365691319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f81d9e47-69b8-429e-bb46-0e3097a57612 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:28:16 devstack sudo[106986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f81d9e47-69b8-429e-bb46-0e3097a57612 Apr 29 15:28:16 devstack sudo[106986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:28:16 devstack sudo[106980]: pam_unix(sudo:session): session closed for user root Apr 29 15:28:16 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-4134ae23-163c-4124-a274-3c5aa581075c req-6fc590cf-1c96-41ec-87d5-d1b1d652158b tempest-TestServerVolumeAttachScenarioOldVersion-136038078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-fcba171f-4bb7-40de-a989-9f2c3c5ae1e1" returned: 0 in 0.696s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:28:16 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-4134ae23-163c-4124-a274-3c5aa581075c req-6fc590cf-1c96-41ec-87d5-d1b1d652158b tempest-TestServerVolumeAttachScenarioOldVersion-136038078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.715s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:28:16 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-4134ae23-163c-4124-a274-3c5aa581075c req-6fc590cf-1c96-41ec-87d5-d1b1d652158b tempest-TestServerVolumeAttachScenarioOldVersion-136038078 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a', 'name': 'volume-fcba171f-4bb7-40de-a989-9f2c3c5ae1e1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8102f9a6-4b73-437b-8aad-1a8f93e2da53', 'enforce_multipath': True} {{(pid=84448) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 15:28:16 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-4134ae23-163c-4124-a274-3c5aa581075c req-6fc590cf-1c96-41ec-87d5-d1b1d652158b tempest-TestServerVolumeAttachScenarioOldVersion-136038078 None] attachment_update completed successfully. Apr 29 15:28:16 devstack sudo[106986]: pam_unix(sudo:session): session closed for user root Apr 29 15:28:16 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-9efbb256-b9ec-4eb2-9fee-7344abbdbca6 tempest-CinderUnicodeTest-1365691319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f81d9e47-69b8-429e-bb46-0e3097a57612" returned: 0 in 0.649s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:28:16 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-9efbb256-b9ec-4eb2-9fee-7344abbdbca6 tempest-CinderUnicodeTest-1365691319 None] Lock "cinder-quobyte-f81d9e47-69b8-429e-bb46-0e3097a57612" released by "delete_volume" :: held 1.419s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:28:16 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-9efbb256-b9ec-4eb2-9fee-7344abbdbca6 tempest-CinderUnicodeTest-1365691319 None] Created reservations ['7d593309-6607-47bb-a7eb-55ea8013f17e', '9a95c2e8-f29f-4c21-8e62-fb9e374fe641', '19ff226c-b1a9-4ff0-908a-f33a418647ec', 'd13fcee0-5fbb-42a9-a345-1a014dcc65b0'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:28:16 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-9efbb256-b9ec-4eb2-9fee-7344abbdbca6 tempest-CinderUnicodeTest-1365691319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:28:16 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-9efbb256-b9ec-4eb2-9fee-7344abbdbca6 tempest-CinderUnicodeTest-1365691319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:28:16 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-9efbb256-b9ec-4eb2-9fee-7344abbdbca6 tempest-CinderUnicodeTest-1365691319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:28:16 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-9efbb256-b9ec-4eb2-9fee-7344abbdbca6 tempest-CinderUnicodeTest-1365691319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:28:16 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-9efbb256-b9ec-4eb2-9fee-7344abbdbca6 tempest-CinderUnicodeTest-1365691319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:28:16 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-9efbb256-b9ec-4eb2-9fee-7344abbdbca6 tempest-CinderUnicodeTest-1365691319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:28:16 devstack sudo[107059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:28:16 devstack sudo[107059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:28:17 devstack sudo[107059]: pam_unix(sudo:session): session closed for user root Apr 29 15:28:17 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-9efbb256-b9ec-4eb2-9fee-7344abbdbca6 tempest-CinderUnicodeTest-1365691319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.628s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:28:17 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-9efbb256-b9ec-4eb2-9fee-7344abbdbca6 tempest-CinderUnicodeTest-1365691319 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:28:17 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-9efbb256-b9ec-4eb2-9fee-7344abbdbca6 tempest-CinderUnicodeTest-1365691319 None] Deleted volume successfully. Apr 29 15:28:17 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-9efbb256-b9ec-4eb2-9fee-7344abbdbca6 tempest-CinderUnicodeTest-1365691319 None] Lock "cinder-f81d9e47-69b8-429e-bb46-0e3097a57612-delete_volume" released by "delete_volume" :: held 2.260s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:28:22 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-97d14814-7592-42e9-a4d6-963b6c037d5b req-e2789314-874f-4113-a115-717c7334decb tempest-TestServerVolumeAttachScenarioOldVersion-136038078 None] Terminate volume connection completed successfully. Apr 29 15:28:22 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-97d14814-7592-42e9-a4d6-963b6c037d5b req-e2789314-874f-4113-a115-717c7334decb tempest-TestServerVolumeAttachScenarioOldVersion-136038078 None] Deleting attachment 8102f9a6-4b73-437b-8aad-1a8f93e2da53. {{(pid=84448) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 15:28:24 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-dc113ed4-0d19-4f99-9f81-febeaa84cd9f tempest-TestServerVolumeAttachScenarioOldVersion-136038078 None] Acquiring lock "cinder-fcba171f-4bb7-40de-a989-9f2c3c5ae1e1-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:28:24 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-dc113ed4-0d19-4f99-9f81-febeaa84cd9f tempest-TestServerVolumeAttachScenarioOldVersion-136038078 None] Lock "cinder-fcba171f-4bb7-40de-a989-9f2c3c5ae1e1-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:28:25 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-dc113ed4-0d19-4f99-9f81-febeaa84cd9f tempest-TestServerVolumeAttachScenarioOldVersion-136038078 None] Acquiring lock "cinder-quobyte-fcba171f-4bb7-40de-a989-9f2c3c5ae1e1" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:28:25 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-dc113ed4-0d19-4f99-9f81-febeaa84cd9f tempest-TestServerVolumeAttachScenarioOldVersion-136038078 None] Lock "cinder-quobyte-fcba171f-4bb7-40de-a989-9f2c3c5ae1e1" acquired by "delete_volume" :: waited 0.020s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:28:25 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e44780-efb3-4e13-b66b-1e24e81a722f]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:28:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-dc113ed4-0d19-4f99-9f81-febeaa84cd9f tempest-TestServerVolumeAttachScenarioOldVersion-136038078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-fcba171f-4bb7-40de-a989-9f2c3c5ae1e1 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:28:25 devstack sudo[107407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-fcba171f-4bb7-40de-a989-9f2c3c5ae1e1 Apr 29 15:28:25 devstack sudo[107407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:28:25 devstack sudo[107407]: pam_unix(sudo:session): session closed for user root Apr 29 15:28:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-dc113ed4-0d19-4f99-9f81-febeaa84cd9f tempest-TestServerVolumeAttachScenarioOldVersion-136038078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-fcba171f-4bb7-40de-a989-9f2c3c5ae1e1" returned: 0 in 0.756s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:28:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-dc113ed4-0d19-4f99-9f81-febeaa84cd9f tempest-TestServerVolumeAttachScenarioOldVersion-136038078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-fcba171f-4bb7-40de-a989-9f2c3c5ae1e1 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:28:25 devstack sudo[107412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-fcba171f-4bb7-40de-a989-9f2c3c5ae1e1 Apr 29 15:28:25 devstack sudo[107412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:28:26 devstack sudo[107412]: pam_unix(sudo:session): session closed for user root Apr 29 15:28:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-dc113ed4-0d19-4f99-9f81-febeaa84cd9f tempest-TestServerVolumeAttachScenarioOldVersion-136038078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-fcba171f-4bb7-40de-a989-9f2c3c5ae1e1" returned: 0 in 0.714s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:28:26 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-dc113ed4-0d19-4f99-9f81-febeaa84cd9f tempest-TestServerVolumeAttachScenarioOldVersion-136038078 None] Lock "cinder-quobyte-fcba171f-4bb7-40de-a989-9f2c3c5ae1e1" released by "delete_volume" :: held 1.531s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:28:26 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-dc113ed4-0d19-4f99-9f81-febeaa84cd9f tempest-TestServerVolumeAttachScenarioOldVersion-136038078 None] Created reservations ['313d50da-1423-44a9-8978-d10bfb7a58d7', '2af64bd7-6d0f-4566-a46c-557dd9054a22', '674bdb73-939c-4e0c-aec2-4b6981ecf9c7', '73f97edc-4e63-4aa3-9546-94517c2d16c2'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:28:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-dc113ed4-0d19-4f99-9f81-febeaa84cd9f tempest-TestServerVolumeAttachScenarioOldVersion-136038078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:28:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-dc113ed4-0d19-4f99-9f81-febeaa84cd9f tempest-TestServerVolumeAttachScenarioOldVersion-136038078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:28:26 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-dc113ed4-0d19-4f99-9f81-febeaa84cd9f tempest-TestServerVolumeAttachScenarioOldVersion-136038078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:28:26 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-dc113ed4-0d19-4f99-9f81-febeaa84cd9f tempest-TestServerVolumeAttachScenarioOldVersion-136038078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:28:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-dc113ed4-0d19-4f99-9f81-febeaa84cd9f tempest-TestServerVolumeAttachScenarioOldVersion-136038078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:28:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-dc113ed4-0d19-4f99-9f81-febeaa84cd9f tempest-TestServerVolumeAttachScenarioOldVersion-136038078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:28:26 devstack sudo[107416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:28:26 devstack sudo[107416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:28:27 devstack sudo[107416]: pam_unix(sudo:session): session closed for user root Apr 29 15:28:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-dc113ed4-0d19-4f99-9f81-febeaa84cd9f tempest-TestServerVolumeAttachScenarioOldVersion-136038078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.736s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:28:27 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-dc113ed4-0d19-4f99-9f81-febeaa84cd9f tempest-TestServerVolumeAttachScenarioOldVersion-136038078 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:28:27 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-dc113ed4-0d19-4f99-9f81-febeaa84cd9f tempest-TestServerVolumeAttachScenarioOldVersion-136038078 None] Deleted volume successfully. Apr 29 15:28:27 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-dc113ed4-0d19-4f99-9f81-febeaa84cd9f tempest-TestServerVolumeAttachScenarioOldVersion-136038078 None] Lock "cinder-fcba171f-4bb7-40de-a989-9f2c3c5ae1e1-delete_volume" released by "delete_volume" :: held 2.516s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:28:30 devstack cinder-volume[84448]: DEBUG oslo_service.periodic_task [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84448) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 15:28:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:28:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:28:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:28:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:28:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:28:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:28:30 devstack sudo[107480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:28:30 devstack sudo[107480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:28:31 devstack sudo[107480]: pam_unix(sudo:session): session closed for user root Apr 29 15:28:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.735s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:28:31 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:28:36 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:UPDATE=65,cinder:SELECT=48,cinder:INSERT=17,cinder:DELETE=8 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:28:37 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:UPDATE=73,cinder:SELECT=57,cinder:INSERT=16,cinder:DELETE=3 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:28:38 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb162cc5-9ce5-44cb-97aa-6d72d21c7993 tempest-SnapshotDependencyTests-1747382522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:28:38 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-fb162cc5-9ce5-44cb-97aa-6d72d21c7993 tempest-SnapshotDependencyTests-1747382522 None] Flow 'volume_create_manager' (bfed1f55-6cb5-4a09-a8c2-20565ed3d29b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:28:38 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-fb162cc5-9ce5-44cb-97aa-6d72d21c7993 tempest-SnapshotDependencyTests-1747382522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44ce630a-6234-4de3-8d5d-bb0c2f884c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:28:38 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-fb162cc5-9ce5-44cb-97aa-6d72d21c7993 tempest-SnapshotDependencyTests-1747382522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44ce630a-6234-4de3-8d5d-bb0c2f884c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:28:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1343692961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=466b75db-d61b-4f23-8e00-dbecf3735975,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d9a318fe68c4e0a8e3b2420567265d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:28:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:28:39Z,use_quota=True,user_id='e678a13b53924efabe5fa6b760cfca9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:28:38 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-fb162cc5-9ce5-44cb-97aa-6d72d21c7993 tempest-SnapshotDependencyTests-1747382522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11471de2-0b10-4079-a3e5-04f2756210d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:28:38 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-fb162cc5-9ce5-44cb-97aa-6d72d21c7993 tempest-SnapshotDependencyTests-1747382522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11471de2-0b10-4079-a3e5-04f2756210d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:28:38 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-fb162cc5-9ce5-44cb-97aa-6d72d21c7993 tempest-SnapshotDependencyTests-1747382522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65b16ac7-9d8e-4717-b817-93a44a3bd335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:28:38 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-fb162cc5-9ce5-44cb-97aa-6d72d21c7993 tempest-SnapshotDependencyTests-1747382522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65b16ac7-9d8e-4717-b817-93a44a3bd335) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '466b75db-d61b-4f23-8e00-dbecf3735975', 'volume_name': 'volume-466b75db-d61b-4f23-8e00-dbecf3735975', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:28:38 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-fb162cc5-9ce5-44cb-97aa-6d72d21c7993 tempest-SnapshotDependencyTests-1747382522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64c3b972-c2ab-440f-8828-58af6d2deb9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:28:38 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-fb162cc5-9ce5-44cb-97aa-6d72d21c7993 tempest-SnapshotDependencyTests-1747382522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64c3b972-c2ab-440f-8828-58af6d2deb9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:28:38 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-fb162cc5-9ce5-44cb-97aa-6d72d21c7993 tempest-SnapshotDependencyTests-1747382522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (779d42e3-39c5-47d3-b3aa-7fbcc14a47c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:28:38 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-fb162cc5-9ce5-44cb-97aa-6d72d21c7993 tempest-SnapshotDependencyTests-1747382522 None] Volume 466b75db-d61b-4f23-8e00-dbecf3735975: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-466b75db-d61b-4f23-8e00-dbecf3735975', 'volume_size': 1} Apr 29 15:28:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-fb162cc5-9ce5-44cb-97aa-6d72d21c7993 tempest-SnapshotDependencyTests-1747382522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:28:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-fb162cc5-9ce5-44cb-97aa-6d72d21c7993 tempest-SnapshotDependencyTests-1747382522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:28:38 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-fb162cc5-9ce5-44cb-97aa-6d72d21c7993 tempest-SnapshotDependencyTests-1747382522 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:28:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1343692961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=466b75db-d61b-4f23-8e00-dbecf3735975,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d9a318fe68c4e0a8e3b2420567265d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:28:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:28:39Z,use_quota=True,user_id='e678a13b53924efabe5fa6b760cfca9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:28:38 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-fb162cc5-9ce5-44cb-97aa-6d72d21c7993 tempest-SnapshotDependencyTests-1747382522 None] Creating volume 466b75db-d61b-4f23-8e00-dbecf3735975 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:28:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-fb162cc5-9ce5-44cb-97aa-6d72d21c7993 tempest-SnapshotDependencyTests-1747382522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:28:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-fb162cc5-9ce5-44cb-97aa-6d72d21c7993 tempest-SnapshotDependencyTests-1747382522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:28:38 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-fb162cc5-9ce5-44cb-97aa-6d72d21c7993 tempest-SnapshotDependencyTests-1747382522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:28:38 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-fb162cc5-9ce5-44cb-97aa-6d72d21c7993 tempest-SnapshotDependencyTests-1747382522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:28:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-fb162cc5-9ce5-44cb-97aa-6d72d21c7993 tempest-SnapshotDependencyTests-1747382522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:28:38 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-fb162cc5-9ce5-44cb-97aa-6d72d21c7993 tempest-SnapshotDependencyTests-1747382522 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:28:38 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-fb162cc5-9ce5-44cb-97aa-6d72d21c7993 tempest-SnapshotDependencyTests-1747382522 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:28:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-fb162cc5-9ce5-44cb-97aa-6d72d21c7993 tempest-SnapshotDependencyTests-1747382522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-466b75db-d61b-4f23-8e00-dbecf3735975 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:28:38 devstack sudo[107528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-466b75db-d61b-4f23-8e00-dbecf3735975 1073741824 Apr 29 15:28:38 devstack sudo[107528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:28:39 devstack sudo[107528]: pam_unix(sudo:session): session closed for user root Apr 29 15:28:39 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-fb162cc5-9ce5-44cb-97aa-6d72d21c7993 tempest-SnapshotDependencyTests-1747382522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-466b75db-d61b-4f23-8e00-dbecf3735975 1073741824" returned: 0 in 0.793s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:28:39 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-fb162cc5-9ce5-44cb-97aa-6d72d21c7993 tempest-SnapshotDependencyTests-1747382522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-466b75db-d61b-4f23-8e00-dbecf3735975 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:28:39 devstack sudo[107534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-466b75db-d61b-4f23-8e00-dbecf3735975 Apr 29 15:28:39 devstack sudo[107534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:28:40 devstack sudo[107534]: pam_unix(sudo:session): session closed for user root Apr 29 15:28:40 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-fb162cc5-9ce5-44cb-97aa-6d72d21c7993 tempest-SnapshotDependencyTests-1747382522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-466b75db-d61b-4f23-8e00-dbecf3735975" returned: 0 in 0.669s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:28:40 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-fb162cc5-9ce5-44cb-97aa-6d72d21c7993 tempest-SnapshotDependencyTests-1747382522 None] <== create_volume: return (1513ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:28:40 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-fb162cc5-9ce5-44cb-97aa-6d72d21c7993 tempest-SnapshotDependencyTests-1747382522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.515s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:28:40 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-fb162cc5-9ce5-44cb-97aa-6d72d21c7993 tempest-SnapshotDependencyTests-1747382522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (779d42e3-39c5-47d3-b3aa-7fbcc14a47c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-466b75db-d61b-4f23-8e00-dbecf3735975', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:28:40 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-fb162cc5-9ce5-44cb-97aa-6d72d21c7993 tempest-SnapshotDependencyTests-1747382522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ba2a312-5dbc-45a1-a024-e82b0f4b54f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:28:40 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-fb162cc5-9ce5-44cb-97aa-6d72d21c7993 tempest-SnapshotDependencyTests-1747382522 None] Volume volume-466b75db-d61b-4f23-8e00-dbecf3735975 (466b75db-d61b-4f23-8e00-dbecf3735975): created successfully Apr 29 15:28:40 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-fb162cc5-9ce5-44cb-97aa-6d72d21c7993 tempest-SnapshotDependencyTests-1747382522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ba2a312-5dbc-45a1-a024-e82b0f4b54f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:28:40 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-fb162cc5-9ce5-44cb-97aa-6d72d21c7993 tempest-SnapshotDependencyTests-1747382522 None] Flow 'volume_create_manager' (bfed1f55-6cb5-4a09-a8c2-20565ed3d29b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:28:40 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-fb162cc5-9ce5-44cb-97aa-6d72d21c7993 tempest-SnapshotDependencyTests-1747382522 None] Created volume successfully. Apr 29 15:28:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-6cec4500-2d0c-4a63-a3fc-02a0b2c19f3e tempest-SnapshotDependencyTests-1747382522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:28:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-6cec4500-2d0c-4a63-a3fc-02a0b2c19f3e tempest-SnapshotDependencyTests-1747382522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:28:41 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-6cec4500-2d0c-4a63-a3fc-02a0b2c19f3e tempest-SnapshotDependencyTests-1747382522 None] Creating offline snapshot 10194f82-efa7-42da-9f60-774bd13b7edc of volume 466b75db-d61b-4f23-8e00-dbecf3735975 {{(pid=84448) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 15:28:41 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4aacd08-dfc9-4c0b-bdb4-4e0f73277c2b]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:28:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6cec4500-2d0c-4a63-a3fc-02a0b2c19f3e tempest-SnapshotDependencyTests-1747382522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-466b75db-d61b-4f23-8e00-dbecf3735975 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:28:41 devstack sudo[107537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-466b75db-d61b-4f23-8e00-dbecf3735975 Apr 29 15:28:41 devstack sudo[107537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:28:41 devstack sudo[107537]: pam_unix(sudo:session): session closed for user root Apr 29 15:28:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6cec4500-2d0c-4a63-a3fc-02a0b2c19f3e tempest-SnapshotDependencyTests-1747382522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-466b75db-d61b-4f23-8e00-dbecf3735975" returned: 0 in 0.783s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:28:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6cec4500-2d0c-4a63-a3fc-02a0b2c19f3e tempest-SnapshotDependencyTests-1747382522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-466b75db-d61b-4f23-8e00-dbecf3735975,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-466b75db-d61b-4f23-8e00-dbecf3735975.10194f82-efa7-42da-9f60-774bd13b7edc 1G {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:28:42 devstack sudo[107543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-466b75db-d61b-4f23-8e00-dbecf3735975,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-466b75db-d61b-4f23-8e00-dbecf3735975.10194f82-efa7-42da-9f60-774bd13b7edc 1G Apr 29 15:28:42 devstack sudo[107543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:28:42 devstack sudo[107543]: pam_unix(sudo:session): session closed for user root Apr 29 15:28:42 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6cec4500-2d0c-4a63-a3fc-02a0b2c19f3e tempest-SnapshotDependencyTests-1747382522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-466b75db-d61b-4f23-8e00-dbecf3735975,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-466b75db-d61b-4f23-8e00-dbecf3735975.10194f82-efa7-42da-9f60-774bd13b7edc 1G" returned: 0 in 0.925s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:28:42 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6cec4500-2d0c-4a63-a3fc-02a0b2c19f3e tempest-SnapshotDependencyTests-1747382522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-466b75db-d61b-4f23-8e00-dbecf3735975 -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-466b75db-d61b-4f23-8e00-dbecf3735975.10194f82-efa7-42da-9f60-774bd13b7edc {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:28:42 devstack sudo[107552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-466b75db-d61b-4f23-8e00-dbecf3735975 -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-466b75db-d61b-4f23-8e00-dbecf3735975.10194f82-efa7-42da-9f60-774bd13b7edc Apr 29 15:28:42 devstack sudo[107552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:28:43 devstack sudo[107552]: pam_unix(sudo:session): session closed for user root Apr 29 15:28:43 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6cec4500-2d0c-4a63-a3fc-02a0b2c19f3e tempest-SnapshotDependencyTests-1747382522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-466b75db-d61b-4f23-8e00-dbecf3735975 -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-466b75db-d61b-4f23-8e00-dbecf3735975.10194f82-efa7-42da-9f60-774bd13b7edc" returned: 0 in 0.763s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:28:43 devstack cinder-volume[84448]: WARNING cinder.volume.drivers.remotefs [None req-6cec4500-2d0c-4a63-a3fc-02a0b2c19f3e tempest-SnapshotDependencyTests-1747382522 None] /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-466b75db-d61b-4f23-8e00-dbecf3735975.10194f82-efa7-42da-9f60-774bd13b7edc is being set with open permissions: ugo+rw Apr 29 15:28:43 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6cec4500-2d0c-4a63-a3fc-02a0b2c19f3e tempest-SnapshotDependencyTests-1747382522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-466b75db-d61b-4f23-8e00-dbecf3735975.10194f82-efa7-42da-9f60-774bd13b7edc {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:28:43 devstack sudo[107568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-466b75db-d61b-4f23-8e00-dbecf3735975.10194f82-efa7-42da-9f60-774bd13b7edc Apr 29 15:28:43 devstack sudo[107568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:28:44 devstack sudo[107568]: pam_unix(sudo:session): session closed for user root Apr 29 15:28:44 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6cec4500-2d0c-4a63-a3fc-02a0b2c19f3e tempest-SnapshotDependencyTests-1747382522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-466b75db-d61b-4f23-8e00-dbecf3735975.10194f82-efa7-42da-9f60-774bd13b7edc" returned: 0 in 0.645s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:28:44 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6cec4500-2d0c-4a63-a3fc-02a0b2c19f3e tempest-SnapshotDependencyTests-1747382522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-466b75db-d61b-4f23-8e00-dbecf3735975.info {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:28:44 devstack sudo[107586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-466b75db-d61b-4f23-8e00-dbecf3735975.info Apr 29 15:28:44 devstack sudo[107586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:28:44 devstack sudo[107586]: pam_unix(sudo:session): session closed for user root Apr 29 15:28:44 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6cec4500-2d0c-4a63-a3fc-02a0b2c19f3e tempest-SnapshotDependencyTests-1747382522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-466b75db-d61b-4f23-8e00-dbecf3735975.info" returned: 0 in 0.625s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:28:44 devstack cinder-volume[84448]: WARNING cinder.volume.drivers.remotefs [None req-6cec4500-2d0c-4a63-a3fc-02a0b2c19f3e tempest-SnapshotDependencyTests-1747382522 None] /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-466b75db-d61b-4f23-8e00-dbecf3735975.info is being set with open permissions: ugo+rw Apr 29 15:28:44 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6cec4500-2d0c-4a63-a3fc-02a0b2c19f3e tempest-SnapshotDependencyTests-1747382522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-466b75db-d61b-4f23-8e00-dbecf3735975.info {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:28:45 devstack sudo[107590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-466b75db-d61b-4f23-8e00-dbecf3735975.info Apr 29 15:28:45 devstack sudo[107590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:28:45 devstack sudo[107590]: pam_unix(sudo:session): session closed for user root Apr 29 15:28:45 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6cec4500-2d0c-4a63-a3fc-02a0b2c19f3e tempest-SnapshotDependencyTests-1747382522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-466b75db-d61b-4f23-8e00-dbecf3735975.info" returned: 0 in 0.677s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:28:45 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-6cec4500-2d0c-4a63-a3fc-02a0b2c19f3e tempest-SnapshotDependencyTests-1747382522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.524s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:28:45 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-6cec4500-2d0c-4a63-a3fc-02a0b2c19f3e tempest-SnapshotDependencyTests-1747382522 None] Create snapshot completed successfully Apr 29 15:28:47 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-4aea4fcc-c3aa-4098-ac33-75455b8aee8a tempest-SnapshotDependencyTests-1747382522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:28:47 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4aea4fcc-c3aa-4098-ac33-75455b8aee8a tempest-SnapshotDependencyTests-1747382522 None] Flow 'volume_create_manager' (532e27dc-bb4e-411a-a4ab-508c3ca11094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:28:47 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4aea4fcc-c3aa-4098-ac33-75455b8aee8a tempest-SnapshotDependencyTests-1747382522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bfc5ad9-8bca-4557-acb1-8f17fd36d880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:28:47 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4aea4fcc-c3aa-4098-ac33-75455b8aee8a tempest-SnapshotDependencyTests-1747382522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bfc5ad9-8bca-4557-acb1-8f17fd36d880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:28:47Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af7ef742-f976-4d09-833e-db8c55e2a60b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d9a318fe68c4e0a8e3b2420567265d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:28:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=10194f82-efa7-42da-9f60-774bd13b7edc,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:28:47Z,use_quota=True,user_id='e678a13b53924efabe5fa6b760cfca9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:28:47 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4aea4fcc-c3aa-4098-ac33-75455b8aee8a tempest-SnapshotDependencyTests-1747382522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52480e6f-6c93-4302-b602-54fd09f0f83d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:28:47 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4aea4fcc-c3aa-4098-ac33-75455b8aee8a tempest-SnapshotDependencyTests-1747382522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52480e6f-6c93-4302-b602-54fd09f0f83d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:28:47 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4aea4fcc-c3aa-4098-ac33-75455b8aee8a tempest-SnapshotDependencyTests-1747382522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5aa23cc5-5b6e-4555-b6a6-fe11c382a749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:28:47 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4aea4fcc-c3aa-4098-ac33-75455b8aee8a tempest-SnapshotDependencyTests-1747382522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5aa23cc5-5b6e-4555-b6a6-fe11c382a749) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'af7ef742-f976-4d09-833e-db8c55e2a60b', 'volume_name': 'volume-af7ef742-f976-4d09-833e-db8c55e2a60b', 'volume_size': 1, 'snapshot_id': '10194f82-efa7-42da-9f60-774bd13b7edc'}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:28:47 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4aea4fcc-c3aa-4098-ac33-75455b8aee8a tempest-SnapshotDependencyTests-1747382522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc37b96c-f478-468d-86c8-e7d96b76de08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:28:47 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4aea4fcc-c3aa-4098-ac33-75455b8aee8a tempest-SnapshotDependencyTests-1747382522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc37b96c-f478-468d-86c8-e7d96b76de08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:28:47 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4aea4fcc-c3aa-4098-ac33-75455b8aee8a tempest-SnapshotDependencyTests-1747382522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (699fb660-11cb-46fc-a431-5a061b352269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:28:47 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-4aea4fcc-c3aa-4098-ac33-75455b8aee8a tempest-SnapshotDependencyTests-1747382522 None] Volume af7ef742-f976-4d09-833e-db8c55e2a60b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-af7ef742-f976-4d09-833e-db8c55e2a60b', 'volume_size': 1, 'snapshot_id': '10194f82-efa7-42da-9f60-774bd13b7edc'} Apr 29 15:28:47 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-4aea4fcc-c3aa-4098-ac33-75455b8aee8a tempest-SnapshotDependencyTests-1747382522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:28:47 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-4aea4fcc-c3aa-4098-ac33-75455b8aee8a tempest-SnapshotDependencyTests-1747382522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:28:47 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-4aea4fcc-c3aa-4098-ac33-75455b8aee8a tempest-SnapshotDependencyTests-1747382522 None] Acquiring lock "cinder-quobyte-10194f82-efa7-42da-9f60-774bd13b7edc-af7ef742-f976-4d09-833e-db8c55e2a60b" by "_create_volume_from_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:28:47 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-4aea4fcc-c3aa-4098-ac33-75455b8aee8a tempest-SnapshotDependencyTests-1747382522 None] Lock "cinder-quobyte-10194f82-efa7-42da-9f60-774bd13b7edc-af7ef742-f976-4d09-833e-db8c55e2a60b" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:28:47 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-4aea4fcc-c3aa-4098-ac33-75455b8aee8a tempest-SnapshotDependencyTests-1747382522 None] Creating volume af7ef742-f976-4d09-833e-db8c55e2a60b from snapshot 10194f82-efa7-42da-9f60-774bd13b7edc {{(pid=84448) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 15:28:47 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-4aea4fcc-c3aa-4098-ac33-75455b8aee8a tempest-SnapshotDependencyTests-1747382522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:28:47 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-4aea4fcc-c3aa-4098-ac33-75455b8aee8a tempest-SnapshotDependencyTests-1747382522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:28:47 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-4aea4fcc-c3aa-4098-ac33-75455b8aee8a tempest-SnapshotDependencyTests-1747382522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:28:47 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-4aea4fcc-c3aa-4098-ac33-75455b8aee8a tempest-SnapshotDependencyTests-1747382522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:28:47 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-4aea4fcc-c3aa-4098-ac33-75455b8aee8a tempest-SnapshotDependencyTests-1747382522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:28:47 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-4aea4fcc-c3aa-4098-ac33-75455b8aee8a tempest-SnapshotDependencyTests-1747382522 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:28:47 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-4aea4fcc-c3aa-4098-ac33-75455b8aee8a tempest-SnapshotDependencyTests-1747382522 None] Acquiring lock "cinder-quobyte-af7ef742-f976-4d09-833e-db8c55e2a60b" by "_copy_volume_from_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:28:47 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-4aea4fcc-c3aa-4098-ac33-75455b8aee8a tempest-SnapshotDependencyTests-1747382522 None] Lock "cinder-quobyte-af7ef742-f976-4d09-833e-db8c55e2a60b" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:28:47 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-4aea4fcc-c3aa-4098-ac33-75455b8aee8a tempest-SnapshotDependencyTests-1747382522 None] snapshot: 10194f82-efa7-42da-9f60-774bd13b7edc, volume: af7ef742-f976-4d09-833e-db8c55e2a60b, {{(pid=84448) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 15:28:47 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-4aea4fcc-c3aa-4098-ac33-75455b8aee8a tempest-SnapshotDependencyTests-1747382522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:28:47 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-4aea4fcc-c3aa-4098-ac33-75455b8aee8a tempest-SnapshotDependencyTests-1747382522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:28:47 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-4aea4fcc-c3aa-4098-ac33-75455b8aee8a tempest-SnapshotDependencyTests-1747382522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:28:47 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-4aea4fcc-c3aa-4098-ac33-75455b8aee8a tempest-SnapshotDependencyTests-1747382522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:28:47 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-4aea4fcc-c3aa-4098-ac33-75455b8aee8a tempest-SnapshotDependencyTests-1747382522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:28:47 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a4f71d8-b0bf-4c60-9b46-fc116d101ff9]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:28:47 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-4aea4fcc-c3aa-4098-ac33-75455b8aee8a tempest-SnapshotDependencyTests-1747382522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-466b75db-d61b-4f23-8e00-dbecf3735975.10194f82-efa7-42da-9f60-774bd13b7edc {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:28:47 devstack sudo[107597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-466b75db-d61b-4f23-8e00-dbecf3735975.10194f82-efa7-42da-9f60-774bd13b7edc Apr 29 15:28:47 devstack sudo[107597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:28:48 devstack sudo[107597]: pam_unix(sudo:session): session closed for user root Apr 29 15:28:48 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-4aea4fcc-c3aa-4098-ac33-75455b8aee8a tempest-SnapshotDependencyTests-1747382522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-466b75db-d61b-4f23-8e00-dbecf3735975.10194f82-efa7-42da-9f60-774bd13b7edc" returned: 0 in 0.805s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:28:48 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-4aea4fcc-c3aa-4098-ac33-75455b8aee8a tempest-SnapshotDependencyTests-1747382522 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-466b75db-d61b-4f23-8e00-dbecf3735975(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84448) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 15:28:48 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-4aea4fcc-c3aa-4098-ac33-75455b8aee8a tempest-SnapshotDependencyTests-1747382522 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-466b75db-d61b-4f23-8e00-dbecf3735975 {{(pid=84448) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 15:28:48 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-4aea4fcc-c3aa-4098-ac33-75455b8aee8a tempest-SnapshotDependencyTests-1747382522 None] Creating direct copy from snapshot {{(pid=84448) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 15:28:48 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[fafbf5bf-cde4-49f4-90c2-b6e5d0ff9138]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:28:48 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-4aea4fcc-c3aa-4098-ac33-75455b8aee8a tempest-SnapshotDependencyTests-1747382522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-466b75db-d61b-4f23-8e00-dbecf3735975 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:28:48 devstack sudo[107602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-466b75db-d61b-4f23-8e00-dbecf3735975 Apr 29 15:28:48 devstack sudo[107602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:28:49 devstack sudo[107602]: pam_unix(sudo:session): session closed for user root Apr 29 15:28:49 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-4aea4fcc-c3aa-4098-ac33-75455b8aee8a tempest-SnapshotDependencyTests-1747382522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-466b75db-d61b-4f23-8e00-dbecf3735975" returned: 0 in 0.783s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:28:49 devstack cinder-volume[84448]: DEBUG cinder.utils [None req-4aea4fcc-c3aa-4098-ac33-75455b8aee8a tempest-SnapshotDependencyTests-1747382522 None] Path /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-af7ef742-f976-4d09-833e-db8c55e2a60b not found in is_blk_device check {{(pid=84448) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 15:28:49 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-4aea4fcc-c3aa-4098-ac33-75455b8aee8a tempest-SnapshotDependencyTests-1747382522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-466b75db-d61b-4f23-8e00-dbecf3735975 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-af7ef742-f976-4d09-833e-db8c55e2a60b {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:28:49 devstack sudo[107607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-466b75db-d61b-4f23-8e00-dbecf3735975 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-af7ef742-f976-4d09-833e-db8c55e2a60b Apr 29 15:28:49 devstack sudo[107607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:28:51 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-837298a5-d448-4e64-b862-2a3117796dd5 tempest-CreateVolumesFromImageTest-1209047278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:28:51 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-837298a5-d448-4e64-b862-2a3117796dd5 tempest-CreateVolumesFromImageTest-1209047278 None] Flow 'volume_create_manager' (3209f5a2-5c61-4748-990d-d64834e7d352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:28:51 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-837298a5-d448-4e64-b862-2a3117796dd5 tempest-CreateVolumesFromImageTest-1209047278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00c7521a-8b2b-41f4-8687-d191791a2b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:28:51 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-837298a5-d448-4e64-b862-2a3117796dd5 tempest-CreateVolumesFromImageTest-1209047278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00c7521a-8b2b-41f4-8687-d191791a2b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:28:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1268995624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f041097-789c-46df-bba6-ab8e98fd467c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b5d7543f4a843ae8bca02183bcc6add',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:28:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:28:51Z,use_quota=True,user_id='b8c4fcfff43249deaec3a3fa53160c9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:28:51 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-837298a5-d448-4e64-b862-2a3117796dd5 tempest-CreateVolumesFromImageTest-1209047278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4363faaf-5efd-4a9c-b6de-bb4ced6c153e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:28:51 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-837298a5-d448-4e64-b862-2a3117796dd5 tempest-CreateVolumesFromImageTest-1209047278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4363faaf-5efd-4a9c-b6de-bb4ced6c153e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:28:51 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-837298a5-d448-4e64-b862-2a3117796dd5 tempest-CreateVolumesFromImageTest-1209047278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fdbcf1f-8e98-480d-ac6b-a5acfed9bdf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:28:51 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-837298a5-d448-4e64-b862-2a3117796dd5 tempest-CreateVolumesFromImageTest-1209047278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fdbcf1f-8e98-480d-ac6b-a5acfed9bdf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f041097-789c-46df-bba6-ab8e98fd467c', 'volume_name': 'volume-4f041097-789c-46df-bba6-ab8e98fd467c', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:28:51 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-837298a5-d448-4e64-b862-2a3117796dd5 tempest-CreateVolumesFromImageTest-1209047278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1b1aa8e-c019-4a13-98a5-f30afa50fc69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:28:52 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-837298a5-d448-4e64-b862-2a3117796dd5 tempest-CreateVolumesFromImageTest-1209047278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1b1aa8e-c019-4a13-98a5-f30afa50fc69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:28:52 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-837298a5-d448-4e64-b862-2a3117796dd5 tempest-CreateVolumesFromImageTest-1209047278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b2afa21-78d1-40d3-829e-96a746f5bc39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:28:52 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-837298a5-d448-4e64-b862-2a3117796dd5 tempest-CreateVolumesFromImageTest-1209047278 None] Volume 4f041097-789c-46df-bba6-ab8e98fd467c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f041097-789c-46df-bba6-ab8e98fd467c', 'volume_size': 1} Apr 29 15:28:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-837298a5-d448-4e64-b862-2a3117796dd5 tempest-CreateVolumesFromImageTest-1209047278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:28:52 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6f2af28-ac5c-478f-9727-66ff83705bd7 tempest-CreateVolumesFromImageTest-1209047278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:28:52 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e6f2af28-ac5c-478f-9727-66ff83705bd7 tempest-CreateVolumesFromImageTest-1209047278 None] Flow 'volume_create_manager' (dbaaec7b-5e50-4ac6-a11c-1a0003418952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:28:52 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e6f2af28-ac5c-478f-9727-66ff83705bd7 tempest-CreateVolumesFromImageTest-1209047278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e85de06-bd11-4282-b633-03cab59b35ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:28:52 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e6f2af28-ac5c-478f-9727-66ff83705bd7 tempest-CreateVolumesFromImageTest-1209047278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e85de06-bd11-4282-b633-03cab59b35ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:28:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2036258080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d66cce50-a9a3-4bc6-8da2-f61747c37cae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b5d7543f4a843ae8bca02183bcc6add',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:28:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:28:53Z,use_quota=True,user_id='b8c4fcfff43249deaec3a3fa53160c9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:28:52 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e6f2af28-ac5c-478f-9727-66ff83705bd7 tempest-CreateVolumesFromImageTest-1209047278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd30ba0c-1caf-467d-8810-14b0574a531e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:28:52 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e6f2af28-ac5c-478f-9727-66ff83705bd7 tempest-CreateVolumesFromImageTest-1209047278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd30ba0c-1caf-467d-8810-14b0574a531e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:28:52 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e6f2af28-ac5c-478f-9727-66ff83705bd7 tempest-CreateVolumesFromImageTest-1209047278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc1788d4-1d1a-4b8c-85f3-7c808620729e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:28:52 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e6f2af28-ac5c-478f-9727-66ff83705bd7 tempest-CreateVolumesFromImageTest-1209047278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc1788d4-1d1a-4b8c-85f3-7c808620729e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd66cce50-a9a3-4bc6-8da2-f61747c37cae', 'volume_name': 'volume-d66cce50-a9a3-4bc6-8da2-f61747c37cae', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:28:52 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e6f2af28-ac5c-478f-9727-66ff83705bd7 tempest-CreateVolumesFromImageTest-1209047278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dde1e9b-5371-40ea-86f2-32e9b2b93e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:28:52 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e6f2af28-ac5c-478f-9727-66ff83705bd7 tempest-CreateVolumesFromImageTest-1209047278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dde1e9b-5371-40ea-86f2-32e9b2b93e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:28:52 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e6f2af28-ac5c-478f-9727-66ff83705bd7 tempest-CreateVolumesFromImageTest-1209047278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dce1a62d-e2e1-420d-b5b5-3457933a54f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:28:52 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-e6f2af28-ac5c-478f-9727-66ff83705bd7 tempest-CreateVolumesFromImageTest-1209047278 None] Volume d66cce50-a9a3-4bc6-8da2-f61747c37cae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d66cce50-a9a3-4bc6-8da2-f61747c37cae', 'volume_size': 1} Apr 29 15:28:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-e6f2af28-ac5c-478f-9727-66ff83705bd7 tempest-CreateVolumesFromImageTest-1209047278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:28:53 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-a150d6d2-8944-4872-9234-36686ff84e8a tempest-CreateVolumesFromImageTest-1209047278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:28:53 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-a150d6d2-8944-4872-9234-36686ff84e8a tempest-CreateVolumesFromImageTest-1209047278 None] Flow 'volume_create_manager' (c6e1eb6e-9acd-4531-809c-51a1fb8c1650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:28:53 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-a150d6d2-8944-4872-9234-36686ff84e8a tempest-CreateVolumesFromImageTest-1209047278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2107168-0024-4b86-b153-8e4f496cd61b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:28:53 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-a150d6d2-8944-4872-9234-36686ff84e8a tempest-CreateVolumesFromImageTest-1209047278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2107168-0024-4b86-b153-8e4f496cd61b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:28:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-117085980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41344185-a23c-4ddb-b21e-81e1bdebeae6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b5d7543f4a843ae8bca02183bcc6add',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:28:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:28:53Z,use_quota=True,user_id='b8c4fcfff43249deaec3a3fa53160c9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:28:53 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-a150d6d2-8944-4872-9234-36686ff84e8a tempest-CreateVolumesFromImageTest-1209047278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f090d6a3-8520-40b7-bf35-e7b17634c3dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:28:53 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-a150d6d2-8944-4872-9234-36686ff84e8a tempest-CreateVolumesFromImageTest-1209047278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f090d6a3-8520-40b7-bf35-e7b17634c3dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:28:53 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-a150d6d2-8944-4872-9234-36686ff84e8a tempest-CreateVolumesFromImageTest-1209047278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5af62563-bd99-46bb-bb52-cae4861de459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:28:53 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-a150d6d2-8944-4872-9234-36686ff84e8a tempest-CreateVolumesFromImageTest-1209047278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5af62563-bd99-46bb-bb52-cae4861de459) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41344185-a23c-4ddb-b21e-81e1bdebeae6', 'volume_name': 'volume-41344185-a23c-4ddb-b21e-81e1bdebeae6', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:28:53 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-a150d6d2-8944-4872-9234-36686ff84e8a tempest-CreateVolumesFromImageTest-1209047278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d29efd07-f363-4d2e-94c0-a1b018538d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:28:53 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-a150d6d2-8944-4872-9234-36686ff84e8a tempest-CreateVolumesFromImageTest-1209047278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d29efd07-f363-4d2e-94c0-a1b018538d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:28:53 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-a150d6d2-8944-4872-9234-36686ff84e8a tempest-CreateVolumesFromImageTest-1209047278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acfab276-79ff-4167-958c-5366898dd8ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:28:53 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-a150d6d2-8944-4872-9234-36686ff84e8a tempest-CreateVolumesFromImageTest-1209047278 None] Volume 41344185-a23c-4ddb-b21e-81e1bdebeae6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41344185-a23c-4ddb-b21e-81e1bdebeae6', 'volume_size': 1} Apr 29 15:28:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-a150d6d2-8944-4872-9234-36686ff84e8a tempest-CreateVolumesFromImageTest-1209047278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:28:54 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc211388-a067-45c5-b393-86b91bef7467 tempest-CreateVolumesFromImageTest-1209047278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:28:54 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cc211388-a067-45c5-b393-86b91bef7467 tempest-CreateVolumesFromImageTest-1209047278 None] Flow 'volume_create_manager' (5a811fde-9961-48ec-8874-ef2de8df8605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:28:54 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cc211388-a067-45c5-b393-86b91bef7467 tempest-CreateVolumesFromImageTest-1209047278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfe65c02-cc6d-402f-8c1a-334314b2c8cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:28:54 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cc211388-a067-45c5-b393-86b91bef7467 tempest-CreateVolumesFromImageTest-1209047278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfe65c02-cc6d-402f-8c1a-334314b2c8cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:28:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1305626576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc688e9a-a716-45c1-ad58-0288b8826835,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b5d7543f4a843ae8bca02183bcc6add',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:28:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:28:54Z,use_quota=True,user_id='b8c4fcfff43249deaec3a3fa53160c9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:28:54 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cc211388-a067-45c5-b393-86b91bef7467 tempest-CreateVolumesFromImageTest-1209047278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ed34578-87f0-462e-b18d-24e3cceaf0f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:28:54 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cc211388-a067-45c5-b393-86b91bef7467 tempest-CreateVolumesFromImageTest-1209047278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ed34578-87f0-462e-b18d-24e3cceaf0f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:28:54 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cc211388-a067-45c5-b393-86b91bef7467 tempest-CreateVolumesFromImageTest-1209047278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8aff965-6a92-45f2-911f-78a46c8a2a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:28:54 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cc211388-a067-45c5-b393-86b91bef7467 tempest-CreateVolumesFromImageTest-1209047278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8aff965-6a92-45f2-911f-78a46c8a2a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc688e9a-a716-45c1-ad58-0288b8826835', 'volume_name': 'volume-cc688e9a-a716-45c1-ad58-0288b8826835', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:28:54 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cc211388-a067-45c5-b393-86b91bef7467 tempest-CreateVolumesFromImageTest-1209047278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (568b7a2f-760c-41eb-a675-ecd74122a607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:28:54 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cc211388-a067-45c5-b393-86b91bef7467 tempest-CreateVolumesFromImageTest-1209047278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (568b7a2f-760c-41eb-a675-ecd74122a607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:28:54 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cc211388-a067-45c5-b393-86b91bef7467 tempest-CreateVolumesFromImageTest-1209047278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9251f572-fc72-4e52-851c-e546f18034f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:28:54 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-cc211388-a067-45c5-b393-86b91bef7467 tempest-CreateVolumesFromImageTest-1209047278 None] Volume cc688e9a-a716-45c1-ad58-0288b8826835: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc688e9a-a716-45c1-ad58-0288b8826835', 'volume_size': 1} Apr 29 15:28:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-cc211388-a067-45c5-b393-86b91bef7467 tempest-CreateVolumesFromImageTest-1209047278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:28:54 devstack sudo[107607]: pam_unix(sudo:session): session closed for user root Apr 29 15:28:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-4aea4fcc-c3aa-4098-ac33-75455b8aee8a tempest-SnapshotDependencyTests-1747382522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-466b75db-d61b-4f23-8e00-dbecf3735975 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-af7ef742-f976-4d09-833e-db8c55e2a60b" returned: 0 in 5.677s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:28:54 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f943df6-3b4c-4eba-95b5-e98d5c02c7b0 tempest-CreateVolumesFromImageTest-1209047278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:28:54 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-2f943df6-3b4c-4eba-95b5-e98d5c02c7b0 tempest-CreateVolumesFromImageTest-1209047278 None] Flow 'volume_create_manager' (26e83cce-914c-4c3f-ba74-7ea45dfe004c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:28:54 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-2f943df6-3b4c-4eba-95b5-e98d5c02c7b0 tempest-CreateVolumesFromImageTest-1209047278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (967c981b-406a-4460-a48f-93fe8b2c28dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:28:54 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d667cd6-c613-4deb-9a84-28cde481813d]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:28:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-4aea4fcc-c3aa-4098-ac33-75455b8aee8a tempest-SnapshotDependencyTests-1747382522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-466b75db-d61b-4f23-8e00-dbecf3735975 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:28:54 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-2f943df6-3b4c-4eba-95b5-e98d5c02c7b0 tempest-CreateVolumesFromImageTest-1209047278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (967c981b-406a-4460-a48f-93fe8b2c28dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:28:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1436503302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4033a18-0fe5-439a-86ff-b650bdcc7344,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b5d7543f4a843ae8bca02183bcc6add',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:28:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:28:55Z,use_quota=True,user_id='b8c4fcfff43249deaec3a3fa53160c9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:28:54 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-2f943df6-3b4c-4eba-95b5-e98d5c02c7b0 tempest-CreateVolumesFromImageTest-1209047278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9df63dd-bed1-457c-8f76-b8496b9f4952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:28:54 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-2f943df6-3b4c-4eba-95b5-e98d5c02c7b0 tempest-CreateVolumesFromImageTest-1209047278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9df63dd-bed1-457c-8f76-b8496b9f4952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:28:54 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-2f943df6-3b4c-4eba-95b5-e98d5c02c7b0 tempest-CreateVolumesFromImageTest-1209047278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca5febaa-e5a2-4576-a864-0521d13afc31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:28:54 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-2f943df6-3b4c-4eba-95b5-e98d5c02c7b0 tempest-CreateVolumesFromImageTest-1209047278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca5febaa-e5a2-4576-a864-0521d13afc31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4033a18-0fe5-439a-86ff-b650bdcc7344', 'volume_name': 'volume-b4033a18-0fe5-439a-86ff-b650bdcc7344', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:28:54 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-2f943df6-3b4c-4eba-95b5-e98d5c02c7b0 tempest-CreateVolumesFromImageTest-1209047278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37524855-61c2-4a30-8fc1-ca92542e27da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:28:54 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-2f943df6-3b4c-4eba-95b5-e98d5c02c7b0 tempest-CreateVolumesFromImageTest-1209047278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37524855-61c2-4a30-8fc1-ca92542e27da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:28:54 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-2f943df6-3b4c-4eba-95b5-e98d5c02c7b0 tempest-CreateVolumesFromImageTest-1209047278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eba1a978-f83f-41ce-b3ef-2a2794902a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:28:54 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-2f943df6-3b4c-4eba-95b5-e98d5c02c7b0 tempest-CreateVolumesFromImageTest-1209047278 None] Volume b4033a18-0fe5-439a-86ff-b650bdcc7344: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4033a18-0fe5-439a-86ff-b650bdcc7344', 'volume_size': 1} Apr 29 15:28:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-2f943df6-3b4c-4eba-95b5-e98d5c02c7b0 tempest-CreateVolumesFromImageTest-1209047278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:28:54 devstack sudo[107620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-466b75db-d61b-4f23-8e00-dbecf3735975 Apr 29 15:28:54 devstack sudo[107620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:28:55 devstack sudo[107620]: pam_unix(sudo:session): session closed for user root Apr 29 15:28:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-4aea4fcc-c3aa-4098-ac33-75455b8aee8a tempest-SnapshotDependencyTests-1747382522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-466b75db-d61b-4f23-8e00-dbecf3735975" returned: 0 in 0.900s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:28:55 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [None req-4aea4fcc-c3aa-4098-ac33-75455b8aee8a tempest-SnapshotDependencyTests-1747382522 None] Image conversion details: src /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-466b75db-d61b-4f23-8e00-dbecf3735975, size 1024.00 MB, duration 5.68 sec, destination /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-af7ef742-f976-4d09-833e-db8c55e2a60b {{(pid=84448) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 15:28:55 devstack cinder-volume[84448]: INFO cinder.image.image_utils [None req-4aea4fcc-c3aa-4098-ac33-75455b8aee8a tempest-SnapshotDependencyTests-1747382522 None] Converted 1024.00 MB image at 180.33 MB/s Apr 29 15:28:55 devstack cinder-volume[84448]: WARNING cinder.volume.drivers.remotefs [None req-4aea4fcc-c3aa-4098-ac33-75455b8aee8a tempest-SnapshotDependencyTests-1747382522 None] /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-af7ef742-f976-4d09-833e-db8c55e2a60b is being set with open permissions: ugo+rw Apr 29 15:28:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-4aea4fcc-c3aa-4098-ac33-75455b8aee8a tempest-SnapshotDependencyTests-1747382522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-af7ef742-f976-4d09-833e-db8c55e2a60b {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:28:55 devstack sudo[107625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-af7ef742-f976-4d09-833e-db8c55e2a60b Apr 29 15:28:55 devstack sudo[107625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:28:56 devstack sudo[107625]: pam_unix(sudo:session): session closed for user root Apr 29 15:28:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-4aea4fcc-c3aa-4098-ac33-75455b8aee8a tempest-SnapshotDependencyTests-1747382522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-af7ef742-f976-4d09-833e-db8c55e2a60b" returned: 0 in 0.594s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:28:56 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-4aea4fcc-c3aa-4098-ac33-75455b8aee8a tempest-SnapshotDependencyTests-1747382522 None] Lock "cinder-quobyte-af7ef742-f976-4d09-833e-db8c55e2a60b" released by "_copy_volume_from_snapshot" :: held 8.895s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:28:56 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-4aea4fcc-c3aa-4098-ac33-75455b8aee8a tempest-SnapshotDependencyTests-1747382522 None] Lock "cinder-quobyte-10194f82-efa7-42da-9f60-774bd13b7edc-af7ef742-f976-4d09-833e-db8c55e2a60b" released by "_create_volume_from_snapshot" :: held 8.927s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:28:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-4aea4fcc-c3aa-4098-ac33-75455b8aee8a tempest-SnapshotDependencyTests-1747382522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.942s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:28:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-837298a5-d448-4e64-b862-2a3117796dd5 tempest-CreateVolumesFromImageTest-1209047278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.192s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:28:56 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-837298a5-d448-4e64-b862-2a3117796dd5 tempest-CreateVolumesFromImageTest-1209047278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:28:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1268995624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f041097-789c-46df-bba6-ab8e98fd467c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b5d7543f4a843ae8bca02183bcc6add',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:28:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:28:51Z,use_quota=True,user_id='b8c4fcfff43249deaec3a3fa53160c9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:28:56 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-837298a5-d448-4e64-b862-2a3117796dd5 tempest-CreateVolumesFromImageTest-1209047278 None] Creating volume 4f041097-789c-46df-bba6-ab8e98fd467c {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:28:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-837298a5-d448-4e64-b862-2a3117796dd5 tempest-CreateVolumesFromImageTest-1209047278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:28:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-837298a5-d448-4e64-b862-2a3117796dd5 tempest-CreateVolumesFromImageTest-1209047278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:28:56 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-837298a5-d448-4e64-b862-2a3117796dd5 tempest-CreateVolumesFromImageTest-1209047278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:28:56 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-837298a5-d448-4e64-b862-2a3117796dd5 tempest-CreateVolumesFromImageTest-1209047278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:28:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-837298a5-d448-4e64-b862-2a3117796dd5 tempest-CreateVolumesFromImageTest-1209047278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:28:56 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-837298a5-d448-4e64-b862-2a3117796dd5 tempest-CreateVolumesFromImageTest-1209047278 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:28:56 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-837298a5-d448-4e64-b862-2a3117796dd5 tempest-CreateVolumesFromImageTest-1209047278 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:28:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-837298a5-d448-4e64-b862-2a3117796dd5 tempest-CreateVolumesFromImageTest-1209047278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4f041097-789c-46df-bba6-ab8e98fd467c 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:28:56 devstack sudo[107629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4f041097-789c-46df-bba6-ab8e98fd467c 1073741824 Apr 29 15:28:56 devstack sudo[107629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:28:56 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4aea4fcc-c3aa-4098-ac33-75455b8aee8a tempest-SnapshotDependencyTests-1747382522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (699fb660-11cb-46fc-a431-5a061b352269) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af7ef742-f976-4d09-833e-db8c55e2a60b', 'volume_size': 1, 'snapshot_id': '10194f82-efa7-42da-9f60-774bd13b7edc'}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:28:56 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4aea4fcc-c3aa-4098-ac33-75455b8aee8a tempest-SnapshotDependencyTests-1747382522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (847963d5-f3a1-4d47-a433-07d9dfa04dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:28:56 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-4aea4fcc-c3aa-4098-ac33-75455b8aee8a tempest-SnapshotDependencyTests-1747382522 None] Volume volume-af7ef742-f976-4d09-833e-db8c55e2a60b (af7ef742-f976-4d09-833e-db8c55e2a60b): created successfully Apr 29 15:28:56 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4aea4fcc-c3aa-4098-ac33-75455b8aee8a tempest-SnapshotDependencyTests-1747382522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (847963d5-f3a1-4d47-a433-07d9dfa04dda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:28:56 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4aea4fcc-c3aa-4098-ac33-75455b8aee8a tempest-SnapshotDependencyTests-1747382522 None] Flow 'volume_create_manager' (532e27dc-bb4e-411a-a4ab-508c3ca11094) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:28:56 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-4aea4fcc-c3aa-4098-ac33-75455b8aee8a tempest-SnapshotDependencyTests-1747382522 None] Created volume successfully. Apr 29 15:28:56 devstack sudo[107629]: pam_unix(sudo:session): session closed for user root Apr 29 15:28:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-837298a5-d448-4e64-b862-2a3117796dd5 tempest-CreateVolumesFromImageTest-1209047278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4f041097-789c-46df-bba6-ab8e98fd467c 1073741824" returned: 0 in 0.740s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:28:57 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-837298a5-d448-4e64-b862-2a3117796dd5 tempest-CreateVolumesFromImageTest-1209047278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4f041097-789c-46df-bba6-ab8e98fd467c {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:28:57 devstack sudo[107634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4f041097-789c-46df-bba6-ab8e98fd467c Apr 29 15:28:57 devstack sudo[107634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:28:57 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-01d65286-03d1-4b0d-8fa5-3bd61184c0f8 tempest-SnapshotDependencyTests-1747382522 None] Acquiring lock "cinder-10194f82-efa7-42da-9f60-774bd13b7edc-delete_snapshot" by "delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:28:57 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-01d65286-03d1-4b0d-8fa5-3bd61184c0f8 tempest-SnapshotDependencyTests-1747382522 None] Lock "cinder-10194f82-efa7-42da-9f60-774bd13b7edc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:28:57 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-01d65286-03d1-4b0d-8fa5-3bd61184c0f8 tempest-SnapshotDependencyTests-1747382522 None] Acquiring lock "cinder-quobyte-466b75db-d61b-4f23-8e00-dbecf3735975" by "delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:28:57 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-01d65286-03d1-4b0d-8fa5-3bd61184c0f8 tempest-SnapshotDependencyTests-1747382522 None] Lock "cinder-quobyte-466b75db-d61b-4f23-8e00-dbecf3735975" acquired by "delete_snapshot" :: waited 0.024s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:28:57 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-01d65286-03d1-4b0d-8fa5-3bd61184c0f8 tempest-SnapshotDependencyTests-1747382522 None] Acquiring lock "cinder-quobyte-10194f82-efa7-42da-9f60-774bd13b7edc" by "_delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:28:57 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-01d65286-03d1-4b0d-8fa5-3bd61184c0f8 tempest-SnapshotDependencyTests-1747382522 None] Lock "cinder-quobyte-10194f82-efa7-42da-9f60-774bd13b7edc" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:28:57 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-01d65286-03d1-4b0d-8fa5-3bd61184c0f8 tempest-SnapshotDependencyTests-1747382522 None] Deleting offline snapshot 10194f82-efa7-42da-9f60-774bd13b7edc of volume 466b75db-d61b-4f23-8e00-dbecf3735975 {{(pid=84448) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 15:28:57 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-01d65286-03d1-4b0d-8fa5-3bd61184c0f8 tempest-SnapshotDependencyTests-1747382522 None] snapshot_file for this snap is: volume-466b75db-d61b-4f23-8e00-dbecf3735975.10194f82-efa7-42da-9f60-774bd13b7edc {{(pid=84448) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 15:28:57 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c696a8-dc6c-4c5f-9d31-240bf5e5e831]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:28:57 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-01d65286-03d1-4b0d-8fa5-3bd61184c0f8 tempest-SnapshotDependencyTests-1747382522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-466b75db-d61b-4f23-8e00-dbecf3735975.10194f82-efa7-42da-9f60-774bd13b7edc {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:28:57 devstack sudo[107636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-466b75db-d61b-4f23-8e00-dbecf3735975.10194f82-efa7-42da-9f60-774bd13b7edc Apr 29 15:28:57 devstack sudo[107636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:28:57 devstack sudo[107634]: pam_unix(sudo:session): session closed for user root Apr 29 15:28:57 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-837298a5-d448-4e64-b862-2a3117796dd5 tempest-CreateVolumesFromImageTest-1209047278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4f041097-789c-46df-bba6-ab8e98fd467c" returned: 0 in 0.598s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:28:57 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-837298a5-d448-4e64-b862-2a3117796dd5 tempest-CreateVolumesFromImageTest-1209047278 None] <== create_volume: return (1374ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:28:57 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-837298a5-d448-4e64-b862-2a3117796dd5 tempest-CreateVolumesFromImageTest-1209047278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.376s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:28:57 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-e6f2af28-ac5c-478f-9727-66ff83705bd7 tempest-CreateVolumesFromImageTest-1209047278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.765s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:28:57 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-e6f2af28-ac5c-478f-9727-66ff83705bd7 tempest-CreateVolumesFromImageTest-1209047278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:28:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2036258080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d66cce50-a9a3-4bc6-8da2-f61747c37cae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b5d7543f4a843ae8bca02183bcc6add',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:28:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:28:53Z,use_quota=True,user_id='b8c4fcfff43249deaec3a3fa53160c9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:28:57 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-e6f2af28-ac5c-478f-9727-66ff83705bd7 tempest-CreateVolumesFromImageTest-1209047278 None] Creating volume d66cce50-a9a3-4bc6-8da2-f61747c37cae {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:28:57 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-e6f2af28-ac5c-478f-9727-66ff83705bd7 tempest-CreateVolumesFromImageTest-1209047278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:28:57 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-e6f2af28-ac5c-478f-9727-66ff83705bd7 tempest-CreateVolumesFromImageTest-1209047278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:28:57 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-e6f2af28-ac5c-478f-9727-66ff83705bd7 tempest-CreateVolumesFromImageTest-1209047278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:28:57 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-e6f2af28-ac5c-478f-9727-66ff83705bd7 tempest-CreateVolumesFromImageTest-1209047278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:28:57 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-e6f2af28-ac5c-478f-9727-66ff83705bd7 tempest-CreateVolumesFromImageTest-1209047278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:28:57 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-e6f2af28-ac5c-478f-9727-66ff83705bd7 tempest-CreateVolumesFromImageTest-1209047278 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:28:57 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-e6f2af28-ac5c-478f-9727-66ff83705bd7 tempest-CreateVolumesFromImageTest-1209047278 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:28:57 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-e6f2af28-ac5c-478f-9727-66ff83705bd7 tempest-CreateVolumesFromImageTest-1209047278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d66cce50-a9a3-4bc6-8da2-f61747c37cae 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:28:57 devstack sudo[107639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d66cce50-a9a3-4bc6-8da2-f61747c37cae 1073741824 Apr 29 15:28:57 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-837298a5-d448-4e64-b862-2a3117796dd5 tempest-CreateVolumesFromImageTest-1209047278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b2afa21-78d1-40d3-829e-96a746f5bc39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f041097-789c-46df-bba6-ab8e98fd467c', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:28:57 devstack sudo[107639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:28:57 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-837298a5-d448-4e64-b862-2a3117796dd5 tempest-CreateVolumesFromImageTest-1209047278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (650b5445-8099-44c3-a612-f9b8194b6ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:28:57 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-837298a5-d448-4e64-b862-2a3117796dd5 tempest-CreateVolumesFromImageTest-1209047278 None] Volume volume-4f041097-789c-46df-bba6-ab8e98fd467c (4f041097-789c-46df-bba6-ab8e98fd467c): created successfully Apr 29 15:28:57 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-837298a5-d448-4e64-b862-2a3117796dd5 tempest-CreateVolumesFromImageTest-1209047278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (650b5445-8099-44c3-a612-f9b8194b6ec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:28:57 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-837298a5-d448-4e64-b862-2a3117796dd5 tempest-CreateVolumesFromImageTest-1209047278 None] Flow 'volume_create_manager' (3209f5a2-5c61-4748-990d-d64834e7d352) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:28:57 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-837298a5-d448-4e64-b862-2a3117796dd5 tempest-CreateVolumesFromImageTest-1209047278 None] Created volume successfully. Apr 29 15:28:58 devstack sudo[107636]: pam_unix(sudo:session): session closed for user root Apr 29 15:28:58 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-01d65286-03d1-4b0d-8fa5-3bd61184c0f8 tempest-SnapshotDependencyTests-1747382522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-466b75db-d61b-4f23-8e00-dbecf3735975.10194f82-efa7-42da-9f60-774bd13b7edc" returned: 0 in 0.750s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:28:58 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-01d65286-03d1-4b0d-8fa5-3bd61184c0f8 tempest-SnapshotDependencyTests-1747382522 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-466b75db-d61b-4f23-8e00-dbecf3735975(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84448) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 15:28:58 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e86449f-8593-470a-859d-8ca015cdf6bd]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:28:58 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-01d65286-03d1-4b0d-8fa5-3bd61184c0f8 tempest-SnapshotDependencyTests-1747382522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-466b75db-d61b-4f23-8e00-dbecf3735975 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:28:58 devstack sudo[107644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-466b75db-d61b-4f23-8e00-dbecf3735975 Apr 29 15:28:58 devstack sudo[107644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:28:58 devstack sudo[107639]: pam_unix(sudo:session): session closed for user root Apr 29 15:28:58 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-e6f2af28-ac5c-478f-9727-66ff83705bd7 tempest-CreateVolumesFromImageTest-1209047278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d66cce50-a9a3-4bc6-8da2-f61747c37cae 1073741824" returned: 0 in 0.813s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:28:58 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-e6f2af28-ac5c-478f-9727-66ff83705bd7 tempest-CreateVolumesFromImageTest-1209047278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d66cce50-a9a3-4bc6-8da2-f61747c37cae {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:28:58 devstack sudo[107650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d66cce50-a9a3-4bc6-8da2-f61747c37cae Apr 29 15:28:58 devstack sudo[107650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:28:58 devstack sudo[107644]: pam_unix(sudo:session): session closed for user root Apr 29 15:28:58 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-01d65286-03d1-4b0d-8fa5-3bd61184c0f8 tempest-SnapshotDependencyTests-1747382522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-466b75db-d61b-4f23-8e00-dbecf3735975" returned: 0 in 0.718s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:28:58 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-01d65286-03d1-4b0d-8fa5-3bd61184c0f8 tempest-SnapshotDependencyTests-1747382522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-466b75db-d61b-4f23-8e00-dbecf3735975.10194f82-efa7-42da-9f60-774bd13b7edc {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:28:58 devstack sudo[107655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-466b75db-d61b-4f23-8e00-dbecf3735975.10194f82-efa7-42da-9f60-774bd13b7edc Apr 29 15:28:58 devstack sudo[107655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:28:59 devstack sudo[107650]: pam_unix(sudo:session): session closed for user root Apr 29 15:28:59 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-e6f2af28-ac5c-478f-9727-66ff83705bd7 tempest-CreateVolumesFromImageTest-1209047278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d66cce50-a9a3-4bc6-8da2-f61747c37cae" returned: 0 in 0.601s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:28:59 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-e6f2af28-ac5c-478f-9727-66ff83705bd7 tempest-CreateVolumesFromImageTest-1209047278 None] <== create_volume: return (1455ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:28:59 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-e6f2af28-ac5c-478f-9727-66ff83705bd7 tempest-CreateVolumesFromImageTest-1209047278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.459s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:28:59 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-a150d6d2-8944-4872-9234-36686ff84e8a tempest-CreateVolumesFromImageTest-1209047278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.359s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:28:59 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-a150d6d2-8944-4872-9234-36686ff84e8a tempest-CreateVolumesFromImageTest-1209047278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:28:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-117085980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41344185-a23c-4ddb-b21e-81e1bdebeae6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b5d7543f4a843ae8bca02183bcc6add',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:28:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:28:53Z,use_quota=True,user_id='b8c4fcfff43249deaec3a3fa53160c9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:28:59 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-a150d6d2-8944-4872-9234-36686ff84e8a tempest-CreateVolumesFromImageTest-1209047278 None] Creating volume 41344185-a23c-4ddb-b21e-81e1bdebeae6 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:28:59 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-a150d6d2-8944-4872-9234-36686ff84e8a tempest-CreateVolumesFromImageTest-1209047278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:28:59 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-a150d6d2-8944-4872-9234-36686ff84e8a tempest-CreateVolumesFromImageTest-1209047278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:28:59 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-a150d6d2-8944-4872-9234-36686ff84e8a tempest-CreateVolumesFromImageTest-1209047278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:28:59 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-a150d6d2-8944-4872-9234-36686ff84e8a tempest-CreateVolumesFromImageTest-1209047278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:28:59 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-a150d6d2-8944-4872-9234-36686ff84e8a tempest-CreateVolumesFromImageTest-1209047278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:28:59 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-a150d6d2-8944-4872-9234-36686ff84e8a tempest-CreateVolumesFromImageTest-1209047278 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:28:59 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-a150d6d2-8944-4872-9234-36686ff84e8a tempest-CreateVolumesFromImageTest-1209047278 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:28:59 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a150d6d2-8944-4872-9234-36686ff84e8a tempest-CreateVolumesFromImageTest-1209047278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-41344185-a23c-4ddb-b21e-81e1bdebeae6 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:28:59 devstack sudo[107658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-41344185-a23c-4ddb-b21e-81e1bdebeae6 1073741824 Apr 29 15:28:59 devstack sudo[107658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:28:59 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e6f2af28-ac5c-478f-9727-66ff83705bd7 tempest-CreateVolumesFromImageTest-1209047278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dce1a62d-e2e1-420d-b5b5-3457933a54f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d66cce50-a9a3-4bc6-8da2-f61747c37cae', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:28:59 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e6f2af28-ac5c-478f-9727-66ff83705bd7 tempest-CreateVolumesFromImageTest-1209047278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1d17e0b-d3c4-4892-ad5d-95267390b1d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:28:59 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-e6f2af28-ac5c-478f-9727-66ff83705bd7 tempest-CreateVolumesFromImageTest-1209047278 None] Volume volume-d66cce50-a9a3-4bc6-8da2-f61747c37cae (d66cce50-a9a3-4bc6-8da2-f61747c37cae): created successfully Apr 29 15:28:59 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e6f2af28-ac5c-478f-9727-66ff83705bd7 tempest-CreateVolumesFromImageTest-1209047278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1d17e0b-d3c4-4892-ad5d-95267390b1d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:28:59 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e6f2af28-ac5c-478f-9727-66ff83705bd7 tempest-CreateVolumesFromImageTest-1209047278 None] Flow 'volume_create_manager' (dbaaec7b-5e50-4ac6-a11c-1a0003418952) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:28:59 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-e6f2af28-ac5c-478f-9727-66ff83705bd7 tempest-CreateVolumesFromImageTest-1209047278 None] Created volume successfully. Apr 29 15:28:59 devstack sudo[107655]: pam_unix(sudo:session): session closed for user root Apr 29 15:28:59 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-01d65286-03d1-4b0d-8fa5-3bd61184c0f8 tempest-SnapshotDependencyTests-1747382522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-466b75db-d61b-4f23-8e00-dbecf3735975.10194f82-efa7-42da-9f60-774bd13b7edc" returned: 0 in 0.680s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:28:59 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-01d65286-03d1-4b0d-8fa5-3bd61184c0f8 tempest-SnapshotDependencyTests-1747382522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-466b75db-d61b-4f23-8e00-dbecf3735975.10194f82-efa7-42da-9f60-774bd13b7edc {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:28:59 devstack sudo[107663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-466b75db-d61b-4f23-8e00-dbecf3735975.10194f82-efa7-42da-9f60-774bd13b7edc Apr 29 15:28:59 devstack sudo[107663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:28:59 devstack sudo[107658]: pam_unix(sudo:session): session closed for user root Apr 29 15:28:59 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a150d6d2-8944-4872-9234-36686ff84e8a tempest-CreateVolumesFromImageTest-1209047278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-41344185-a23c-4ddb-b21e-81e1bdebeae6 1073741824" returned: 0 in 0.780s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:28:59 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a150d6d2-8944-4872-9234-36686ff84e8a tempest-CreateVolumesFromImageTest-1209047278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-41344185-a23c-4ddb-b21e-81e1bdebeae6 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:28:59 devstack sudo[107668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-41344185-a23c-4ddb-b21e-81e1bdebeae6 Apr 29 15:28:59 devstack sudo[107668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:29:00 devstack sudo[107663]: pam_unix(sudo:session): session closed for user root Apr 29 15:29:00 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-01d65286-03d1-4b0d-8fa5-3bd61184c0f8 tempest-SnapshotDependencyTests-1747382522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-466b75db-d61b-4f23-8e00-dbecf3735975.10194f82-efa7-42da-9f60-774bd13b7edc" returned: 0 in 0.629s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:29:00 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-01d65286-03d1-4b0d-8fa5-3bd61184c0f8 tempest-SnapshotDependencyTests-1747382522 None] Lock "cinder-quobyte-10194f82-efa7-42da-9f60-774bd13b7edc" released by "_delete_snapshot" :: held 2.877s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:29:00 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-01d65286-03d1-4b0d-8fa5-3bd61184c0f8 tempest-SnapshotDependencyTests-1747382522 None] Lock "cinder-quobyte-466b75db-d61b-4f23-8e00-dbecf3735975" released by "delete_snapshot" :: held 2.902s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:29:00 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-01d65286-03d1-4b0d-8fa5-3bd61184c0f8 tempest-SnapshotDependencyTests-1747382522 None] Created reservations ['cac0c5c1-6fef-4e42-8c1d-77dcc11f681c', '03436760-ca36-4838-87f2-8a3350bb672d', '60f95769-0877-419e-9cf1-faea8f2d3331', 'a0ba3e28-1582-465a-be11-7ad0a99868f5'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:29:00 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-01d65286-03d1-4b0d-8fa5-3bd61184c0f8 tempest-SnapshotDependencyTests-1747382522 None] Delete snapshot completed successfully. Apr 29 15:29:00 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-01d65286-03d1-4b0d-8fa5-3bd61184c0f8 tempest-SnapshotDependencyTests-1747382522 None] Lock "cinder-10194f82-efa7-42da-9f60-774bd13b7edc-delete_snapshot" released by "delete_snapshot" :: held 3.047s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:29:00 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-49273836-b950-4cc0-a3b6-8e6db6f60778 tempest-SnapshotDependencyTests-1747382522 None] Acquiring lock "cinder-466b75db-d61b-4f23-8e00-dbecf3735975-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:29:00 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-49273836-b950-4cc0-a3b6-8e6db6f60778 tempest-SnapshotDependencyTests-1747382522 None] Lock "cinder-466b75db-d61b-4f23-8e00-dbecf3735975-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:29:00 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-49273836-b950-4cc0-a3b6-8e6db6f60778 tempest-SnapshotDependencyTests-1747382522 None] Acquiring lock "cinder-quobyte-466b75db-d61b-4f23-8e00-dbecf3735975" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:29:00 devstack sudo[107668]: pam_unix(sudo:session): session closed for user root Apr 29 15:29:00 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a150d6d2-8944-4872-9234-36686ff84e8a tempest-CreateVolumesFromImageTest-1209047278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-41344185-a23c-4ddb-b21e-81e1bdebeae6" returned: 0 in 0.600s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:29:00 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-a150d6d2-8944-4872-9234-36686ff84e8a tempest-CreateVolumesFromImageTest-1209047278 None] <== create_volume: return (1436ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:29:00 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-a150d6d2-8944-4872-9234-36686ff84e8a tempest-CreateVolumesFromImageTest-1209047278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.439s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:29:00 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-cc211388-a067-45c5-b393-86b91bef7467 tempest-CreateVolumesFromImageTest-1209047278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.162s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:29:00 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-cc211388-a067-45c5-b393-86b91bef7467 tempest-CreateVolumesFromImageTest-1209047278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:28:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1305626576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc688e9a-a716-45c1-ad58-0288b8826835,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b5d7543f4a843ae8bca02183bcc6add',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:28:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:28:54Z,use_quota=True,user_id='b8c4fcfff43249deaec3a3fa53160c9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:29:00 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-cc211388-a067-45c5-b393-86b91bef7467 tempest-CreateVolumesFromImageTest-1209047278 None] Creating volume cc688e9a-a716-45c1-ad58-0288b8826835 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:29:00 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-cc211388-a067-45c5-b393-86b91bef7467 tempest-CreateVolumesFromImageTest-1209047278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:29:00 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-cc211388-a067-45c5-b393-86b91bef7467 tempest-CreateVolumesFromImageTest-1209047278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:29:00 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-cc211388-a067-45c5-b393-86b91bef7467 tempest-CreateVolumesFromImageTest-1209047278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:29:00 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-cc211388-a067-45c5-b393-86b91bef7467 tempest-CreateVolumesFromImageTest-1209047278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:29:00 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-cc211388-a067-45c5-b393-86b91bef7467 tempest-CreateVolumesFromImageTest-1209047278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:29:00 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-cc211388-a067-45c5-b393-86b91bef7467 tempest-CreateVolumesFromImageTest-1209047278 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:29:00 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-cc211388-a067-45c5-b393-86b91bef7467 tempest-CreateVolumesFromImageTest-1209047278 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:29:00 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cc211388-a067-45c5-b393-86b91bef7467 tempest-CreateVolumesFromImageTest-1209047278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cc688e9a-a716-45c1-ad58-0288b8826835 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:29:00 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-49273836-b950-4cc0-a3b6-8e6db6f60778 tempest-SnapshotDependencyTests-1747382522 None] Lock "cinder-quobyte-466b75db-d61b-4f23-8e00-dbecf3735975" acquired by "delete_volume" :: waited 0.037s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:29:00 devstack sudo[107672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cc688e9a-a716-45c1-ad58-0288b8826835 1073741824 Apr 29 15:29:00 devstack sudo[107672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:29:00 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-a150d6d2-8944-4872-9234-36686ff84e8a tempest-CreateVolumesFromImageTest-1209047278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acfab276-79ff-4167-958c-5366898dd8ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41344185-a23c-4ddb-b21e-81e1bdebeae6', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:29:00 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-a150d6d2-8944-4872-9234-36686ff84e8a tempest-CreateVolumesFromImageTest-1209047278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34bba360-94a8-47c9-acf7-c8758478ff68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:29:00 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc0ef5a-5c8d-4b30-9d80-22bb1997bf19]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:29:00 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-49273836-b950-4cc0-a3b6-8e6db6f60778 tempest-SnapshotDependencyTests-1747382522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-466b75db-d61b-4f23-8e00-dbecf3735975 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:29:00 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-a150d6d2-8944-4872-9234-36686ff84e8a tempest-CreateVolumesFromImageTest-1209047278 None] Volume volume-41344185-a23c-4ddb-b21e-81e1bdebeae6 (41344185-a23c-4ddb-b21e-81e1bdebeae6): created successfully Apr 29 15:29:00 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-a150d6d2-8944-4872-9234-36686ff84e8a tempest-CreateVolumesFromImageTest-1209047278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34bba360-94a8-47c9-acf7-c8758478ff68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:29:00 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-a150d6d2-8944-4872-9234-36686ff84e8a tempest-CreateVolumesFromImageTest-1209047278 None] Flow 'volume_create_manager' (c6e1eb6e-9acd-4531-809c-51a1fb8c1650) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:29:00 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-a150d6d2-8944-4872-9234-36686ff84e8a tempest-CreateVolumesFromImageTest-1209047278 None] Created volume successfully. Apr 29 15:29:00 devstack sudo[107674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-466b75db-d61b-4f23-8e00-dbecf3735975 Apr 29 15:29:00 devstack sudo[107674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:29:01 devstack sudo[107672]: pam_unix(sudo:session): session closed for user root Apr 29 15:29:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cc211388-a067-45c5-b393-86b91bef7467 tempest-CreateVolumesFromImageTest-1209047278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cc688e9a-a716-45c1-ad58-0288b8826835 1073741824" returned: 0 in 0.783s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:29:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cc211388-a067-45c5-b393-86b91bef7467 tempest-CreateVolumesFromImageTest-1209047278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cc688e9a-a716-45c1-ad58-0288b8826835 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:29:01 devstack sudo[107682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cc688e9a-a716-45c1-ad58-0288b8826835 Apr 29 15:29:01 devstack sudo[107674]: pam_unix(sudo:session): session closed for user root Apr 29 15:29:01 devstack sudo[107682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:29:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-49273836-b950-4cc0-a3b6-8e6db6f60778 tempest-SnapshotDependencyTests-1747382522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-466b75db-d61b-4f23-8e00-dbecf3735975" returned: 0 in 0.783s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:29:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-49273836-b950-4cc0-a3b6-8e6db6f60778 tempest-SnapshotDependencyTests-1747382522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-466b75db-d61b-4f23-8e00-dbecf3735975 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:29:01 devstack sudo[107684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-466b75db-d61b-4f23-8e00-dbecf3735975 Apr 29 15:29:01 devstack sudo[107684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:29:01 devstack sudo[107682]: pam_unix(sudo:session): session closed for user root Apr 29 15:29:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cc211388-a067-45c5-b393-86b91bef7467 tempest-CreateVolumesFromImageTest-1209047278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cc688e9a-a716-45c1-ad58-0288b8826835" returned: 0 in 0.606s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:29:01 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-cc211388-a067-45c5-b393-86b91bef7467 tempest-CreateVolumesFromImageTest-1209047278 None] <== create_volume: return (1428ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:29:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-cc211388-a067-45c5-b393-86b91bef7467 tempest-CreateVolumesFromImageTest-1209047278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.432s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:29:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-2f943df6-3b4c-4eba-95b5-e98d5c02c7b0 tempest-CreateVolumesFromImageTest-1209047278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.178s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:29:01 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-2f943df6-3b4c-4eba-95b5-e98d5c02c7b0 tempest-CreateVolumesFromImageTest-1209047278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:28:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1436503302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4033a18-0fe5-439a-86ff-b650bdcc7344,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b5d7543f4a843ae8bca02183bcc6add',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:28:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:28:55Z,use_quota=True,user_id='b8c4fcfff43249deaec3a3fa53160c9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:29:01 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-2f943df6-3b4c-4eba-95b5-e98d5c02c7b0 tempest-CreateVolumesFromImageTest-1209047278 None] Creating volume b4033a18-0fe5-439a-86ff-b650bdcc7344 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:29:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-2f943df6-3b4c-4eba-95b5-e98d5c02c7b0 tempest-CreateVolumesFromImageTest-1209047278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:29:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-2f943df6-3b4c-4eba-95b5-e98d5c02c7b0 tempest-CreateVolumesFromImageTest-1209047278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:29:01 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-2f943df6-3b4c-4eba-95b5-e98d5c02c7b0 tempest-CreateVolumesFromImageTest-1209047278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:29:01 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-2f943df6-3b4c-4eba-95b5-e98d5c02c7b0 tempest-CreateVolumesFromImageTest-1209047278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:29:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-2f943df6-3b4c-4eba-95b5-e98d5c02c7b0 tempest-CreateVolumesFromImageTest-1209047278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:29:01 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-2f943df6-3b4c-4eba-95b5-e98d5c02c7b0 tempest-CreateVolumesFromImageTest-1209047278 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:29:01 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-2f943df6-3b4c-4eba-95b5-e98d5c02c7b0 tempest-CreateVolumesFromImageTest-1209047278 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:29:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-2f943df6-3b4c-4eba-95b5-e98d5c02c7b0 tempest-CreateVolumesFromImageTest-1209047278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-b4033a18-0fe5-439a-86ff-b650bdcc7344 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:29:01 devstack sudo[107684]: pam_unix(sudo:session): session closed for user root Apr 29 15:29:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-49273836-b950-4cc0-a3b6-8e6db6f60778 tempest-SnapshotDependencyTests-1747382522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-466b75db-d61b-4f23-8e00-dbecf3735975" returned: 0 in 0.602s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:29:02 devstack sudo[107688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-b4033a18-0fe5-439a-86ff-b650bdcc7344 1073741824 Apr 29 15:29:02 devstack sudo[107688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:29:02 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-49273836-b950-4cc0-a3b6-8e6db6f60778 tempest-SnapshotDependencyTests-1747382522 None] Lock "cinder-quobyte-466b75db-d61b-4f23-8e00-dbecf3735975" released by "delete_volume" :: held 1.473s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:29:02 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cc211388-a067-45c5-b393-86b91bef7467 tempest-CreateVolumesFromImageTest-1209047278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9251f572-fc72-4e52-851c-e546f18034f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc688e9a-a716-45c1-ad58-0288b8826835', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:29:02 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cc211388-a067-45c5-b393-86b91bef7467 tempest-CreateVolumesFromImageTest-1209047278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1d2fb9d-2657-474b-86fd-c654a28a8972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:29:02 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-cc211388-a067-45c5-b393-86b91bef7467 tempest-CreateVolumesFromImageTest-1209047278 None] Volume volume-cc688e9a-a716-45c1-ad58-0288b8826835 (cc688e9a-a716-45c1-ad58-0288b8826835): created successfully Apr 29 15:29:02 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cc211388-a067-45c5-b393-86b91bef7467 tempest-CreateVolumesFromImageTest-1209047278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1d2fb9d-2657-474b-86fd-c654a28a8972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:29:02 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cc211388-a067-45c5-b393-86b91bef7467 tempest-CreateVolumesFromImageTest-1209047278 None] Flow 'volume_create_manager' (5a811fde-9961-48ec-8874-ef2de8df8605) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:29:02 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-cc211388-a067-45c5-b393-86b91bef7467 tempest-CreateVolumesFromImageTest-1209047278 None] Created volume successfully. Apr 29 15:29:02 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-49273836-b950-4cc0-a3b6-8e6db6f60778 tempest-SnapshotDependencyTests-1747382522 None] Created reservations ['10f2dd42-b5d4-41e0-aa2e-d4e0a8cdb88e', '0a80c2fc-ab9a-4e6d-8c51-e9118e14f95b', '49ecd9ec-2087-463d-bfa7-3440c4be1d4b', '605010f8-1fbe-444f-b702-6ffed43d7269'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:29:02 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-49273836-b950-4cc0-a3b6-8e6db6f60778 tempest-SnapshotDependencyTests-1747382522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:29:02 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-49273836-b950-4cc0-a3b6-8e6db6f60778 tempest-SnapshotDependencyTests-1747382522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:29:02 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-49273836-b950-4cc0-a3b6-8e6db6f60778 tempest-SnapshotDependencyTests-1747382522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:29:02 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-49273836-b950-4cc0-a3b6-8e6db6f60778 tempest-SnapshotDependencyTests-1747382522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:29:02 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-49273836-b950-4cc0-a3b6-8e6db6f60778 tempest-SnapshotDependencyTests-1747382522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:29:02 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-49273836-b950-4cc0-a3b6-8e6db6f60778 tempest-SnapshotDependencyTests-1747382522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:29:02 devstack sudo[107690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:29:02 devstack sudo[107690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:29:02 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-02c43f10-b34c-4281-8430-ed421da19853 tempest-SnapshotDependencyTests-1747382522 None] Acquiring lock "cinder-af7ef742-f976-4d09-833e-db8c55e2a60b-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:29:02 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-02c43f10-b34c-4281-8430-ed421da19853 tempest-SnapshotDependencyTests-1747382522 None] Lock "cinder-af7ef742-f976-4d09-833e-db8c55e2a60b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:29:02 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-02c43f10-b34c-4281-8430-ed421da19853 tempest-SnapshotDependencyTests-1747382522 None] Acquiring lock "cinder-quobyte-af7ef742-f976-4d09-833e-db8c55e2a60b" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:29:02 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-02c43f10-b34c-4281-8430-ed421da19853 tempest-SnapshotDependencyTests-1747382522 None] Lock "cinder-quobyte-af7ef742-f976-4d09-833e-db8c55e2a60b" acquired by "delete_volume" :: waited 0.017s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:29:02 devstack sudo[107690]: pam_unix(sudo:session): session closed for user root Apr 29 15:29:02 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-49273836-b950-4cc0-a3b6-8e6db6f60778 tempest-SnapshotDependencyTests-1747382522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.616s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:29:02 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-49273836-b950-4cc0-a3b6-8e6db6f60778 tempest-SnapshotDependencyTests-1747382522 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:29:02 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af0dcaf-6b3d-4e54-bda1-deed01fa17ee]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:29:02 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-02c43f10-b34c-4281-8430-ed421da19853 tempest-SnapshotDependencyTests-1747382522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-af7ef742-f976-4d09-833e-db8c55e2a60b {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:29:02 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-49273836-b950-4cc0-a3b6-8e6db6f60778 tempest-SnapshotDependencyTests-1747382522 None] Deleted volume successfully. Apr 29 15:29:02 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-49273836-b950-4cc0-a3b6-8e6db6f60778 tempest-SnapshotDependencyTests-1747382522 None] Lock "cinder-466b75db-d61b-4f23-8e00-dbecf3735975-delete_volume" released by "delete_volume" :: held 2.342s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:29:02 devstack sudo[107688]: pam_unix(sudo:session): session closed for user root Apr 29 15:29:02 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-2f943df6-3b4c-4eba-95b5-e98d5c02c7b0 tempest-CreateVolumesFromImageTest-1209047278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-b4033a18-0fe5-439a-86ff-b650bdcc7344 1073741824" returned: 0 in 0.860s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:29:02 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-2f943df6-3b4c-4eba-95b5-e98d5c02c7b0 tempest-CreateVolumesFromImageTest-1209047278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-b4033a18-0fe5-439a-86ff-b650bdcc7344 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:29:02 devstack sudo[107696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-af7ef742-f976-4d09-833e-db8c55e2a60b Apr 29 15:29:02 devstack sudo[107696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:29:02 devstack sudo[107697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-b4033a18-0fe5-439a-86ff-b650bdcc7344 Apr 29 15:29:02 devstack sudo[107697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:29:03 devstack sudo[107697]: pam_unix(sudo:session): session closed for user root Apr 29 15:29:03 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-2f943df6-3b4c-4eba-95b5-e98d5c02c7b0 tempest-CreateVolumesFromImageTest-1209047278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-b4033a18-0fe5-439a-86ff-b650bdcc7344" returned: 0 in 0.604s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:29:03 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-2f943df6-3b4c-4eba-95b5-e98d5c02c7b0 tempest-CreateVolumesFromImageTest-1209047278 None] <== create_volume: return (1509ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:29:03 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-2f943df6-3b4c-4eba-95b5-e98d5c02c7b0 tempest-CreateVolumesFromImageTest-1209047278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.514s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:29:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-2f943df6-3b4c-4eba-95b5-e98d5c02c7b0 tempest-CreateVolumesFromImageTest-1209047278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eba1a978-f83f-41ce-b3ef-2a2794902a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4033a18-0fe5-439a-86ff-b650bdcc7344', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:29:03 devstack sudo[107696]: pam_unix(sudo:session): session closed for user root Apr 29 15:29:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-2f943df6-3b4c-4eba-95b5-e98d5c02c7b0 tempest-CreateVolumesFromImageTest-1209047278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16ab2a25-1fee-4fce-8702-124363905565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:29:03 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-02c43f10-b34c-4281-8430-ed421da19853 tempest-SnapshotDependencyTests-1747382522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-af7ef742-f976-4d09-833e-db8c55e2a60b" returned: 0 in 0.724s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:29:03 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-02c43f10-b34c-4281-8430-ed421da19853 tempest-SnapshotDependencyTests-1747382522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-af7ef742-f976-4d09-833e-db8c55e2a60b {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:29:03 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-2f943df6-3b4c-4eba-95b5-e98d5c02c7b0 tempest-CreateVolumesFromImageTest-1209047278 None] Volume volume-b4033a18-0fe5-439a-86ff-b650bdcc7344 (b4033a18-0fe5-439a-86ff-b650bdcc7344): created successfully Apr 29 15:29:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-2f943df6-3b4c-4eba-95b5-e98d5c02c7b0 tempest-CreateVolumesFromImageTest-1209047278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16ab2a25-1fee-4fce-8702-124363905565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:29:03 devstack sudo[107704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-af7ef742-f976-4d09-833e-db8c55e2a60b Apr 29 15:29:03 devstack sudo[107704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:29:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-2f943df6-3b4c-4eba-95b5-e98d5c02c7b0 tempest-CreateVolumesFromImageTest-1209047278 None] Flow 'volume_create_manager' (26e83cce-914c-4c3f-ba74-7ea45dfe004c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:29:03 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-2f943df6-3b4c-4eba-95b5-e98d5c02c7b0 tempest-CreateVolumesFromImageTest-1209047278 None] Created volume successfully. Apr 29 15:29:04 devstack sudo[107704]: pam_unix(sudo:session): session closed for user root Apr 29 15:29:04 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-02c43f10-b34c-4281-8430-ed421da19853 tempest-SnapshotDependencyTests-1747382522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-af7ef742-f976-4d09-833e-db8c55e2a60b" returned: 0 in 0.583s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:29:04 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-02c43f10-b34c-4281-8430-ed421da19853 tempest-SnapshotDependencyTests-1747382522 None] Lock "cinder-quobyte-af7ef742-f976-4d09-833e-db8c55e2a60b" released by "delete_volume" :: held 1.348s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:29:04 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-02c43f10-b34c-4281-8430-ed421da19853 tempest-SnapshotDependencyTests-1747382522 None] Created reservations ['92a6198f-f639-467c-85af-cf90339e9ca8', 'af464ca8-42bd-4078-93d3-9052bb03230a', '390e6798-268d-4acd-9e55-e99b0313df84', '112dbc9c-5523-45ae-8378-60228761053b'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:29:04 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-02c43f10-b34c-4281-8430-ed421da19853 tempest-SnapshotDependencyTests-1747382522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:29:04 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-02c43f10-b34c-4281-8430-ed421da19853 tempest-SnapshotDependencyTests-1747382522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:29:04 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-02c43f10-b34c-4281-8430-ed421da19853 tempest-SnapshotDependencyTests-1747382522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:29:04 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-02c43f10-b34c-4281-8430-ed421da19853 tempest-SnapshotDependencyTests-1747382522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:29:04 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-02c43f10-b34c-4281-8430-ed421da19853 tempest-SnapshotDependencyTests-1747382522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:29:04 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-02c43f10-b34c-4281-8430-ed421da19853 tempest-SnapshotDependencyTests-1747382522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:29:04 devstack sudo[107707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:29:04 devstack sudo[107707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:29:04 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-93903a11-360d-4092-8879-97b4fe3348ea tempest-CreateVolumesFromImageTest-1209047278 None] Acquiring lock "cinder-b4033a18-0fe5-439a-86ff-b650bdcc7344-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:29:04 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-93903a11-360d-4092-8879-97b4fe3348ea tempest-CreateVolumesFromImageTest-1209047278 None] Lock "cinder-b4033a18-0fe5-439a-86ff-b650bdcc7344-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:29:04 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-93903a11-360d-4092-8879-97b4fe3348ea tempest-CreateVolumesFromImageTest-1209047278 None] Acquiring lock "cinder-quobyte-b4033a18-0fe5-439a-86ff-b650bdcc7344" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:29:04 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-93903a11-360d-4092-8879-97b4fe3348ea tempest-CreateVolumesFromImageTest-1209047278 None] Lock "cinder-quobyte-b4033a18-0fe5-439a-86ff-b650bdcc7344" acquired by "delete_volume" :: waited 0.015s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:29:04 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e2cca8-7001-44d2-a0bc-827e9181f3ea]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:29:04 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-93903a11-360d-4092-8879-97b4fe3348ea tempest-CreateVolumesFromImageTest-1209047278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-b4033a18-0fe5-439a-86ff-b650bdcc7344 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:29:04 devstack sudo[107709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-b4033a18-0fe5-439a-86ff-b650bdcc7344 Apr 29 15:29:04 devstack sudo[107709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:29:04 devstack sudo[107707]: pam_unix(sudo:session): session closed for user root Apr 29 15:29:04 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-02c43f10-b34c-4281-8430-ed421da19853 tempest-SnapshotDependencyTests-1747382522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.599s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:29:04 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-02c43f10-b34c-4281-8430-ed421da19853 tempest-SnapshotDependencyTests-1747382522 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:29:04 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-02c43f10-b34c-4281-8430-ed421da19853 tempest-SnapshotDependencyTests-1747382522 None] Deleted volume successfully. Apr 29 15:29:04 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-02c43f10-b34c-4281-8430-ed421da19853 tempest-SnapshotDependencyTests-1747382522 None] Lock "cinder-af7ef742-f976-4d09-833e-db8c55e2a60b-delete_volume" released by "delete_volume" :: held 2.144s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:29:05 devstack sudo[107709]: pam_unix(sudo:session): session closed for user root Apr 29 15:29:05 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-93903a11-360d-4092-8879-97b4fe3348ea tempest-CreateVolumesFromImageTest-1209047278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-b4033a18-0fe5-439a-86ff-b650bdcc7344" returned: 0 in 0.737s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:29:05 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-93903a11-360d-4092-8879-97b4fe3348ea tempest-CreateVolumesFromImageTest-1209047278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-b4033a18-0fe5-439a-86ff-b650bdcc7344 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:29:05 devstack sudo[107715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-b4033a18-0fe5-439a-86ff-b650bdcc7344 Apr 29 15:29:05 devstack sudo[107715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:29:05 devstack sudo[107715]: pam_unix(sudo:session): session closed for user root Apr 29 15:29:05 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-93903a11-360d-4092-8879-97b4fe3348ea tempest-CreateVolumesFromImageTest-1209047278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-b4033a18-0fe5-439a-86ff-b650bdcc7344" returned: 0 in 0.631s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:29:05 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-93903a11-360d-4092-8879-97b4fe3348ea tempest-CreateVolumesFromImageTest-1209047278 None] Lock "cinder-quobyte-b4033a18-0fe5-439a-86ff-b650bdcc7344" released by "delete_volume" :: held 1.415s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:29:05 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-93903a11-360d-4092-8879-97b4fe3348ea tempest-CreateVolumesFromImageTest-1209047278 None] Created reservations ['1585a3c7-1bb8-47c6-b1a3-3a8e9ae33e54', '6c91bf05-354d-438b-bc84-28c0acf0db09', '0623a960-c5c3-409f-a2ce-f417ba603304', '792ea97b-9043-42e9-b1a7-5ad940c158a4'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:29:05 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-93903a11-360d-4092-8879-97b4fe3348ea tempest-CreateVolumesFromImageTest-1209047278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:29:05 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-93903a11-360d-4092-8879-97b4fe3348ea tempest-CreateVolumesFromImageTest-1209047278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:29:05 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-93903a11-360d-4092-8879-97b4fe3348ea tempest-CreateVolumesFromImageTest-1209047278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:29:05 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-93903a11-360d-4092-8879-97b4fe3348ea tempest-CreateVolumesFromImageTest-1209047278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:29:05 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-93903a11-360d-4092-8879-97b4fe3348ea tempest-CreateVolumesFromImageTest-1209047278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:29:05 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-93903a11-360d-4092-8879-97b4fe3348ea tempest-CreateVolumesFromImageTest-1209047278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:29:06 devstack sudo[107719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:29:06 devstack sudo[107719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:29:06 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-85dfd3de-e910-4bce-b1f8-9364db606beb tempest-CreateVolumesFromImageTest-1209047278 None] Acquiring lock "cinder-cc688e9a-a716-45c1-ad58-0288b8826835-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:29:06 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-85dfd3de-e910-4bce-b1f8-9364db606beb tempest-CreateVolumesFromImageTest-1209047278 None] Lock "cinder-cc688e9a-a716-45c1-ad58-0288b8826835-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:29:06 devstack sudo[107719]: pam_unix(sudo:session): session closed for user root Apr 29 15:29:06 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-93903a11-360d-4092-8879-97b4fe3348ea tempest-CreateVolumesFromImageTest-1209047278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.674s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:29:06 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-93903a11-360d-4092-8879-97b4fe3348ea tempest-CreateVolumesFromImageTest-1209047278 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:29:06 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-93903a11-360d-4092-8879-97b4fe3348ea tempest-CreateVolumesFromImageTest-1209047278 None] Deleted volume successfully. Apr 29 15:29:06 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-85dfd3de-e910-4bce-b1f8-9364db606beb tempest-CreateVolumesFromImageTest-1209047278 None] Acquiring lock "cinder-quobyte-cc688e9a-a716-45c1-ad58-0288b8826835" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:29:06 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-93903a11-360d-4092-8879-97b4fe3348ea tempest-CreateVolumesFromImageTest-1209047278 None] Lock "cinder-b4033a18-0fe5-439a-86ff-b650bdcc7344-delete_volume" released by "delete_volume" :: held 2.300s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:29:06 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-85dfd3de-e910-4bce-b1f8-9364db606beb tempest-CreateVolumesFromImageTest-1209047278 None] Lock "cinder-quobyte-cc688e9a-a716-45c1-ad58-0288b8826835" acquired by "delete_volume" :: waited 0.021s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:29:06 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[530711c0-af61-4179-b8fc-f94834bddb5c]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:29:06 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-85dfd3de-e910-4bce-b1f8-9364db606beb tempest-CreateVolumesFromImageTest-1209047278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cc688e9a-a716-45c1-ad58-0288b8826835 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:29:06 devstack sudo[107723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cc688e9a-a716-45c1-ad58-0288b8826835 Apr 29 15:29:06 devstack sudo[107723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:29:07 devstack sudo[107723]: pam_unix(sudo:session): session closed for user root Apr 29 15:29:07 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-85dfd3de-e910-4bce-b1f8-9364db606beb tempest-CreateVolumesFromImageTest-1209047278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cc688e9a-a716-45c1-ad58-0288b8826835" returned: 0 in 0.769s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:29:07 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-85dfd3de-e910-4bce-b1f8-9364db606beb tempest-CreateVolumesFromImageTest-1209047278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cc688e9a-a716-45c1-ad58-0288b8826835 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:29:07 devstack sudo[107728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cc688e9a-a716-45c1-ad58-0288b8826835 Apr 29 15:29:07 devstack sudo[107728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:29:08 devstack sudo[107728]: pam_unix(sudo:session): session closed for user root Apr 29 15:29:08 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-85dfd3de-e910-4bce-b1f8-9364db606beb tempest-CreateVolumesFromImageTest-1209047278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cc688e9a-a716-45c1-ad58-0288b8826835" returned: 0 in 0.674s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:29:08 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-85dfd3de-e910-4bce-b1f8-9364db606beb tempest-CreateVolumesFromImageTest-1209047278 None] Lock "cinder-quobyte-cc688e9a-a716-45c1-ad58-0288b8826835" released by "delete_volume" :: held 1.490s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:29:08 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-85dfd3de-e910-4bce-b1f8-9364db606beb tempest-CreateVolumesFromImageTest-1209047278 None] Created reservations ['51b60a4f-c2d8-4855-93a3-140c02e54095', 'a793e739-009b-44a1-92f4-64ab3f3987bc', '691e455d-5add-4280-ac24-738491899306', 'dd530f3c-7ee5-4739-9d81-92eca6038552'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:29:08 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-85dfd3de-e910-4bce-b1f8-9364db606beb tempest-CreateVolumesFromImageTest-1209047278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:29:08 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-85dfd3de-e910-4bce-b1f8-9364db606beb tempest-CreateVolumesFromImageTest-1209047278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:29:08 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-85dfd3de-e910-4bce-b1f8-9364db606beb tempest-CreateVolumesFromImageTest-1209047278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:29:08 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-85dfd3de-e910-4bce-b1f8-9364db606beb tempest-CreateVolumesFromImageTest-1209047278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:29:08 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-85dfd3de-e910-4bce-b1f8-9364db606beb tempest-CreateVolumesFromImageTest-1209047278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:29:08 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-85dfd3de-e910-4bce-b1f8-9364db606beb tempest-CreateVolumesFromImageTest-1209047278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:29:08 devstack sudo[107731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:29:08 devstack sudo[107731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:29:08 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-60bf7558-5809-4fa3-a23f-49d582a64a7f tempest-CreateVolumesFromImageTest-1209047278 None] Acquiring lock "cinder-41344185-a23c-4ddb-b21e-81e1bdebeae6-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:29:08 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-60bf7558-5809-4fa3-a23f-49d582a64a7f tempest-CreateVolumesFromImageTest-1209047278 None] Lock "cinder-41344185-a23c-4ddb-b21e-81e1bdebeae6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:29:08 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-60bf7558-5809-4fa3-a23f-49d582a64a7f tempest-CreateVolumesFromImageTest-1209047278 None] Acquiring lock "cinder-quobyte-41344185-a23c-4ddb-b21e-81e1bdebeae6" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:29:08 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-60bf7558-5809-4fa3-a23f-49d582a64a7f tempest-CreateVolumesFromImageTest-1209047278 None] Lock "cinder-quobyte-41344185-a23c-4ddb-b21e-81e1bdebeae6" acquired by "delete_volume" :: waited 0.019s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:29:09 devstack sudo[107731]: pam_unix(sudo:session): session closed for user root Apr 29 15:29:09 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-85dfd3de-e910-4bce-b1f8-9364db606beb tempest-CreateVolumesFromImageTest-1209047278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.687s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:29:09 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-85dfd3de-e910-4bce-b1f8-9364db606beb tempest-CreateVolumesFromImageTest-1209047278 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:29:09 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0c0ce0-40aa-4b5d-b14c-4cf4f0978896]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:29:09 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-60bf7558-5809-4fa3-a23f-49d582a64a7f tempest-CreateVolumesFromImageTest-1209047278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-41344185-a23c-4ddb-b21e-81e1bdebeae6 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:29:09 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-85dfd3de-e910-4bce-b1f8-9364db606beb tempest-CreateVolumesFromImageTest-1209047278 None] Deleted volume successfully. Apr 29 15:29:09 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-85dfd3de-e910-4bce-b1f8-9364db606beb tempest-CreateVolumesFromImageTest-1209047278 None] Lock "cinder-cc688e9a-a716-45c1-ad58-0288b8826835-delete_volume" released by "delete_volume" :: held 2.419s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:29:09 devstack sudo[107735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-41344185-a23c-4ddb-b21e-81e1bdebeae6 Apr 29 15:29:09 devstack sudo[107735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:29:09 devstack sudo[107735]: pam_unix(sudo:session): session closed for user root Apr 29 15:29:09 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-60bf7558-5809-4fa3-a23f-49d582a64a7f tempest-CreateVolumesFromImageTest-1209047278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-41344185-a23c-4ddb-b21e-81e1bdebeae6" returned: 0 in 0.725s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:29:09 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-60bf7558-5809-4fa3-a23f-49d582a64a7f tempest-CreateVolumesFromImageTest-1209047278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-41344185-a23c-4ddb-b21e-81e1bdebeae6 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:29:09 devstack sudo[107740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-41344185-a23c-4ddb-b21e-81e1bdebeae6 Apr 29 15:29:09 devstack sudo[107740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:29:10 devstack sudo[107740]: pam_unix(sudo:session): session closed for user root Apr 29 15:29:10 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-60bf7558-5809-4fa3-a23f-49d582a64a7f tempest-CreateVolumesFromImageTest-1209047278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-41344185-a23c-4ddb-b21e-81e1bdebeae6" returned: 0 in 0.667s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:29:10 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-60bf7558-5809-4fa3-a23f-49d582a64a7f tempest-CreateVolumesFromImageTest-1209047278 None] Lock "cinder-quobyte-41344185-a23c-4ddb-b21e-81e1bdebeae6" released by "delete_volume" :: held 1.450s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:29:10 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-60bf7558-5809-4fa3-a23f-49d582a64a7f tempest-CreateVolumesFromImageTest-1209047278 None] Created reservations ['a7f1629e-49c5-46f8-a822-8c7de65e0ecc', '02f4ad57-9cf3-4285-b30a-b28ec8717474', 'c5c25e70-c362-4509-9efb-90be44b8dbb1', '4aca75a3-42aa-4d3a-ba08-ec7d84309e0b'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:29:10 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-60bf7558-5809-4fa3-a23f-49d582a64a7f tempest-CreateVolumesFromImageTest-1209047278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:29:10 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-60bf7558-5809-4fa3-a23f-49d582a64a7f tempest-CreateVolumesFromImageTest-1209047278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:29:10 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-60bf7558-5809-4fa3-a23f-49d582a64a7f tempest-CreateVolumesFromImageTest-1209047278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:29:10 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-60bf7558-5809-4fa3-a23f-49d582a64a7f tempest-CreateVolumesFromImageTest-1209047278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:29:10 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-60bf7558-5809-4fa3-a23f-49d582a64a7f tempest-CreateVolumesFromImageTest-1209047278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:29:10 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-60bf7558-5809-4fa3-a23f-49d582a64a7f tempest-CreateVolumesFromImageTest-1209047278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:29:10 devstack sudo[107744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:29:10 devstack sudo[107744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:29:11 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-001a9ee2-e7fa-4e88-b47d-fb16119daadb tempest-CreateVolumesFromImageTest-1209047278 None] Acquiring lock "cinder-d66cce50-a9a3-4bc6-8da2-f61747c37cae-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:29:11 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-001a9ee2-e7fa-4e88-b47d-fb16119daadb tempest-CreateVolumesFromImageTest-1209047278 None] Lock "cinder-d66cce50-a9a3-4bc6-8da2-f61747c37cae-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:29:11 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-001a9ee2-e7fa-4e88-b47d-fb16119daadb tempest-CreateVolumesFromImageTest-1209047278 None] Acquiring lock "cinder-quobyte-d66cce50-a9a3-4bc6-8da2-f61747c37cae" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:29:11 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-001a9ee2-e7fa-4e88-b47d-fb16119daadb tempest-CreateVolumesFromImageTest-1209047278 None] Lock "cinder-quobyte-d66cce50-a9a3-4bc6-8da2-f61747c37cae" acquired by "delete_volume" :: waited 0.027s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:29:11 devstack sudo[107744]: pam_unix(sudo:session): session closed for user root Apr 29 15:29:11 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-60bf7558-5809-4fa3-a23f-49d582a64a7f tempest-CreateVolumesFromImageTest-1209047278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.789s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:29:11 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-60bf7558-5809-4fa3-a23f-49d582a64a7f tempest-CreateVolumesFromImageTest-1209047278 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:29:11 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-60bf7558-5809-4fa3-a23f-49d582a64a7f tempest-CreateVolumesFromImageTest-1209047278 None] Deleted volume successfully. Apr 29 15:29:11 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[501816bb-7cee-450b-8d68-806b83b030e7]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:29:11 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-001a9ee2-e7fa-4e88-b47d-fb16119daadb tempest-CreateVolumesFromImageTest-1209047278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d66cce50-a9a3-4bc6-8da2-f61747c37cae {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:29:11 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-60bf7558-5809-4fa3-a23f-49d582a64a7f tempest-CreateVolumesFromImageTest-1209047278 None] Lock "cinder-41344185-a23c-4ddb-b21e-81e1bdebeae6-delete_volume" released by "delete_volume" :: held 2.506s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:29:11 devstack sudo[107747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d66cce50-a9a3-4bc6-8da2-f61747c37cae Apr 29 15:29:11 devstack sudo[107747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:29:12 devstack sudo[107747]: pam_unix(sudo:session): session closed for user root Apr 29 15:29:12 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-001a9ee2-e7fa-4e88-b47d-fb16119daadb tempest-CreateVolumesFromImageTest-1209047278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d66cce50-a9a3-4bc6-8da2-f61747c37cae" returned: 0 in 0.851s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:29:12 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-001a9ee2-e7fa-4e88-b47d-fb16119daadb tempest-CreateVolumesFromImageTest-1209047278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d66cce50-a9a3-4bc6-8da2-f61747c37cae {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:29:12 devstack sudo[107753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d66cce50-a9a3-4bc6-8da2-f61747c37cae Apr 29 15:29:12 devstack sudo[107753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:29:12 devstack sudo[107753]: pam_unix(sudo:session): session closed for user root Apr 29 15:29:12 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-001a9ee2-e7fa-4e88-b47d-fb16119daadb tempest-CreateVolumesFromImageTest-1209047278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d66cce50-a9a3-4bc6-8da2-f61747c37cae" returned: 0 in 0.655s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:29:12 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-001a9ee2-e7fa-4e88-b47d-fb16119daadb tempest-CreateVolumesFromImageTest-1209047278 None] Lock "cinder-quobyte-d66cce50-a9a3-4bc6-8da2-f61747c37cae" released by "delete_volume" :: held 1.599s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:29:12 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-001a9ee2-e7fa-4e88-b47d-fb16119daadb tempest-CreateVolumesFromImageTest-1209047278 None] Created reservations ['b66ea494-b0a3-436e-b81a-6644a7f12bf7', '67bb3ce8-4dcf-4da3-a5e7-c735f07c530c', 'eb71cb0c-ad08-47f3-8e61-e1aab805d5f9', 'c07b9bcf-5f36-453a-9668-6db32fa20b79'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:29:13 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-001a9ee2-e7fa-4e88-b47d-fb16119daadb tempest-CreateVolumesFromImageTest-1209047278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:29:13 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-001a9ee2-e7fa-4e88-b47d-fb16119daadb tempest-CreateVolumesFromImageTest-1209047278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:29:13 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-001a9ee2-e7fa-4e88-b47d-fb16119daadb tempest-CreateVolumesFromImageTest-1209047278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:29:13 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-001a9ee2-e7fa-4e88-b47d-fb16119daadb tempest-CreateVolumesFromImageTest-1209047278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:29:13 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-001a9ee2-e7fa-4e88-b47d-fb16119daadb tempest-CreateVolumesFromImageTest-1209047278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:29:13 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-001a9ee2-e7fa-4e88-b47d-fb16119daadb tempest-CreateVolumesFromImageTest-1209047278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:29:13 devstack sudo[107756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:29:13 devstack sudo[107756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:29:13 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-fd67fa64-ffb6-408b-b39e-19f416626d36 tempest-CreateVolumesFromImageTest-1209047278 None] Acquiring lock "cinder-4f041097-789c-46df-bba6-ab8e98fd467c-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:29:13 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-fd67fa64-ffb6-408b-b39e-19f416626d36 tempest-CreateVolumesFromImageTest-1209047278 None] Lock "cinder-4f041097-789c-46df-bba6-ab8e98fd467c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:29:13 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-fd67fa64-ffb6-408b-b39e-19f416626d36 tempest-CreateVolumesFromImageTest-1209047278 None] Acquiring lock "cinder-quobyte-4f041097-789c-46df-bba6-ab8e98fd467c" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:29:13 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-fd67fa64-ffb6-408b-b39e-19f416626d36 tempest-CreateVolumesFromImageTest-1209047278 None] Lock "cinder-quobyte-4f041097-789c-46df-bba6-ab8e98fd467c" acquired by "delete_volume" :: waited 0.031s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:29:13 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e2e5c4-38c2-44a5-bd11-ea8677693a5e]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:29:13 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-fd67fa64-ffb6-408b-b39e-19f416626d36 tempest-CreateVolumesFromImageTest-1209047278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4f041097-789c-46df-bba6-ab8e98fd467c {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:29:13 devstack sudo[107756]: pam_unix(sudo:session): session closed for user root Apr 29 15:29:13 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-001a9ee2-e7fa-4e88-b47d-fb16119daadb tempest-CreateVolumesFromImageTest-1209047278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.848s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:29:13 devstack sudo[107758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4f041097-789c-46df-bba6-ab8e98fd467c Apr 29 15:29:13 devstack sudo[107758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:29:13 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-001a9ee2-e7fa-4e88-b47d-fb16119daadb tempest-CreateVolumesFromImageTest-1209047278 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:29:13 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-001a9ee2-e7fa-4e88-b47d-fb16119daadb tempest-CreateVolumesFromImageTest-1209047278 None] Deleted volume successfully. Apr 29 15:29:13 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-001a9ee2-e7fa-4e88-b47d-fb16119daadb tempest-CreateVolumesFromImageTest-1209047278 None] Lock "cinder-d66cce50-a9a3-4bc6-8da2-f61747c37cae-delete_volume" released by "delete_volume" :: held 2.753s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:29:14 devstack sudo[107758]: pam_unix(sudo:session): session closed for user root Apr 29 15:29:14 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-fd67fa64-ffb6-408b-b39e-19f416626d36 tempest-CreateVolumesFromImageTest-1209047278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4f041097-789c-46df-bba6-ab8e98fd467c" returned: 0 in 0.940s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:29:14 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-fd67fa64-ffb6-408b-b39e-19f416626d36 tempest-CreateVolumesFromImageTest-1209047278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4f041097-789c-46df-bba6-ab8e98fd467c {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:29:14 devstack sudo[107780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4f041097-789c-46df-bba6-ab8e98fd467c Apr 29 15:29:14 devstack sudo[107780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:29:15 devstack sudo[107780]: pam_unix(sudo:session): session closed for user root Apr 29 15:29:15 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-fd67fa64-ffb6-408b-b39e-19f416626d36 tempest-CreateVolumesFromImageTest-1209047278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-4f041097-789c-46df-bba6-ab8e98fd467c" returned: 0 in 0.684s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:29:15 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-fd67fa64-ffb6-408b-b39e-19f416626d36 tempest-CreateVolumesFromImageTest-1209047278 None] Lock "cinder-quobyte-4f041097-789c-46df-bba6-ab8e98fd467c" released by "delete_volume" :: held 1.696s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:29:15 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-fd67fa64-ffb6-408b-b39e-19f416626d36 tempest-CreateVolumesFromImageTest-1209047278 None] Created reservations ['49f7daf8-bb09-4f02-ae0d-0d6b84442dff', '384aa1a4-9c0e-434c-a391-6f97a55208bc', '43bb0283-f6ed-438a-b95d-b3b4d3bd361a', 'ffef2e78-ff69-4593-910a-54f2e56dce94'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:29:15 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-fd67fa64-ffb6-408b-b39e-19f416626d36 tempest-CreateVolumesFromImageTest-1209047278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:29:15 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-fd67fa64-ffb6-408b-b39e-19f416626d36 tempest-CreateVolumesFromImageTest-1209047278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:29:15 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-fd67fa64-ffb6-408b-b39e-19f416626d36 tempest-CreateVolumesFromImageTest-1209047278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:29:15 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-fd67fa64-ffb6-408b-b39e-19f416626d36 tempest-CreateVolumesFromImageTest-1209047278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:29:15 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-fd67fa64-ffb6-408b-b39e-19f416626d36 tempest-CreateVolumesFromImageTest-1209047278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:29:15 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-fd67fa64-ffb6-408b-b39e-19f416626d36 tempest-CreateVolumesFromImageTest-1209047278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:29:15 devstack sudo[107784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:29:15 devstack sudo[107784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:29:15 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-338c91b4-4868-4fab-b80b-06614c9ad36d req-ff935a4a-e8a1-477a-81dc-f81a1ab5f15c tempest-ServerRescueNegativeTestJSON-1253271205 None] Terminate volume connection completed successfully. Apr 29 15:29:15 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-338c91b4-4868-4fab-b80b-06614c9ad36d req-ff935a4a-e8a1-477a-81dc-f81a1ab5f15c tempest-ServerRescueNegativeTestJSON-1253271205 None] Deleting attachment ebabfe63-ddc2-4f24-8eea-83438213f98a. {{(pid=84448) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 15:29:16 devstack sudo[107784]: pam_unix(sudo:session): session closed for user root Apr 29 15:29:16 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-fd67fa64-ffb6-408b-b39e-19f416626d36 tempest-CreateVolumesFromImageTest-1209047278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.592s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:29:16 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-fd67fa64-ffb6-408b-b39e-19f416626d36 tempest-CreateVolumesFromImageTest-1209047278 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:29:16 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-fd67fa64-ffb6-408b-b39e-19f416626d36 tempest-CreateVolumesFromImageTest-1209047278 None] Deleted volume successfully. Apr 29 15:29:16 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-fd67fa64-ffb6-408b-b39e-19f416626d36 tempest-CreateVolumesFromImageTest-1209047278 None] Lock "cinder-4f041097-789c-46df-bba6-ab8e98fd467c-delete_volume" released by "delete_volume" :: held 2.546s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:29:18 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbaec6da-06b6-4eaf-b6a9-04efc4817c8d tempest-CreateVolumesFromSnapshotTest-1901764630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:29:18 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cbaec6da-06b6-4eaf-b6a9-04efc4817c8d tempest-CreateVolumesFromSnapshotTest-1901764630 None] Flow 'volume_create_manager' (f3cdaf87-9657-4eb8-b769-fea4db605175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:29:18 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cbaec6da-06b6-4eaf-b6a9-04efc4817c8d tempest-CreateVolumesFromSnapshotTest-1901764630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f78fd1e8-2cab-4443-bc69-22a1f6f6547b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:29:18 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cbaec6da-06b6-4eaf-b6a9-04efc4817c8d tempest-CreateVolumesFromSnapshotTest-1901764630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f78fd1e8-2cab-4443-bc69-22a1f6f6547b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:29:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1115101987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd9a5c34-8aa5-45b2-b032-f3c4aa364a9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f46a492915414787b65e7d3929f18cff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:29:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:29:18Z,use_quota=True,user_id='de82e028a0c34615ab390bc64d8aa985',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:29:18 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cbaec6da-06b6-4eaf-b6a9-04efc4817c8d tempest-CreateVolumesFromSnapshotTest-1901764630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf9e52e9-4c25-46b7-a1fe-45c36780c913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:29:18 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cbaec6da-06b6-4eaf-b6a9-04efc4817c8d tempest-CreateVolumesFromSnapshotTest-1901764630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf9e52e9-4c25-46b7-a1fe-45c36780c913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:29:18 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cbaec6da-06b6-4eaf-b6a9-04efc4817c8d tempest-CreateVolumesFromSnapshotTest-1901764630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e180031-d839-49cd-b448-31b1b67a4c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:29:18 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cbaec6da-06b6-4eaf-b6a9-04efc4817c8d tempest-CreateVolumesFromSnapshotTest-1901764630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e180031-d839-49cd-b448-31b1b67a4c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd9a5c34-8aa5-45b2-b032-f3c4aa364a9e', 'volume_name': 'volume-bd9a5c34-8aa5-45b2-b032-f3c4aa364a9e', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:29:18 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cbaec6da-06b6-4eaf-b6a9-04efc4817c8d tempest-CreateVolumesFromSnapshotTest-1901764630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf39fd04-e8c4-4ab8-83ab-c045ca79643b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:29:18 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cbaec6da-06b6-4eaf-b6a9-04efc4817c8d tempest-CreateVolumesFromSnapshotTest-1901764630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf39fd04-e8c4-4ab8-83ab-c045ca79643b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:29:18 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cbaec6da-06b6-4eaf-b6a9-04efc4817c8d tempest-CreateVolumesFromSnapshotTest-1901764630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fef01b53-1ff4-4217-8625-7081b2d6c9f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:29:18 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-cbaec6da-06b6-4eaf-b6a9-04efc4817c8d tempest-CreateVolumesFromSnapshotTest-1901764630 None] Volume bd9a5c34-8aa5-45b2-b032-f3c4aa364a9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd9a5c34-8aa5-45b2-b032-f3c4aa364a9e', 'volume_size': 1} Apr 29 15:29:18 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-cbaec6da-06b6-4eaf-b6a9-04efc4817c8d tempest-CreateVolumesFromSnapshotTest-1901764630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:29:18 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-cbaec6da-06b6-4eaf-b6a9-04efc4817c8d tempest-CreateVolumesFromSnapshotTest-1901764630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:29:18 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-cbaec6da-06b6-4eaf-b6a9-04efc4817c8d tempest-CreateVolumesFromSnapshotTest-1901764630 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:29:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1115101987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd9a5c34-8aa5-45b2-b032-f3c4aa364a9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f46a492915414787b65e7d3929f18cff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:29:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:29:18Z,use_quota=True,user_id='de82e028a0c34615ab390bc64d8aa985',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:29:18 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-cbaec6da-06b6-4eaf-b6a9-04efc4817c8d tempest-CreateVolumesFromSnapshotTest-1901764630 None] Creating volume bd9a5c34-8aa5-45b2-b032-f3c4aa364a9e {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:29:18 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-cbaec6da-06b6-4eaf-b6a9-04efc4817c8d tempest-CreateVolumesFromSnapshotTest-1901764630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:29:18 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-cbaec6da-06b6-4eaf-b6a9-04efc4817c8d tempest-CreateVolumesFromSnapshotTest-1901764630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:29:18 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-cbaec6da-06b6-4eaf-b6a9-04efc4817c8d tempest-CreateVolumesFromSnapshotTest-1901764630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:29:18 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-cbaec6da-06b6-4eaf-b6a9-04efc4817c8d tempest-CreateVolumesFromSnapshotTest-1901764630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:29:18 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-cbaec6da-06b6-4eaf-b6a9-04efc4817c8d tempest-CreateVolumesFromSnapshotTest-1901764630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:29:18 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-cbaec6da-06b6-4eaf-b6a9-04efc4817c8d tempest-CreateVolumesFromSnapshotTest-1901764630 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:29:18 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-cbaec6da-06b6-4eaf-b6a9-04efc4817c8d tempest-CreateVolumesFromSnapshotTest-1901764630 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:29:18 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cbaec6da-06b6-4eaf-b6a9-04efc4817c8d tempest-CreateVolumesFromSnapshotTest-1901764630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-bd9a5c34-8aa5-45b2-b032-f3c4aa364a9e 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:29:18 devstack sudo[107788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-bd9a5c34-8aa5-45b2-b032-f3c4aa364a9e 1073741824 Apr 29 15:29:18 devstack sudo[107788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:29:19 devstack sudo[107788]: pam_unix(sudo:session): session closed for user root Apr 29 15:29:19 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cbaec6da-06b6-4eaf-b6a9-04efc4817c8d tempest-CreateVolumesFromSnapshotTest-1901764630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-bd9a5c34-8aa5-45b2-b032-f3c4aa364a9e 1073741824" returned: 0 in 0.787s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:29:19 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cbaec6da-06b6-4eaf-b6a9-04efc4817c8d tempest-CreateVolumesFromSnapshotTest-1901764630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-bd9a5c34-8aa5-45b2-b032-f3c4aa364a9e {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:29:19 devstack sudo[107793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-bd9a5c34-8aa5-45b2-b032-f3c4aa364a9e Apr 29 15:29:19 devstack sudo[107793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:29:19 devstack sudo[107793]: pam_unix(sudo:session): session closed for user root Apr 29 15:29:19 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cbaec6da-06b6-4eaf-b6a9-04efc4817c8d tempest-CreateVolumesFromSnapshotTest-1901764630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-bd9a5c34-8aa5-45b2-b032-f3c4aa364a9e" returned: 0 in 0.608s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:29:19 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-cbaec6da-06b6-4eaf-b6a9-04efc4817c8d tempest-CreateVolumesFromSnapshotTest-1901764630 None] <== create_volume: return (1436ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:29:19 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-cbaec6da-06b6-4eaf-b6a9-04efc4817c8d tempest-CreateVolumesFromSnapshotTest-1901764630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.439s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:29:19 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cbaec6da-06b6-4eaf-b6a9-04efc4817c8d tempest-CreateVolumesFromSnapshotTest-1901764630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fef01b53-1ff4-4217-8625-7081b2d6c9f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd9a5c34-8aa5-45b2-b032-f3c4aa364a9e', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:29:19 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cbaec6da-06b6-4eaf-b6a9-04efc4817c8d tempest-CreateVolumesFromSnapshotTest-1901764630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50eafd44-f5b4-49af-a6db-4f0f6732663c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:29:19 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-cbaec6da-06b6-4eaf-b6a9-04efc4817c8d tempest-CreateVolumesFromSnapshotTest-1901764630 None] Volume volume-bd9a5c34-8aa5-45b2-b032-f3c4aa364a9e (bd9a5c34-8aa5-45b2-b032-f3c4aa364a9e): created successfully Apr 29 15:29:19 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cbaec6da-06b6-4eaf-b6a9-04efc4817c8d tempest-CreateVolumesFromSnapshotTest-1901764630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50eafd44-f5b4-49af-a6db-4f0f6732663c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:29:19 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cbaec6da-06b6-4eaf-b6a9-04efc4817c8d tempest-CreateVolumesFromSnapshotTest-1901764630 None] Flow 'volume_create_manager' (f3cdaf87-9657-4eb8-b769-fea4db605175) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:29:19 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-cbaec6da-06b6-4eaf-b6a9-04efc4817c8d tempest-CreateVolumesFromSnapshotTest-1901764630 None] Created volume successfully. Apr 29 15:29:20 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-3f1c68e2-e7f1-467b-b12c-e768208e83e2 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:29:20 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-3f1c68e2-e7f1-467b-b12c-e768208e83e2 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:29:20 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-3f1c68e2-e7f1-467b-b12c-e768208e83e2 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Creating offline snapshot c2c14c39-50b2-4e6e-abea-c110b9856835 of volume bd9a5c34-8aa5-45b2-b032-f3c4aa364a9e {{(pid=84448) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 15:29:20 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b39f835-d253-4df4-b26a-54b57e8d9e0e]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:29:20 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-3f1c68e2-e7f1-467b-b12c-e768208e83e2 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-bd9a5c34-8aa5-45b2-b032-f3c4aa364a9e {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:29:20 devstack sudo[107796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-bd9a5c34-8aa5-45b2-b032-f3c4aa364a9e Apr 29 15:29:20 devstack sudo[107796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:29:21 devstack sudo[107796]: pam_unix(sudo:session): session closed for user root Apr 29 15:29:21 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-3f1c68e2-e7f1-467b-b12c-e768208e83e2 tempest-CreateVolumesFromSnapshotTest-1901764630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-bd9a5c34-8aa5-45b2-b032-f3c4aa364a9e" returned: 0 in 0.714s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:29:21 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-3f1c68e2-e7f1-467b-b12c-e768208e83e2 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-bd9a5c34-8aa5-45b2-b032-f3c4aa364a9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-bd9a5c34-8aa5-45b2-b032-f3c4aa364a9e.c2c14c39-50b2-4e6e-abea-c110b9856835 1G {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:29:21 devstack sudo[107801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-bd9a5c34-8aa5-45b2-b032-f3c4aa364a9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-bd9a5c34-8aa5-45b2-b032-f3c4aa364a9e.c2c14c39-50b2-4e6e-abea-c110b9856835 1G Apr 29 15:29:21 devstack sudo[107801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:29:22 devstack sudo[107801]: pam_unix(sudo:session): session closed for user root Apr 29 15:29:22 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-3f1c68e2-e7f1-467b-b12c-e768208e83e2 tempest-CreateVolumesFromSnapshotTest-1901764630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-bd9a5c34-8aa5-45b2-b032-f3c4aa364a9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-bd9a5c34-8aa5-45b2-b032-f3c4aa364a9e.c2c14c39-50b2-4e6e-abea-c110b9856835 1G" returned: 0 in 0.749s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:29:22 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-3f1c68e2-e7f1-467b-b12c-e768208e83e2 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd9a5c34-8aa5-45b2-b032-f3c4aa364a9e -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-bd9a5c34-8aa5-45b2-b032-f3c4aa364a9e.c2c14c39-50b2-4e6e-abea-c110b9856835 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:29:22 devstack sudo[107806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd9a5c34-8aa5-45b2-b032-f3c4aa364a9e -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-bd9a5c34-8aa5-45b2-b032-f3c4aa364a9e.c2c14c39-50b2-4e6e-abea-c110b9856835 Apr 29 15:29:22 devstack sudo[107806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:29:22 devstack sudo[107806]: pam_unix(sudo:session): session closed for user root Apr 29 15:29:22 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-3f1c68e2-e7f1-467b-b12c-e768208e83e2 tempest-CreateVolumesFromSnapshotTest-1901764630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd9a5c34-8aa5-45b2-b032-f3c4aa364a9e -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-bd9a5c34-8aa5-45b2-b032-f3c4aa364a9e.c2c14c39-50b2-4e6e-abea-c110b9856835" returned: 0 in 0.664s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:29:22 devstack cinder-volume[84448]: WARNING cinder.volume.drivers.remotefs [None req-3f1c68e2-e7f1-467b-b12c-e768208e83e2 tempest-CreateVolumesFromSnapshotTest-1901764630 None] /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-bd9a5c34-8aa5-45b2-b032-f3c4aa364a9e.c2c14c39-50b2-4e6e-abea-c110b9856835 is being set with open permissions: ugo+rw Apr 29 15:29:22 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-3f1c68e2-e7f1-467b-b12c-e768208e83e2 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-bd9a5c34-8aa5-45b2-b032-f3c4aa364a9e.c2c14c39-50b2-4e6e-abea-c110b9856835 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:29:22 devstack sudo[107811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-bd9a5c34-8aa5-45b2-b032-f3c4aa364a9e.c2c14c39-50b2-4e6e-abea-c110b9856835 Apr 29 15:29:22 devstack sudo[107811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:29:23 devstack sudo[107811]: pam_unix(sudo:session): session closed for user root Apr 29 15:29:23 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-3f1c68e2-e7f1-467b-b12c-e768208e83e2 tempest-CreateVolumesFromSnapshotTest-1901764630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-bd9a5c34-8aa5-45b2-b032-f3c4aa364a9e.c2c14c39-50b2-4e6e-abea-c110b9856835" returned: 0 in 0.593s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:29:23 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-3f1c68e2-e7f1-467b-b12c-e768208e83e2 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-bd9a5c34-8aa5-45b2-b032-f3c4aa364a9e.info {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:29:23 devstack sudo[107814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-bd9a5c34-8aa5-45b2-b032-f3c4aa364a9e.info Apr 29 15:29:23 devstack sudo[107814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:29:24 devstack sudo[107814]: pam_unix(sudo:session): session closed for user root Apr 29 15:29:24 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-3f1c68e2-e7f1-467b-b12c-e768208e83e2 tempest-CreateVolumesFromSnapshotTest-1901764630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-bd9a5c34-8aa5-45b2-b032-f3c4aa364a9e.info" returned: 0 in 0.596s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:29:24 devstack cinder-volume[84448]: WARNING cinder.volume.drivers.remotefs [None req-3f1c68e2-e7f1-467b-b12c-e768208e83e2 tempest-CreateVolumesFromSnapshotTest-1901764630 None] /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-bd9a5c34-8aa5-45b2-b032-f3c4aa364a9e.info is being set with open permissions: ugo+rw Apr 29 15:29:24 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-3f1c68e2-e7f1-467b-b12c-e768208e83e2 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-bd9a5c34-8aa5-45b2-b032-f3c4aa364a9e.info {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:29:24 devstack sudo[107819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-bd9a5c34-8aa5-45b2-b032-f3c4aa364a9e.info Apr 29 15:29:24 devstack sudo[107819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:29:24 devstack sudo[107819]: pam_unix(sudo:session): session closed for user root Apr 29 15:29:24 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-3f1c68e2-e7f1-467b-b12c-e768208e83e2 tempest-CreateVolumesFromSnapshotTest-1901764630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-bd9a5c34-8aa5-45b2-b032-f3c4aa364a9e.info" returned: 0 in 0.581s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:29:24 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-3f1c68e2-e7f1-467b-b12c-e768208e83e2 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.977s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:29:24 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-3f1c68e2-e7f1-467b-b12c-e768208e83e2 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Create snapshot completed successfully Apr 29 15:29:25 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-94be48bd-60e4-4cd3-840b-b47ef9c833e1 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:29:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-94be48bd-60e4-4cd3-840b-b47ef9c833e1 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Flow 'volume_create_manager' (a83e843c-2f61-4749-b748-0b6d7056fc80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:29:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-94be48bd-60e4-4cd3-840b-b47ef9c833e1 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (830c1897-d8df-4b68-950b-2bf1d47ef61c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:29:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-94be48bd-60e4-4cd3-840b-b47ef9c833e1 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (830c1897-d8df-4b68-950b-2bf1d47ef61c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:29:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1011222614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49f42311-257b-4d71-b61e-ca61d146392f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f46a492915414787b65e7d3929f18cff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:29:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:29:25Z,use_quota=True,user_id='de82e028a0c34615ab390bc64d8aa985',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:29:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-94be48bd-60e4-4cd3-840b-b47ef9c833e1 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3731164a-6ba1-49b3-a0d1-a3c7a34b4a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:29:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-94be48bd-60e4-4cd3-840b-b47ef9c833e1 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3731164a-6ba1-49b3-a0d1-a3c7a34b4a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:29:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-94be48bd-60e4-4cd3-840b-b47ef9c833e1 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a80ef3a9-bbb2-41cc-95b8-3f0083272bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:29:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-94be48bd-60e4-4cd3-840b-b47ef9c833e1 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a80ef3a9-bbb2-41cc-95b8-3f0083272bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49f42311-257b-4d71-b61e-ca61d146392f', 'volume_name': 'volume-49f42311-257b-4d71-b61e-ca61d146392f', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:29:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-94be48bd-60e4-4cd3-840b-b47ef9c833e1 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f162db81-d6b1-4895-bd18-bfe899fdbab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:29:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-94be48bd-60e4-4cd3-840b-b47ef9c833e1 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f162db81-d6b1-4895-bd18-bfe899fdbab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:29:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-94be48bd-60e4-4cd3-840b-b47ef9c833e1 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4453ecde-a6d6-48a7-b43b-3361654d0157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:29:25 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-94be48bd-60e4-4cd3-840b-b47ef9c833e1 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Volume 49f42311-257b-4d71-b61e-ca61d146392f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49f42311-257b-4d71-b61e-ca61d146392f', 'volume_size': 1} Apr 29 15:29:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-94be48bd-60e4-4cd3-840b-b47ef9c833e1 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:29:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-94be48bd-60e4-4cd3-840b-b47ef9c833e1 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:29:25 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-94be48bd-60e4-4cd3-840b-b47ef9c833e1 tempest-CreateVolumesFromSnapshotTest-1901764630 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:29:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1011222614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49f42311-257b-4d71-b61e-ca61d146392f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f46a492915414787b65e7d3929f18cff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:29:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:29:25Z,use_quota=True,user_id='de82e028a0c34615ab390bc64d8aa985',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:29:25 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-94be48bd-60e4-4cd3-840b-b47ef9c833e1 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Creating volume 49f42311-257b-4d71-b61e-ca61d146392f {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:29:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-94be48bd-60e4-4cd3-840b-b47ef9c833e1 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:29:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-94be48bd-60e4-4cd3-840b-b47ef9c833e1 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:29:25 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-94be48bd-60e4-4cd3-840b-b47ef9c833e1 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:29:25 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-94be48bd-60e4-4cd3-840b-b47ef9c833e1 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:29:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-94be48bd-60e4-4cd3-840b-b47ef9c833e1 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:29:25 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-94be48bd-60e4-4cd3-840b-b47ef9c833e1 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:29:25 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-94be48bd-60e4-4cd3-840b-b47ef9c833e1 tempest-CreateVolumesFromSnapshotTest-1901764630 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:29:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-94be48bd-60e4-4cd3-840b-b47ef9c833e1 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-49f42311-257b-4d71-b61e-ca61d146392f 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:29:25 devstack sudo[107822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-49f42311-257b-4d71-b61e-ca61d146392f 1073741824 Apr 29 15:29:25 devstack sudo[107822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:29:25 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7f60e8a-7821-4d3f-bd2a-8495caac3093 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:29:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-a7f60e8a-7821-4d3f-bd2a-8495caac3093 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Flow 'volume_create_manager' (e6191c2c-84b0-4c1a-bf97-a112ffd764bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:29:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-a7f60e8a-7821-4d3f-bd2a-8495caac3093 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f56a159-cc2c-4206-8753-595643f37968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:29:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-a7f60e8a-7821-4d3f-bd2a-8495caac3093 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f56a159-cc2c-4206-8753-595643f37968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:29:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1921660971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c453254a-5dc9-4169-ac2b-b9f01bb7e29a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f46a492915414787b65e7d3929f18cff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:29:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:29:25Z,use_quota=True,user_id='de82e028a0c34615ab390bc64d8aa985',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:29:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-a7f60e8a-7821-4d3f-bd2a-8495caac3093 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54491196-41ef-405f-a8e5-0f20bf664b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:29:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-a7f60e8a-7821-4d3f-bd2a-8495caac3093 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54491196-41ef-405f-a8e5-0f20bf664b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:29:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-a7f60e8a-7821-4d3f-bd2a-8495caac3093 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb48d6fd-d505-4cf9-8e58-e210c9aeb21f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:29:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-a7f60e8a-7821-4d3f-bd2a-8495caac3093 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb48d6fd-d505-4cf9-8e58-e210c9aeb21f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c453254a-5dc9-4169-ac2b-b9f01bb7e29a', 'volume_name': 'volume-c453254a-5dc9-4169-ac2b-b9f01bb7e29a', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:29:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-a7f60e8a-7821-4d3f-bd2a-8495caac3093 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3914b78-4d0a-4036-b2da-cf824f217960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:29:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-a7f60e8a-7821-4d3f-bd2a-8495caac3093 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3914b78-4d0a-4036-b2da-cf824f217960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:29:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-a7f60e8a-7821-4d3f-bd2a-8495caac3093 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7b98f44-0e47-4438-ad94-2bacf533ee1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:29:25 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-a7f60e8a-7821-4d3f-bd2a-8495caac3093 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Volume c453254a-5dc9-4169-ac2b-b9f01bb7e29a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c453254a-5dc9-4169-ac2b-b9f01bb7e29a', 'volume_size': 1} Apr 29 15:29:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-a7f60e8a-7821-4d3f-bd2a-8495caac3093 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:29:25 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-2340fc6a-386b-4427-81e0-e30b1a0d81b9 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:29:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-2340fc6a-386b-4427-81e0-e30b1a0d81b9 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Flow 'volume_create_manager' (af581533-e469-449b-9870-cd9177dece2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:29:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-2340fc6a-386b-4427-81e0-e30b1a0d81b9 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5973f544-67f9-4b8c-9c42-34c5da034de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:29:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-2340fc6a-386b-4427-81e0-e30b1a0d81b9 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5973f544-67f9-4b8c-9c42-34c5da034de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:29:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2058403493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e83c271-dac8-47a6-9dfb-38c4cf59c283,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f46a492915414787b65e7d3929f18cff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:29:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:29:26Z,use_quota=True,user_id='de82e028a0c34615ab390bc64d8aa985',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:29:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-2340fc6a-386b-4427-81e0-e30b1a0d81b9 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae0e2259-cc4a-4fe9-9770-ef13d5dd9a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:29:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-2340fc6a-386b-4427-81e0-e30b1a0d81b9 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae0e2259-cc4a-4fe9-9770-ef13d5dd9a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:29:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-2340fc6a-386b-4427-81e0-e30b1a0d81b9 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb7b27e8-f95d-452d-a4d6-1f7dcb44da44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:29:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-2340fc6a-386b-4427-81e0-e30b1a0d81b9 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb7b27e8-f95d-452d-a4d6-1f7dcb44da44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e83c271-dac8-47a6-9dfb-38c4cf59c283', 'volume_name': 'volume-7e83c271-dac8-47a6-9dfb-38c4cf59c283', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:29:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-2340fc6a-386b-4427-81e0-e30b1a0d81b9 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa314cdb-d450-4b40-ba61-b3c14808a204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:29:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-2340fc6a-386b-4427-81e0-e30b1a0d81b9 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa314cdb-d450-4b40-ba61-b3c14808a204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:29:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-2340fc6a-386b-4427-81e0-e30b1a0d81b9 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab8eb457-9521-48d3-86df-32a72c47dea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:29:25 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-2340fc6a-386b-4427-81e0-e30b1a0d81b9 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Volume 7e83c271-dac8-47a6-9dfb-38c4cf59c283: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e83c271-dac8-47a6-9dfb-38c4cf59c283', 'volume_size': 1} Apr 29 15:29:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-2340fc6a-386b-4427-81e0-e30b1a0d81b9 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:29:26 devstack sudo[107822]: pam_unix(sudo:session): session closed for user root Apr 29 15:29:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-94be48bd-60e4-4cd3-840b-b47ef9c833e1 tempest-CreateVolumesFromSnapshotTest-1901764630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-49f42311-257b-4d71-b61e-ca61d146392f 1073741824" returned: 0 in 0.874s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:29:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-94be48bd-60e4-4cd3-840b-b47ef9c833e1 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-49f42311-257b-4d71-b61e-ca61d146392f {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:29:26 devstack sudo[107829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-49f42311-257b-4d71-b61e-ca61d146392f Apr 29 15:29:26 devstack sudo[107829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:29:26 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5a48384-962f-48d5-80b3-cc7520eb0af3 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:29:26 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e5a48384-962f-48d5-80b3-cc7520eb0af3 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Flow 'volume_create_manager' (022355a2-a822-411e-ab06-330ed83aaf8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:29:26 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e5a48384-962f-48d5-80b3-cc7520eb0af3 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d834507-751b-4a06-afab-8407e6c095ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:29:26 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e5a48384-962f-48d5-80b3-cc7520eb0af3 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d834507-751b-4a06-afab-8407e6c095ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:29:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1295218184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3512f53d-834f-4f3b-87fc-6a729e677b59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f46a492915414787b65e7d3929f18cff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:29:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:29:26Z,use_quota=True,user_id='de82e028a0c34615ab390bc64d8aa985',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:29:26 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e5a48384-962f-48d5-80b3-cc7520eb0af3 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43944409-2a8c-4d71-8247-23e8594ad7eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:29:26 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e5a48384-962f-48d5-80b3-cc7520eb0af3 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43944409-2a8c-4d71-8247-23e8594ad7eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:29:26 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e5a48384-962f-48d5-80b3-cc7520eb0af3 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff726d25-7085-47cd-97fa-b03e821e6475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:29:26 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e5a48384-962f-48d5-80b3-cc7520eb0af3 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff726d25-7085-47cd-97fa-b03e821e6475) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3512f53d-834f-4f3b-87fc-6a729e677b59', 'volume_name': 'volume-3512f53d-834f-4f3b-87fc-6a729e677b59', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:29:26 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e5a48384-962f-48d5-80b3-cc7520eb0af3 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a2e2170-d00d-48bf-8539-b969e175fe8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:29:26 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e5a48384-962f-48d5-80b3-cc7520eb0af3 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a2e2170-d00d-48bf-8539-b969e175fe8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:29:26 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e5a48384-962f-48d5-80b3-cc7520eb0af3 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ae15751-2cae-4a34-8e38-ca0d37c0f859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:29:26 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-e5a48384-962f-48d5-80b3-cc7520eb0af3 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Volume 3512f53d-834f-4f3b-87fc-6a729e677b59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3512f53d-834f-4f3b-87fc-6a729e677b59', 'volume_size': 1} Apr 29 15:29:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-e5a48384-962f-48d5-80b3-cc7520eb0af3 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:29:26 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-c70fe395-8374-41bc-b10c-6cf813c042c1 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:29:26 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c70fe395-8374-41bc-b10c-6cf813c042c1 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Flow 'volume_create_manager' (df7175db-2f6c-4f90-9497-810039096d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:29:26 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c70fe395-8374-41bc-b10c-6cf813c042c1 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f8ce79c-9975-46d2-8277-745db1de8a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:29:26 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c70fe395-8374-41bc-b10c-6cf813c042c1 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f8ce79c-9975-46d2-8277-745db1de8a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:29:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2122917672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13cafb07-335b-4df9-b5c8-67a469961bbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f46a492915414787b65e7d3929f18cff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:29:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:29:27Z,use_quota=True,user_id='de82e028a0c34615ab390bc64d8aa985',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:29:26 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c70fe395-8374-41bc-b10c-6cf813c042c1 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d487675-1fe3-4bec-a138-1e457e74f992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:29:26 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c70fe395-8374-41bc-b10c-6cf813c042c1 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d487675-1fe3-4bec-a138-1e457e74f992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:29:26 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c70fe395-8374-41bc-b10c-6cf813c042c1 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73309b3f-f325-43b9-88e7-0b18e0b46f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:29:26 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c70fe395-8374-41bc-b10c-6cf813c042c1 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73309b3f-f325-43b9-88e7-0b18e0b46f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13cafb07-335b-4df9-b5c8-67a469961bbb', 'volume_name': 'volume-13cafb07-335b-4df9-b5c8-67a469961bbb', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:29:26 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c70fe395-8374-41bc-b10c-6cf813c042c1 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54ad194c-1359-4811-9f50-3a9165dadd20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:29:26 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c70fe395-8374-41bc-b10c-6cf813c042c1 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54ad194c-1359-4811-9f50-3a9165dadd20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:29:26 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c70fe395-8374-41bc-b10c-6cf813c042c1 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f029ccb-1db1-466e-aeba-33abfa446e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:29:26 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-c70fe395-8374-41bc-b10c-6cf813c042c1 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Volume 13cafb07-335b-4df9-b5c8-67a469961bbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13cafb07-335b-4df9-b5c8-67a469961bbb', 'volume_size': 1} Apr 29 15:29:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-c70fe395-8374-41bc-b10c-6cf813c042c1 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:29:26 devstack sudo[107829]: pam_unix(sudo:session): session closed for user root Apr 29 15:29:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-94be48bd-60e4-4cd3-840b-b47ef9c833e1 tempest-CreateVolumesFromSnapshotTest-1901764630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-49f42311-257b-4d71-b61e-ca61d146392f" returned: 0 in 0.626s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:29:26 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-94be48bd-60e4-4cd3-840b-b47ef9c833e1 tempest-CreateVolumesFromSnapshotTest-1901764630 None] <== create_volume: return (1551ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:29:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-94be48bd-60e4-4cd3-840b-b47ef9c833e1 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.554s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:29:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-a7f60e8a-7821-4d3f-bd2a-8495caac3093 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.201s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:29:26 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-a7f60e8a-7821-4d3f-bd2a-8495caac3093 tempest-CreateVolumesFromSnapshotTest-1901764630 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:29:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1921660971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c453254a-5dc9-4169-ac2b-b9f01bb7e29a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f46a492915414787b65e7d3929f18cff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:29:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:29:25Z,use_quota=True,user_id='de82e028a0c34615ab390bc64d8aa985',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:29:26 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-a7f60e8a-7821-4d3f-bd2a-8495caac3093 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Creating volume c453254a-5dc9-4169-ac2b-b9f01bb7e29a {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:29:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-a7f60e8a-7821-4d3f-bd2a-8495caac3093 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:29:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-a7f60e8a-7821-4d3f-bd2a-8495caac3093 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:29:26 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-a7f60e8a-7821-4d3f-bd2a-8495caac3093 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:29:26 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-a7f60e8a-7821-4d3f-bd2a-8495caac3093 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:29:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-a7f60e8a-7821-4d3f-bd2a-8495caac3093 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:29:26 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-a7f60e8a-7821-4d3f-bd2a-8495caac3093 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:29:26 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-a7f60e8a-7821-4d3f-bd2a-8495caac3093 tempest-CreateVolumesFromSnapshotTest-1901764630 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:29:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a7f60e8a-7821-4d3f-bd2a-8495caac3093 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c453254a-5dc9-4169-ac2b-b9f01bb7e29a 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:29:26 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-94be48bd-60e4-4cd3-840b-b47ef9c833e1 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4453ecde-a6d6-48a7-b43b-3361654d0157) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49f42311-257b-4d71-b61e-ca61d146392f', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:29:26 devstack sudo[107832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c453254a-5dc9-4169-ac2b-b9f01bb7e29a 1073741824 Apr 29 15:29:26 devstack sudo[107832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:29:26 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-94be48bd-60e4-4cd3-840b-b47ef9c833e1 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73ce7b95-934e-43aa-8213-548dfd8b3033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:29:26 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-94be48bd-60e4-4cd3-840b-b47ef9c833e1 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Volume volume-49f42311-257b-4d71-b61e-ca61d146392f (49f42311-257b-4d71-b61e-ca61d146392f): created successfully Apr 29 15:29:26 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-94be48bd-60e4-4cd3-840b-b47ef9c833e1 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73ce7b95-934e-43aa-8213-548dfd8b3033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:29:26 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-94be48bd-60e4-4cd3-840b-b47ef9c833e1 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Flow 'volume_create_manager' (a83e843c-2f61-4749-b748-0b6d7056fc80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:29:26 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-94be48bd-60e4-4cd3-840b-b47ef9c833e1 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Created volume successfully. Apr 29 15:29:27 devstack sudo[107832]: pam_unix(sudo:session): session closed for user root Apr 29 15:29:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a7f60e8a-7821-4d3f-bd2a-8495caac3093 tempest-CreateVolumesFromSnapshotTest-1901764630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c453254a-5dc9-4169-ac2b-b9f01bb7e29a 1073741824" returned: 0 in 0.781s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:29:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a7f60e8a-7821-4d3f-bd2a-8495caac3093 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c453254a-5dc9-4169-ac2b-b9f01bb7e29a {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:29:27 devstack sudo[107838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c453254a-5dc9-4169-ac2b-b9f01bb7e29a Apr 29 15:29:27 devstack sudo[107838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:29:28 devstack sudo[107838]: pam_unix(sudo:session): session closed for user root Apr 29 15:29:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a7f60e8a-7821-4d3f-bd2a-8495caac3093 tempest-CreateVolumesFromSnapshotTest-1901764630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c453254a-5dc9-4169-ac2b-b9f01bb7e29a" returned: 0 in 0.592s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:29:28 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-a7f60e8a-7821-4d3f-bd2a-8495caac3093 tempest-CreateVolumesFromSnapshotTest-1901764630 None] <== create_volume: return (1408ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:29:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-a7f60e8a-7821-4d3f-bd2a-8495caac3093 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.411s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:29:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-2340fc6a-386b-4427-81e0-e30b1a0d81b9 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.281s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:29:28 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-2340fc6a-386b-4427-81e0-e30b1a0d81b9 tempest-CreateVolumesFromSnapshotTest-1901764630 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:29:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2058403493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e83c271-dac8-47a6-9dfb-38c4cf59c283,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f46a492915414787b65e7d3929f18cff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:29:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:29:26Z,use_quota=True,user_id='de82e028a0c34615ab390bc64d8aa985',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:29:28 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-2340fc6a-386b-4427-81e0-e30b1a0d81b9 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Creating volume 7e83c271-dac8-47a6-9dfb-38c4cf59c283 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:29:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-2340fc6a-386b-4427-81e0-e30b1a0d81b9 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:29:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-2340fc6a-386b-4427-81e0-e30b1a0d81b9 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:29:28 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-2340fc6a-386b-4427-81e0-e30b1a0d81b9 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:29:28 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-2340fc6a-386b-4427-81e0-e30b1a0d81b9 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:29:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-2340fc6a-386b-4427-81e0-e30b1a0d81b9 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:29:28 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-2340fc6a-386b-4427-81e0-e30b1a0d81b9 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:29:28 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-2340fc6a-386b-4427-81e0-e30b1a0d81b9 tempest-CreateVolumesFromSnapshotTest-1901764630 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:29:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-2340fc6a-386b-4427-81e0-e30b1a0d81b9 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7e83c271-dac8-47a6-9dfb-38c4cf59c283 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:29:28 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-a7f60e8a-7821-4d3f-bd2a-8495caac3093 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7b98f44-0e47-4438-ad94-2bacf533ee1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c453254a-5dc9-4169-ac2b-b9f01bb7e29a', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:29:28 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-a7f60e8a-7821-4d3f-bd2a-8495caac3093 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bf5d528-ce5f-459f-911e-42315915d4dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:29:28 devstack sudo[107841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7e83c271-dac8-47a6-9dfb-38c4cf59c283 1073741824 Apr 29 15:29:28 devstack sudo[107841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:29:28 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-a7f60e8a-7821-4d3f-bd2a-8495caac3093 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Volume volume-c453254a-5dc9-4169-ac2b-b9f01bb7e29a (c453254a-5dc9-4169-ac2b-b9f01bb7e29a): created successfully Apr 29 15:29:28 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-a7f60e8a-7821-4d3f-bd2a-8495caac3093 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bf5d528-ce5f-459f-911e-42315915d4dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:29:28 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-a7f60e8a-7821-4d3f-bd2a-8495caac3093 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Flow 'volume_create_manager' (e6191c2c-84b0-4c1a-bf97-a112ffd764bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:29:28 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-a7f60e8a-7821-4d3f-bd2a-8495caac3093 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Created volume successfully. Apr 29 15:29:28 devstack sudo[107841]: pam_unix(sudo:session): session closed for user root Apr 29 15:29:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-2340fc6a-386b-4427-81e0-e30b1a0d81b9 tempest-CreateVolumesFromSnapshotTest-1901764630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7e83c271-dac8-47a6-9dfb-38c4cf59c283 1073741824" returned: 0 in 0.761s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:29:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-2340fc6a-386b-4427-81e0-e30b1a0d81b9 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7e83c271-dac8-47a6-9dfb-38c4cf59c283 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:29:29 devstack sudo[107846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7e83c271-dac8-47a6-9dfb-38c4cf59c283 Apr 29 15:29:29 devstack sudo[107846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:29:29 devstack sudo[107846]: pam_unix(sudo:session): session closed for user root Apr 29 15:29:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-2340fc6a-386b-4427-81e0-e30b1a0d81b9 tempest-CreateVolumesFromSnapshotTest-1901764630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7e83c271-dac8-47a6-9dfb-38c4cf59c283" returned: 0 in 0.581s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:29:29 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-2340fc6a-386b-4427-81e0-e30b1a0d81b9 tempest-CreateVolumesFromSnapshotTest-1901764630 None] <== create_volume: return (1380ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:29:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-2340fc6a-386b-4427-81e0-e30b1a0d81b9 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.384s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:29:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-e5a48384-962f-48d5-80b3-cc7520eb0af3 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.306s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:29:29 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-e5a48384-962f-48d5-80b3-cc7520eb0af3 tempest-CreateVolumesFromSnapshotTest-1901764630 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:29:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1295218184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3512f53d-834f-4f3b-87fc-6a729e677b59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f46a492915414787b65e7d3929f18cff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:29:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:29:26Z,use_quota=True,user_id='de82e028a0c34615ab390bc64d8aa985',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:29:29 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-e5a48384-962f-48d5-80b3-cc7520eb0af3 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Creating volume 3512f53d-834f-4f3b-87fc-6a729e677b59 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:29:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-e5a48384-962f-48d5-80b3-cc7520eb0af3 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:29:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-e5a48384-962f-48d5-80b3-cc7520eb0af3 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:29:29 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-e5a48384-962f-48d5-80b3-cc7520eb0af3 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:29:29 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-e5a48384-962f-48d5-80b3-cc7520eb0af3 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:29:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-e5a48384-962f-48d5-80b3-cc7520eb0af3 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:29:29 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-e5a48384-962f-48d5-80b3-cc7520eb0af3 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:29:29 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-e5a48384-962f-48d5-80b3-cc7520eb0af3 tempest-CreateVolumesFromSnapshotTest-1901764630 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:29:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-e5a48384-962f-48d5-80b3-cc7520eb0af3 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3512f53d-834f-4f3b-87fc-6a729e677b59 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:29:29 devstack sudo[107849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3512f53d-834f-4f3b-87fc-6a729e677b59 1073741824 Apr 29 15:29:29 devstack sudo[107849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:29:29 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-2340fc6a-386b-4427-81e0-e30b1a0d81b9 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab8eb457-9521-48d3-86df-32a72c47dea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e83c271-dac8-47a6-9dfb-38c4cf59c283', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:29:29 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-2340fc6a-386b-4427-81e0-e30b1a0d81b9 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f4840c0-5617-4f5c-a13a-8cc4f7f14f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:29:29 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-2340fc6a-386b-4427-81e0-e30b1a0d81b9 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Volume volume-7e83c271-dac8-47a6-9dfb-38c4cf59c283 (7e83c271-dac8-47a6-9dfb-38c4cf59c283): created successfully Apr 29 15:29:29 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-2340fc6a-386b-4427-81e0-e30b1a0d81b9 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f4840c0-5617-4f5c-a13a-8cc4f7f14f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:29:29 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-2340fc6a-386b-4427-81e0-e30b1a0d81b9 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Flow 'volume_create_manager' (af581533-e469-449b-9870-cd9177dece2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:29:29 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-2340fc6a-386b-4427-81e0-e30b1a0d81b9 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Created volume successfully. Apr 29 15:29:30 devstack sudo[107849]: pam_unix(sudo:session): session closed for user root Apr 29 15:29:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-e5a48384-962f-48d5-80b3-cc7520eb0af3 tempest-CreateVolumesFromSnapshotTest-1901764630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3512f53d-834f-4f3b-87fc-6a729e677b59 1073741824" returned: 0 in 0.738s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:29:30 devstack cinder-volume[84448]: DEBUG oslo_service.periodic_task [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84448) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 15:29:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:29:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:29:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:29:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:29:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:29:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:29:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-e5a48384-962f-48d5-80b3-cc7520eb0af3 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3512f53d-834f-4f3b-87fc-6a729e677b59 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:29:30 devstack sudo[107855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:29:30 devstack sudo[107855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:29:30 devstack sudo[107856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3512f53d-834f-4f3b-87fc-6a729e677b59 Apr 29 15:29:30 devstack sudo[107856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:29:30 devstack sudo[107855]: pam_unix(sudo:session): session closed for user root Apr 29 15:29:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.602s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:29:31 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:29:31 devstack sudo[107856]: pam_unix(sudo:session): session closed for user root Apr 29 15:29:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-e5a48384-962f-48d5-80b3-cc7520eb0af3 tempest-CreateVolumesFromSnapshotTest-1901764630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3512f53d-834f-4f3b-87fc-6a729e677b59" returned: 0 in 0.610s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:29:31 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-e5a48384-962f-48d5-80b3-cc7520eb0af3 tempest-CreateVolumesFromSnapshotTest-1901764630 None] <== create_volume: return (1405ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:29:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-e5a48384-962f-48d5-80b3-cc7520eb0af3 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.409s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:29:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-c70fe395-8374-41bc-b10c-6cf813c042c1 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.400s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:29:31 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-c70fe395-8374-41bc-b10c-6cf813c042c1 tempest-CreateVolumesFromSnapshotTest-1901764630 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:29:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2122917672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13cafb07-335b-4df9-b5c8-67a469961bbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f46a492915414787b65e7d3929f18cff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:29:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:29:27Z,use_quota=True,user_id='de82e028a0c34615ab390bc64d8aa985',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:29:31 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-c70fe395-8374-41bc-b10c-6cf813c042c1 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Creating volume 13cafb07-335b-4df9-b5c8-67a469961bbb {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:29:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-c70fe395-8374-41bc-b10c-6cf813c042c1 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:29:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-c70fe395-8374-41bc-b10c-6cf813c042c1 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:29:31 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-c70fe395-8374-41bc-b10c-6cf813c042c1 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:29:31 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-c70fe395-8374-41bc-b10c-6cf813c042c1 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:29:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-c70fe395-8374-41bc-b10c-6cf813c042c1 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:29:31 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-c70fe395-8374-41bc-b10c-6cf813c042c1 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:29:31 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-c70fe395-8374-41bc-b10c-6cf813c042c1 tempest-CreateVolumesFromSnapshotTest-1901764630 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:29:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c70fe395-8374-41bc-b10c-6cf813c042c1 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13cafb07-335b-4df9-b5c8-67a469961bbb 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:29:31 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e5a48384-962f-48d5-80b3-cc7520eb0af3 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ae15751-2cae-4a34-8e38-ca0d37c0f859) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3512f53d-834f-4f3b-87fc-6a729e677b59', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:29:31 devstack sudo[107861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13cafb07-335b-4df9-b5c8-67a469961bbb 1073741824 Apr 29 15:29:31 devstack sudo[107861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:29:31 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e5a48384-962f-48d5-80b3-cc7520eb0af3 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (348cb8c3-6095-4106-829b-334b2498a650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:29:31 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-e5a48384-962f-48d5-80b3-cc7520eb0af3 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Volume volume-3512f53d-834f-4f3b-87fc-6a729e677b59 (3512f53d-834f-4f3b-87fc-6a729e677b59): created successfully Apr 29 15:29:31 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e5a48384-962f-48d5-80b3-cc7520eb0af3 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (348cb8c3-6095-4106-829b-334b2498a650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:29:31 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-e5a48384-962f-48d5-80b3-cc7520eb0af3 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Flow 'volume_create_manager' (022355a2-a822-411e-ab06-330ed83aaf8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:29:31 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-e5a48384-962f-48d5-80b3-cc7520eb0af3 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Created volume successfully. Apr 29 15:29:31 devstack sudo[107861]: pam_unix(sudo:session): session closed for user root Apr 29 15:29:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c70fe395-8374-41bc-b10c-6cf813c042c1 tempest-CreateVolumesFromSnapshotTest-1901764630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13cafb07-335b-4df9-b5c8-67a469961bbb 1073741824" returned: 0 in 0.745s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:29:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c70fe395-8374-41bc-b10c-6cf813c042c1 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13cafb07-335b-4df9-b5c8-67a469961bbb {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:29:31 devstack sudo[107870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13cafb07-335b-4df9-b5c8-67a469961bbb Apr 29 15:29:31 devstack sudo[107870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:29:32 devstack sudo[107870]: pam_unix(sudo:session): session closed for user root Apr 29 15:29:32 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c70fe395-8374-41bc-b10c-6cf813c042c1 tempest-CreateVolumesFromSnapshotTest-1901764630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13cafb07-335b-4df9-b5c8-67a469961bbb" returned: 0 in 0.590s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:29:32 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-c70fe395-8374-41bc-b10c-6cf813c042c1 tempest-CreateVolumesFromSnapshotTest-1901764630 None] <== create_volume: return (1373ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:29:32 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-c70fe395-8374-41bc-b10c-6cf813c042c1 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.375s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:29:32 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c70fe395-8374-41bc-b10c-6cf813c042c1 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f029ccb-1db1-466e-aeba-33abfa446e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13cafb07-335b-4df9-b5c8-67a469961bbb', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:29:32 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c70fe395-8374-41bc-b10c-6cf813c042c1 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31da5e6c-e034-4637-9d6a-1f8867adb30b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:29:32 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-c70fe395-8374-41bc-b10c-6cf813c042c1 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Volume volume-13cafb07-335b-4df9-b5c8-67a469961bbb (13cafb07-335b-4df9-b5c8-67a469961bbb): created successfully Apr 29 15:29:32 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c70fe395-8374-41bc-b10c-6cf813c042c1 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31da5e6c-e034-4637-9d6a-1f8867adb30b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:29:32 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c70fe395-8374-41bc-b10c-6cf813c042c1 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Flow 'volume_create_manager' (df7175db-2f6c-4f90-9497-810039096d5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:29:32 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-c70fe395-8374-41bc-b10c-6cf813c042c1 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Created volume successfully. Apr 29 15:29:33 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-ca60a32c-0a46-44b7-b0a7-4e43393b7ee8 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Acquiring lock "cinder-13cafb07-335b-4df9-b5c8-67a469961bbb-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:29:33 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-ca60a32c-0a46-44b7-b0a7-4e43393b7ee8 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Lock "cinder-13cafb07-335b-4df9-b5c8-67a469961bbb-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:29:33 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-ca60a32c-0a46-44b7-b0a7-4e43393b7ee8 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Acquiring lock "cinder-quobyte-13cafb07-335b-4df9-b5c8-67a469961bbb" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:29:33 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-ca60a32c-0a46-44b7-b0a7-4e43393b7ee8 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Lock "cinder-quobyte-13cafb07-335b-4df9-b5c8-67a469961bbb" acquired by "delete_volume" :: waited 0.013s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:29:33 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[865f1212-9ec1-4e5d-b1f0-431d9849aec2]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:29:33 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ca60a32c-0a46-44b7-b0a7-4e43393b7ee8 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13cafb07-335b-4df9-b5c8-67a469961bbb {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:29:33 devstack sudo[107876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13cafb07-335b-4df9-b5c8-67a469961bbb Apr 29 15:29:33 devstack sudo[107876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:29:33 devstack sudo[107876]: pam_unix(sudo:session): session closed for user root Apr 29 15:29:33 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ca60a32c-0a46-44b7-b0a7-4e43393b7ee8 tempest-CreateVolumesFromSnapshotTest-1901764630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13cafb07-335b-4df9-b5c8-67a469961bbb" returned: 0 in 0.699s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:29:33 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ca60a32c-0a46-44b7-b0a7-4e43393b7ee8 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13cafb07-335b-4df9-b5c8-67a469961bbb {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:29:33 devstack sudo[107881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13cafb07-335b-4df9-b5c8-67a469961bbb Apr 29 15:29:33 devstack sudo[107881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:29:34 devstack sudo[107881]: pam_unix(sudo:session): session closed for user root Apr 29 15:29:34 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ca60a32c-0a46-44b7-b0a7-4e43393b7ee8 tempest-CreateVolumesFromSnapshotTest-1901764630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-13cafb07-335b-4df9-b5c8-67a469961bbb" returned: 0 in 0.588s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:29:34 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-ca60a32c-0a46-44b7-b0a7-4e43393b7ee8 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Lock "cinder-quobyte-13cafb07-335b-4df9-b5c8-67a469961bbb" released by "delete_volume" :: held 1.328s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:29:34 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-ca60a32c-0a46-44b7-b0a7-4e43393b7ee8 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Created reservations ['4d5a3a4a-e9eb-413a-afda-94cada8d0849', 'fac7d4d8-6f72-401b-b36c-87c2435b9de5', '43069ca3-1bc2-4183-bd56-fa491101f3d1', '111e8ebf-2ac1-491f-a32f-2d0e0adcf88b'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:29:34 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-ca60a32c-0a46-44b7-b0a7-4e43393b7ee8 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:29:34 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-ca60a32c-0a46-44b7-b0a7-4e43393b7ee8 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:29:34 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-ca60a32c-0a46-44b7-b0a7-4e43393b7ee8 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:29:34 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-ca60a32c-0a46-44b7-b0a7-4e43393b7ee8 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:29:34 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-ca60a32c-0a46-44b7-b0a7-4e43393b7ee8 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:29:34 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ca60a32c-0a46-44b7-b0a7-4e43393b7ee8 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:29:34 devstack sudo[107918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:29:34 devstack sudo[107918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:29:35 devstack sudo[107918]: pam_unix(sudo:session): session closed for user root Apr 29 15:29:35 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ca60a32c-0a46-44b7-b0a7-4e43393b7ee8 tempest-CreateVolumesFromSnapshotTest-1901764630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.597s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:29:35 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-ca60a32c-0a46-44b7-b0a7-4e43393b7ee8 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:29:35 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-ca60a32c-0a46-44b7-b0a7-4e43393b7ee8 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Deleted volume successfully. Apr 29 15:29:35 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-ca60a32c-0a46-44b7-b0a7-4e43393b7ee8 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Lock "cinder-13cafb07-335b-4df9-b5c8-67a469961bbb-delete_volume" released by "delete_volume" :: held 2.133s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:29:35 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-00136d56-a28d-4138-8866-baebbcef4009 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Acquiring lock "cinder-3512f53d-834f-4f3b-87fc-6a729e677b59-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:29:35 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-00136d56-a28d-4138-8866-baebbcef4009 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Lock "cinder-3512f53d-834f-4f3b-87fc-6a729e677b59-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:29:35 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-00136d56-a28d-4138-8866-baebbcef4009 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Acquiring lock "cinder-quobyte-3512f53d-834f-4f3b-87fc-6a729e677b59" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:29:35 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-00136d56-a28d-4138-8866-baebbcef4009 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Lock "cinder-quobyte-3512f53d-834f-4f3b-87fc-6a729e677b59" acquired by "delete_volume" :: waited 0.016s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:29:35 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[448099e1-03e5-47f1-bc57-8e3fb7d1426a]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:29:35 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-00136d56-a28d-4138-8866-baebbcef4009 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3512f53d-834f-4f3b-87fc-6a729e677b59 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:29:35 devstack sudo[107923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3512f53d-834f-4f3b-87fc-6a729e677b59 Apr 29 15:29:35 devstack sudo[107923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:29:36 devstack sudo[107923]: pam_unix(sudo:session): session closed for user root Apr 29 15:29:36 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-00136d56-a28d-4138-8866-baebbcef4009 tempest-CreateVolumesFromSnapshotTest-1901764630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3512f53d-834f-4f3b-87fc-6a729e677b59" returned: 0 in 0.684s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:29:36 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-00136d56-a28d-4138-8866-baebbcef4009 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3512f53d-834f-4f3b-87fc-6a729e677b59 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:29:36 devstack sudo[107929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3512f53d-834f-4f3b-87fc-6a729e677b59 Apr 29 15:29:36 devstack sudo[107929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:29:36 devstack sudo[107929]: pam_unix(sudo:session): session closed for user root Apr 29 15:29:36 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-00136d56-a28d-4138-8866-baebbcef4009 tempest-CreateVolumesFromSnapshotTest-1901764630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3512f53d-834f-4f3b-87fc-6a729e677b59" returned: 0 in 0.584s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:29:36 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-00136d56-a28d-4138-8866-baebbcef4009 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Lock "cinder-quobyte-3512f53d-834f-4f3b-87fc-6a729e677b59" released by "delete_volume" :: held 1.306s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:29:36 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:SELECT=82,cinder:UPDATE=115,cinder:DELETE=13,cinder:INSERT=19 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:29:36 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-00136d56-a28d-4138-8866-baebbcef4009 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Created reservations ['ca824ed3-24b8-4201-aa40-595b6b98b136', '642e43be-651e-4047-b0f2-baf2deaeecbe', '1dd48431-0a01-40fc-b0ac-ca251e990e1a', 'cd27cbb3-1ac1-4af8-a127-c2566fa349f9'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:29:36 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-00136d56-a28d-4138-8866-baebbcef4009 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:29:36 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-00136d56-a28d-4138-8866-baebbcef4009 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:29:36 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-00136d56-a28d-4138-8866-baebbcef4009 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:29:36 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-00136d56-a28d-4138-8866-baebbcef4009 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:29:36 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-00136d56-a28d-4138-8866-baebbcef4009 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:29:36 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-00136d56-a28d-4138-8866-baebbcef4009 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:29:36 devstack sudo[107932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:29:36 devstack sudo[107932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:29:37 devstack sudo[107932]: pam_unix(sudo:session): session closed for user root Apr 29 15:29:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-00136d56-a28d-4138-8866-baebbcef4009 tempest-CreateVolumesFromSnapshotTest-1901764630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.585s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:29:37 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-00136d56-a28d-4138-8866-baebbcef4009 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:29:37 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-00136d56-a28d-4138-8866-baebbcef4009 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Deleted volume successfully. Apr 29 15:29:37 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-00136d56-a28d-4138-8866-baebbcef4009 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Lock "cinder-3512f53d-834f-4f3b-87fc-6a729e677b59-delete_volume" released by "delete_volume" :: held 2.079s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:29:37 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a07d0597-e675-4168-9b0d-37f765b18256 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Acquiring lock "cinder-7e83c271-dac8-47a6-9dfb-38c4cf59c283-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:29:37 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a07d0597-e675-4168-9b0d-37f765b18256 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Lock "cinder-7e83c271-dac8-47a6-9dfb-38c4cf59c283-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:29:37 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:SELECT=89,cinder:UPDATE=114,cinder:INSERT=34,cinder:DELETE=10 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:29:37 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a07d0597-e675-4168-9b0d-37f765b18256 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Acquiring lock "cinder-quobyte-7e83c271-dac8-47a6-9dfb-38c4cf59c283" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:29:37 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a07d0597-e675-4168-9b0d-37f765b18256 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Lock "cinder-quobyte-7e83c271-dac8-47a6-9dfb-38c4cf59c283" acquired by "delete_volume" :: waited 0.015s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:29:37 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4feba9d-b9d1-46ed-ade5-7f6fddc9ba1c]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:29:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a07d0597-e675-4168-9b0d-37f765b18256 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7e83c271-dac8-47a6-9dfb-38c4cf59c283 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:29:37 devstack sudo[107935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7e83c271-dac8-47a6-9dfb-38c4cf59c283 Apr 29 15:29:37 devstack sudo[107935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:29:38 devstack sudo[107935]: pam_unix(sudo:session): session closed for user root Apr 29 15:29:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a07d0597-e675-4168-9b0d-37f765b18256 tempest-CreateVolumesFromSnapshotTest-1901764630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7e83c271-dac8-47a6-9dfb-38c4cf59c283" returned: 0 in 0.705s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:29:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a07d0597-e675-4168-9b0d-37f765b18256 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7e83c271-dac8-47a6-9dfb-38c4cf59c283 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:29:38 devstack sudo[107940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7e83c271-dac8-47a6-9dfb-38c4cf59c283 Apr 29 15:29:38 devstack sudo[107940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:29:38 devstack sudo[107940]: pam_unix(sudo:session): session closed for user root Apr 29 15:29:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a07d0597-e675-4168-9b0d-37f765b18256 tempest-CreateVolumesFromSnapshotTest-1901764630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7e83c271-dac8-47a6-9dfb-38c4cf59c283" returned: 0 in 0.590s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:29:38 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a07d0597-e675-4168-9b0d-37f765b18256 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Lock "cinder-quobyte-7e83c271-dac8-47a6-9dfb-38c4cf59c283" released by "delete_volume" :: held 1.333s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:29:38 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-a07d0597-e675-4168-9b0d-37f765b18256 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Created reservations ['37810dcd-6765-4330-948e-01b3d8b03db7', 'a6b92cf4-b052-464a-ae2c-e0edbcaeb67d', 'a9d11673-0f1c-4638-ba58-f160263db035', '267941cd-1216-4cff-a77d-6d150156d1c1'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:29:39 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-a07d0597-e675-4168-9b0d-37f765b18256 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:29:39 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-a07d0597-e675-4168-9b0d-37f765b18256 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:29:39 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-a07d0597-e675-4168-9b0d-37f765b18256 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:29:39 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-a07d0597-e675-4168-9b0d-37f765b18256 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:29:39 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-a07d0597-e675-4168-9b0d-37f765b18256 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:29:39 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a07d0597-e675-4168-9b0d-37f765b18256 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:29:39 devstack sudo[107943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:29:39 devstack sudo[107943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:29:39 devstack sudo[107943]: pam_unix(sudo:session): session closed for user root Apr 29 15:29:39 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a07d0597-e675-4168-9b0d-37f765b18256 tempest-CreateVolumesFromSnapshotTest-1901764630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.581s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:29:39 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-a07d0597-e675-4168-9b0d-37f765b18256 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:29:39 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-a07d0597-e675-4168-9b0d-37f765b18256 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Deleted volume successfully. Apr 29 15:29:39 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a07d0597-e675-4168-9b0d-37f765b18256 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Lock "cinder-7e83c271-dac8-47a6-9dfb-38c4cf59c283-delete_volume" released by "delete_volume" :: held 2.092s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:29:39 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-58ac67ec-f148-4265-8bdf-87a24df53f57 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Acquiring lock "cinder-c453254a-5dc9-4169-ac2b-b9f01bb7e29a-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:29:39 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-58ac67ec-f148-4265-8bdf-87a24df53f57 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Lock "cinder-c453254a-5dc9-4169-ac2b-b9f01bb7e29a-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:29:39 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-58ac67ec-f148-4265-8bdf-87a24df53f57 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Acquiring lock "cinder-quobyte-c453254a-5dc9-4169-ac2b-b9f01bb7e29a" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:29:39 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-58ac67ec-f148-4265-8bdf-87a24df53f57 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Lock "cinder-quobyte-c453254a-5dc9-4169-ac2b-b9f01bb7e29a" acquired by "delete_volume" :: waited 0.013s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:29:39 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9f41c9-3434-451f-8a5f-e675dbea42e3]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:29:39 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-58ac67ec-f148-4265-8bdf-87a24df53f57 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c453254a-5dc9-4169-ac2b-b9f01bb7e29a {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:29:39 devstack sudo[107947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c453254a-5dc9-4169-ac2b-b9f01bb7e29a Apr 29 15:29:39 devstack sudo[107947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:29:40 devstack sudo[107947]: pam_unix(sudo:session): session closed for user root Apr 29 15:29:40 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-58ac67ec-f148-4265-8bdf-87a24df53f57 tempest-CreateVolumesFromSnapshotTest-1901764630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c453254a-5dc9-4169-ac2b-b9f01bb7e29a" returned: 0 in 0.699s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:29:40 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-58ac67ec-f148-4265-8bdf-87a24df53f57 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c453254a-5dc9-4169-ac2b-b9f01bb7e29a {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:29:40 devstack sudo[107952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c453254a-5dc9-4169-ac2b-b9f01bb7e29a Apr 29 15:29:40 devstack sudo[107952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:29:41 devstack sudo[107952]: pam_unix(sudo:session): session closed for user root Apr 29 15:29:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-58ac67ec-f148-4265-8bdf-87a24df53f57 tempest-CreateVolumesFromSnapshotTest-1901764630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c453254a-5dc9-4169-ac2b-b9f01bb7e29a" returned: 0 in 0.594s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:29:41 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-58ac67ec-f148-4265-8bdf-87a24df53f57 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Lock "cinder-quobyte-c453254a-5dc9-4169-ac2b-b9f01bb7e29a" released by "delete_volume" :: held 1.331s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:29:41 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-58ac67ec-f148-4265-8bdf-87a24df53f57 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Created reservations ['ea4116b7-6769-49b5-b171-33320b28d629', '2e485df7-d206-4d2d-8fdb-331e5471a948', '2f283e90-539d-4d4b-9fa5-a315860cb892', '980730c7-5162-4811-9f48-327d206c8f4a'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:29:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-58ac67ec-f148-4265-8bdf-87a24df53f57 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:29:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-58ac67ec-f148-4265-8bdf-87a24df53f57 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:29:41 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-58ac67ec-f148-4265-8bdf-87a24df53f57 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:29:41 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-58ac67ec-f148-4265-8bdf-87a24df53f57 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:29:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-58ac67ec-f148-4265-8bdf-87a24df53f57 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:29:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-58ac67ec-f148-4265-8bdf-87a24df53f57 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:29:41 devstack sudo[107955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:29:41 devstack sudo[107955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:29:41 devstack sudo[107955]: pam_unix(sudo:session): session closed for user root Apr 29 15:29:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-58ac67ec-f148-4265-8bdf-87a24df53f57 tempest-CreateVolumesFromSnapshotTest-1901764630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.576s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:29:41 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-58ac67ec-f148-4265-8bdf-87a24df53f57 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:29:41 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-58ac67ec-f148-4265-8bdf-87a24df53f57 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Deleted volume successfully. Apr 29 15:29:41 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-58ac67ec-f148-4265-8bdf-87a24df53f57 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Lock "cinder-c453254a-5dc9-4169-ac2b-b9f01bb7e29a-delete_volume" released by "delete_volume" :: held 2.087s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:29:41 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-3f493f6c-3461-4b1d-84ca-3d728335ab48 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Acquiring lock "cinder-49f42311-257b-4d71-b61e-ca61d146392f-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:29:42 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-3f493f6c-3461-4b1d-84ca-3d728335ab48 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Lock "cinder-49f42311-257b-4d71-b61e-ca61d146392f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:29:42 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-3f493f6c-3461-4b1d-84ca-3d728335ab48 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Acquiring lock "cinder-quobyte-49f42311-257b-4d71-b61e-ca61d146392f" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:29:42 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-3f493f6c-3461-4b1d-84ca-3d728335ab48 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Lock "cinder-quobyte-49f42311-257b-4d71-b61e-ca61d146392f" acquired by "delete_volume" :: waited 0.017s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:29:42 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef285362-c190-4299-8212-d3e80bf1f507]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:29:42 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-3f493f6c-3461-4b1d-84ca-3d728335ab48 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-49f42311-257b-4d71-b61e-ca61d146392f {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:29:42 devstack sudo[107958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-49f42311-257b-4d71-b61e-ca61d146392f Apr 29 15:29:42 devstack sudo[107958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:29:42 devstack sudo[107958]: pam_unix(sudo:session): session closed for user root Apr 29 15:29:42 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-3f493f6c-3461-4b1d-84ca-3d728335ab48 tempest-CreateVolumesFromSnapshotTest-1901764630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-49f42311-257b-4d71-b61e-ca61d146392f" returned: 0 in 0.694s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:29:42 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-3f493f6c-3461-4b1d-84ca-3d728335ab48 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-49f42311-257b-4d71-b61e-ca61d146392f {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:29:42 devstack sudo[107965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-49f42311-257b-4d71-b61e-ca61d146392f Apr 29 15:29:42 devstack sudo[107965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:29:43 devstack sudo[107965]: pam_unix(sudo:session): session closed for user root Apr 29 15:29:43 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-3f493f6c-3461-4b1d-84ca-3d728335ab48 tempest-CreateVolumesFromSnapshotTest-1901764630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-49f42311-257b-4d71-b61e-ca61d146392f" returned: 0 in 0.590s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:29:43 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-3f493f6c-3461-4b1d-84ca-3d728335ab48 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Lock "cinder-quobyte-49f42311-257b-4d71-b61e-ca61d146392f" released by "delete_volume" :: held 1.328s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:29:43 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-3f493f6c-3461-4b1d-84ca-3d728335ab48 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Created reservations ['7196a880-4be1-4d6a-9dfc-92bc8f0882a1', 'bda7799f-d5c4-46a6-a038-f95edec79f70', 'cffe692c-9344-4cab-945f-d04d2bf26d0f', 'c69a1cf6-e823-4e32-85ec-40eed9268cf2'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:29:43 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-3f493f6c-3461-4b1d-84ca-3d728335ab48 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:29:43 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-3f493f6c-3461-4b1d-84ca-3d728335ab48 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:29:43 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-3f493f6c-3461-4b1d-84ca-3d728335ab48 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:29:43 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-3f493f6c-3461-4b1d-84ca-3d728335ab48 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:29:43 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-3f493f6c-3461-4b1d-84ca-3d728335ab48 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:29:43 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-3f493f6c-3461-4b1d-84ca-3d728335ab48 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:29:43 devstack sudo[107968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:29:43 devstack sudo[107968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:29:44 devstack sudo[107968]: pam_unix(sudo:session): session closed for user root Apr 29 15:29:44 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-3f493f6c-3461-4b1d-84ca-3d728335ab48 tempest-CreateVolumesFromSnapshotTest-1901764630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.584s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:29:44 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-3f493f6c-3461-4b1d-84ca-3d728335ab48 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:29:44 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-3f493f6c-3461-4b1d-84ca-3d728335ab48 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Deleted volume successfully. Apr 29 15:29:44 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-3f493f6c-3461-4b1d-84ca-3d728335ab48 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Lock "cinder-49f42311-257b-4d71-b61e-ca61d146392f-delete_volume" released by "delete_volume" :: held 2.090s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:29:44 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-ba6585e5-2d19-4cfe-b034-f1e42268316d tempest-CreateVolumesFromSnapshotTest-1901764630 None] Acquiring lock "cinder-c2c14c39-50b2-4e6e-abea-c110b9856835-delete_snapshot" by "delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:29:44 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-ba6585e5-2d19-4cfe-b034-f1e42268316d tempest-CreateVolumesFromSnapshotTest-1901764630 None] Lock "cinder-c2c14c39-50b2-4e6e-abea-c110b9856835-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:29:44 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-ba6585e5-2d19-4cfe-b034-f1e42268316d tempest-CreateVolumesFromSnapshotTest-1901764630 None] Acquiring lock "cinder-quobyte-bd9a5c34-8aa5-45b2-b032-f3c4aa364a9e" by "delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:29:44 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-ba6585e5-2d19-4cfe-b034-f1e42268316d tempest-CreateVolumesFromSnapshotTest-1901764630 None] Lock "cinder-quobyte-bd9a5c34-8aa5-45b2-b032-f3c4aa364a9e" acquired by "delete_snapshot" :: waited 0.016s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:29:44 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-ba6585e5-2d19-4cfe-b034-f1e42268316d tempest-CreateVolumesFromSnapshotTest-1901764630 None] Acquiring lock "cinder-quobyte-c2c14c39-50b2-4e6e-abea-c110b9856835" by "_delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:29:44 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-ba6585e5-2d19-4cfe-b034-f1e42268316d tempest-CreateVolumesFromSnapshotTest-1901764630 None] Lock "cinder-quobyte-c2c14c39-50b2-4e6e-abea-c110b9856835" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:29:44 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-ba6585e5-2d19-4cfe-b034-f1e42268316d tempest-CreateVolumesFromSnapshotTest-1901764630 None] Deleting offline snapshot c2c14c39-50b2-4e6e-abea-c110b9856835 of volume bd9a5c34-8aa5-45b2-b032-f3c4aa364a9e {{(pid=84448) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 15:29:44 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-ba6585e5-2d19-4cfe-b034-f1e42268316d tempest-CreateVolumesFromSnapshotTest-1901764630 None] snapshot_file for this snap is: volume-bd9a5c34-8aa5-45b2-b032-f3c4aa364a9e.c2c14c39-50b2-4e6e-abea-c110b9856835 {{(pid=84448) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 15:29:44 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39fe914-da3e-436d-ae61-e0e9400e7221]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:29:44 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ba6585e5-2d19-4cfe-b034-f1e42268316d tempest-CreateVolumesFromSnapshotTest-1901764630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-bd9a5c34-8aa5-45b2-b032-f3c4aa364a9e.c2c14c39-50b2-4e6e-abea-c110b9856835 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:29:44 devstack sudo[107976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-bd9a5c34-8aa5-45b2-b032-f3c4aa364a9e.c2c14c39-50b2-4e6e-abea-c110b9856835 Apr 29 15:29:44 devstack sudo[107976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:29:44 devstack sudo[107976]: pam_unix(sudo:session): session closed for user root Apr 29 15:29:45 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ba6585e5-2d19-4cfe-b034-f1e42268316d tempest-CreateVolumesFromSnapshotTest-1901764630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-bd9a5c34-8aa5-45b2-b032-f3c4aa364a9e.c2c14c39-50b2-4e6e-abea-c110b9856835" returned: 0 in 0.707s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:29:45 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-ba6585e5-2d19-4cfe-b034-f1e42268316d tempest-CreateVolumesFromSnapshotTest-1901764630 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd9a5c34-8aa5-45b2-b032-f3c4aa364a9e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84448) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 15:29:45 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[af5df466-f164-48cb-bb93-e1b79abe7ec5]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:29:45 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ba6585e5-2d19-4cfe-b034-f1e42268316d tempest-CreateVolumesFromSnapshotTest-1901764630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-bd9a5c34-8aa5-45b2-b032-f3c4aa364a9e {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:29:45 devstack sudo[107996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-bd9a5c34-8aa5-45b2-b032-f3c4aa364a9e Apr 29 15:29:45 devstack sudo[107996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:29:45 devstack sudo[107996]: pam_unix(sudo:session): session closed for user root Apr 29 15:29:45 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ba6585e5-2d19-4cfe-b034-f1e42268316d tempest-CreateVolumesFromSnapshotTest-1901764630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-bd9a5c34-8aa5-45b2-b032-f3c4aa364a9e" returned: 0 in 0.713s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:29:45 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ba6585e5-2d19-4cfe-b034-f1e42268316d tempest-CreateVolumesFromSnapshotTest-1901764630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-bd9a5c34-8aa5-45b2-b032-f3c4aa364a9e.c2c14c39-50b2-4e6e-abea-c110b9856835 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:29:45 devstack sudo[108002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-bd9a5c34-8aa5-45b2-b032-f3c4aa364a9e.c2c14c39-50b2-4e6e-abea-c110b9856835 Apr 29 15:29:45 devstack sudo[108002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:29:46 devstack sudo[108002]: pam_unix(sudo:session): session closed for user root Apr 29 15:29:46 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ba6585e5-2d19-4cfe-b034-f1e42268316d tempest-CreateVolumesFromSnapshotTest-1901764630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-bd9a5c34-8aa5-45b2-b032-f3c4aa364a9e.c2c14c39-50b2-4e6e-abea-c110b9856835" returned: 0 in 0.698s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:29:46 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ba6585e5-2d19-4cfe-b034-f1e42268316d tempest-CreateVolumesFromSnapshotTest-1901764630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-bd9a5c34-8aa5-45b2-b032-f3c4aa364a9e.c2c14c39-50b2-4e6e-abea-c110b9856835 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:29:46 devstack sudo[108009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-bd9a5c34-8aa5-45b2-b032-f3c4aa364a9e.c2c14c39-50b2-4e6e-abea-c110b9856835 Apr 29 15:29:46 devstack sudo[108009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:29:47 devstack sudo[108009]: pam_unix(sudo:session): session closed for user root Apr 29 15:29:47 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ba6585e5-2d19-4cfe-b034-f1e42268316d tempest-CreateVolumesFromSnapshotTest-1901764630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-bd9a5c34-8aa5-45b2-b032-f3c4aa364a9e.c2c14c39-50b2-4e6e-abea-c110b9856835" returned: 0 in 0.595s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:29:47 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-ba6585e5-2d19-4cfe-b034-f1e42268316d tempest-CreateVolumesFromSnapshotTest-1901764630 None] Lock "cinder-quobyte-c2c14c39-50b2-4e6e-abea-c110b9856835" released by "_delete_snapshot" :: held 2.822s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:29:47 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-ba6585e5-2d19-4cfe-b034-f1e42268316d tempest-CreateVolumesFromSnapshotTest-1901764630 None] Lock "cinder-quobyte-bd9a5c34-8aa5-45b2-b032-f3c4aa364a9e" released by "delete_snapshot" :: held 2.846s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:29:47 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-ba6585e5-2d19-4cfe-b034-f1e42268316d tempest-CreateVolumesFromSnapshotTest-1901764630 None] Created reservations ['7d3913e1-43d6-4437-be14-536feaf41621', 'b3a3934f-e5c4-442f-96d8-dff17c9b9935', '75f922a9-9e07-496c-8cbc-5edf8457fb60', 'e208e6dc-ae92-477b-9766-4a3412e35186'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:29:47 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-ba6585e5-2d19-4cfe-b034-f1e42268316d tempest-CreateVolumesFromSnapshotTest-1901764630 None] Delete snapshot completed successfully. Apr 29 15:29:47 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-ba6585e5-2d19-4cfe-b034-f1e42268316d tempest-CreateVolumesFromSnapshotTest-1901764630 None] Lock "cinder-c2c14c39-50b2-4e6e-abea-c110b9856835-delete_snapshot" released by "delete_snapshot" :: held 2.975s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:29:47 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-1c6a1f1e-8c06-4858-af44-1be063bed285 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Acquiring lock "cinder-bd9a5c34-8aa5-45b2-b032-f3c4aa364a9e-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:29:47 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-1c6a1f1e-8c06-4858-af44-1be063bed285 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Lock "cinder-bd9a5c34-8aa5-45b2-b032-f3c4aa364a9e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:29:47 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-1c6a1f1e-8c06-4858-af44-1be063bed285 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Acquiring lock "cinder-quobyte-bd9a5c34-8aa5-45b2-b032-f3c4aa364a9e" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:29:47 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-1c6a1f1e-8c06-4858-af44-1be063bed285 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Lock "cinder-quobyte-bd9a5c34-8aa5-45b2-b032-f3c4aa364a9e" acquired by "delete_volume" :: waited 0.014s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:29:47 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[36df0c9c-f705-4d22-b811-6aad9752e6ce]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:29:47 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1c6a1f1e-8c06-4858-af44-1be063bed285 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-bd9a5c34-8aa5-45b2-b032-f3c4aa364a9e {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:29:47 devstack sudo[108012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-bd9a5c34-8aa5-45b2-b032-f3c4aa364a9e Apr 29 15:29:47 devstack sudo[108012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:29:48 devstack sudo[108012]: pam_unix(sudo:session): session closed for user root Apr 29 15:29:48 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1c6a1f1e-8c06-4858-af44-1be063bed285 tempest-CreateVolumesFromSnapshotTest-1901764630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-bd9a5c34-8aa5-45b2-b032-f3c4aa364a9e" returned: 0 in 0.701s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:29:48 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1c6a1f1e-8c06-4858-af44-1be063bed285 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-bd9a5c34-8aa5-45b2-b032-f3c4aa364a9e {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:29:48 devstack sudo[108017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-bd9a5c34-8aa5-45b2-b032-f3c4aa364a9e Apr 29 15:29:48 devstack sudo[108017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:29:48 devstack sudo[108017]: pam_unix(sudo:session): session closed for user root Apr 29 15:29:48 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1c6a1f1e-8c06-4858-af44-1be063bed285 tempest-CreateVolumesFromSnapshotTest-1901764630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-bd9a5c34-8aa5-45b2-b032-f3c4aa364a9e" returned: 0 in 0.592s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:29:48 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-1c6a1f1e-8c06-4858-af44-1be063bed285 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Lock "cinder-quobyte-bd9a5c34-8aa5-45b2-b032-f3c4aa364a9e" released by "delete_volume" :: held 1.357s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:29:48 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-1c6a1f1e-8c06-4858-af44-1be063bed285 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Created reservations ['b31f9c41-97e8-48f2-8e5b-a453637c6f8d', '8239416a-83c9-4440-98ac-1e4bf2ebdc93', '1f32ca78-4561-4ed5-a91c-8323669dffb8', '3c5cf81d-618f-42cf-8d63-b7cf6eebb37b'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:29:48 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-1c6a1f1e-8c06-4858-af44-1be063bed285 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:29:48 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-1c6a1f1e-8c06-4858-af44-1be063bed285 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:29:48 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-1c6a1f1e-8c06-4858-af44-1be063bed285 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:29:48 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-1c6a1f1e-8c06-4858-af44-1be063bed285 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:29:48 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-1c6a1f1e-8c06-4858-af44-1be063bed285 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:29:48 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1c6a1f1e-8c06-4858-af44-1be063bed285 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:29:48 devstack sudo[108020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:29:48 devstack sudo[108020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:29:49 devstack sudo[108020]: pam_unix(sudo:session): session closed for user root Apr 29 15:29:49 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1c6a1f1e-8c06-4858-af44-1be063bed285 tempest-CreateVolumesFromSnapshotTest-1901764630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.601s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:29:49 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-1c6a1f1e-8c06-4858-af44-1be063bed285 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:29:49 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-1c6a1f1e-8c06-4858-af44-1be063bed285 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Deleted volume successfully. Apr 29 15:29:49 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-1c6a1f1e-8c06-4858-af44-1be063bed285 tempest-CreateVolumesFromSnapshotTest-1901764630 None] Lock "cinder-bd9a5c34-8aa5-45b2-b032-f3c4aa364a9e-delete_volume" released by "delete_volume" :: held 2.141s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:29:58 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:INSERT=7,cinder:UPDATE=52,cinder:SELECT=28,cinder:DELETE=2 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:29:59 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:SELECT=23,cinder:INSERT=14,cinder:UPDATE=32,cinder:DELETE=3 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:30:30 devstack cinder-volume[84448]: DEBUG oslo_service.periodic_task [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84448) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 15:30:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:30:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:30:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:30:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:30:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:30:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:30:30 devstack sudo[108031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:30:30 devstack sudo[108031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:30:30 devstack sudo[108031]: pam_unix(sudo:session): session closed for user root Apr 29 15:30:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.574s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:30:30 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:31:30 devstack cinder-volume[84448]: DEBUG oslo_service.periodic_task [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84448) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 15:31:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:31:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:31:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:31:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:31:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:31:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:31:30 devstack sudo[108105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:31:30 devstack sudo[108105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:31:30 devstack sudo[108105]: pam_unix(sudo:session): session closed for user root Apr 29 15:31:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.582s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:31:30 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:31:32 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:SELECT=1 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:31:32 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:UPDATE=1 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:32:30 devstack cinder-volume[84448]: DEBUG oslo_service.periodic_task [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84448) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 15:32:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:32:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:32:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:32:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:32:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:32:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:32:30 devstack sudo[108178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:32:30 devstack sudo[108178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:32:30 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-7bc44412-8346-4e2d-9d1c-5a6f0a1595d0 tempest-ServerRescueNegativeTestJSON-1253271205 None] Acquiring lock "cinder-cebb93e5-5b0c-4815-9431-d7b2f3c83123-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:32:30 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-7bc44412-8346-4e2d-9d1c-5a6f0a1595d0 tempest-ServerRescueNegativeTestJSON-1253271205 None] Lock "cinder-cebb93e5-5b0c-4815-9431-d7b2f3c83123-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:32:30 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-7bc44412-8346-4e2d-9d1c-5a6f0a1595d0 tempest-ServerRescueNegativeTestJSON-1253271205 None] Acquiring lock "cinder-quobyte-cebb93e5-5b0c-4815-9431-d7b2f3c83123" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:32:30 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-7bc44412-8346-4e2d-9d1c-5a6f0a1595d0 tempest-ServerRescueNegativeTestJSON-1253271205 None] Lock "cinder-quobyte-cebb93e5-5b0c-4815-9431-d7b2f3c83123" acquired by "delete_volume" :: waited 0.024s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:32:30 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5b991c-195c-494c-8ea9-f3895bf40eab]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:32:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7bc44412-8346-4e2d-9d1c-5a6f0a1595d0 tempest-ServerRescueNegativeTestJSON-1253271205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cebb93e5-5b0c-4815-9431-d7b2f3c83123 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:32:30 devstack sudo[108180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cebb93e5-5b0c-4815-9431-d7b2f3c83123 Apr 29 15:32:30 devstack sudo[108180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:32:31 devstack sudo[108178]: pam_unix(sudo:session): session closed for user root Apr 29 15:32:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.603s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:32:31 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:32:31 devstack sudo[108180]: pam_unix(sudo:session): session closed for user root Apr 29 15:32:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7bc44412-8346-4e2d-9d1c-5a6f0a1595d0 tempest-ServerRescueNegativeTestJSON-1253271205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cebb93e5-5b0c-4815-9431-d7b2f3c83123" returned: 0 in 0.705s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:32:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7bc44412-8346-4e2d-9d1c-5a6f0a1595d0 tempest-ServerRescueNegativeTestJSON-1253271205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cebb93e5-5b0c-4815-9431-d7b2f3c83123 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:32:31 devstack sudo[108186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cebb93e5-5b0c-4815-9431-d7b2f3c83123 Apr 29 15:32:31 devstack sudo[108186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:32:31 devstack sudo[108186]: pam_unix(sudo:session): session closed for user root Apr 29 15:32:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7bc44412-8346-4e2d-9d1c-5a6f0a1595d0 tempest-ServerRescueNegativeTestJSON-1253271205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-cebb93e5-5b0c-4815-9431-d7b2f3c83123" returned: 0 in 0.616s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:32:31 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-7bc44412-8346-4e2d-9d1c-5a6f0a1595d0 tempest-ServerRescueNegativeTestJSON-1253271205 None] Lock "cinder-quobyte-cebb93e5-5b0c-4815-9431-d7b2f3c83123" released by "delete_volume" :: held 1.360s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:32:31 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-7bc44412-8346-4e2d-9d1c-5a6f0a1595d0 tempest-ServerRescueNegativeTestJSON-1253271205 None] Created reservations ['77c945ec-f4c5-4654-b2da-3d95582f8df4', '5bbbfeec-89f5-46c5-90a1-eaf8fbd57812', 'f8ecab0d-6c05-421f-a1f7-8b510a88f27c', '74f6b6fe-ee79-41d7-80c0-bb027b085254'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:32:32 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-7bc44412-8346-4e2d-9d1c-5a6f0a1595d0 tempest-ServerRescueNegativeTestJSON-1253271205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:32:32 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-7bc44412-8346-4e2d-9d1c-5a6f0a1595d0 tempest-ServerRescueNegativeTestJSON-1253271205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:32:32 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-7bc44412-8346-4e2d-9d1c-5a6f0a1595d0 tempest-ServerRescueNegativeTestJSON-1253271205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:32:32 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-7bc44412-8346-4e2d-9d1c-5a6f0a1595d0 tempest-ServerRescueNegativeTestJSON-1253271205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:32:32 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-7bc44412-8346-4e2d-9d1c-5a6f0a1595d0 tempest-ServerRescueNegativeTestJSON-1253271205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:32:32 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7bc44412-8346-4e2d-9d1c-5a6f0a1595d0 tempest-ServerRescueNegativeTestJSON-1253271205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:32:32 devstack sudo[108192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:32:32 devstack sudo[108192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:32:32 devstack sudo[108192]: pam_unix(sudo:session): session closed for user root Apr 29 15:32:32 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7bc44412-8346-4e2d-9d1c-5a6f0a1595d0 tempest-ServerRescueNegativeTestJSON-1253271205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.574s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:32:32 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-7bc44412-8346-4e2d-9d1c-5a6f0a1595d0 tempest-ServerRescueNegativeTestJSON-1253271205 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:32:32 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-7bc44412-8346-4e2d-9d1c-5a6f0a1595d0 tempest-ServerRescueNegativeTestJSON-1253271205 None] Deleted volume successfully. Apr 29 15:32:32 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-7bc44412-8346-4e2d-9d1c-5a6f0a1595d0 tempest-ServerRescueNegativeTestJSON-1253271205 None] Lock "cinder-cebb93e5-5b0c-4815-9431-d7b2f3c83123-delete_volume" released by "delete_volume" :: held 2.145s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:32:42 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:UPDATE=9,cinder:SELECT=4,cinder:INSERT=2 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:32:42 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:32:51 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [req-55979424-7a6c-4d0c-b67a-465ad787f24b req-8b375586-6b49-445a-b811-3a5ae7c8f5c0 tempest-VolumesGetTestJSON-1101315430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:32:51 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-55979424-7a6c-4d0c-b67a-465ad787f24b req-8b375586-6b49-445a-b811-3a5ae7c8f5c0 tempest-VolumesGetTestJSON-1101315430 None] Flow 'volume_create_manager' (b780fa40-a43a-4153-a533-850a38b28ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:32:51 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-55979424-7a6c-4d0c-b67a-465ad787f24b req-8b375586-6b49-445a-b811-3a5ae7c8f5c0 tempest-VolumesGetTestJSON-1101315430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (843cddd0-6c95-42e2-a8b1-b1e56dafce7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:32:51 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-55979424-7a6c-4d0c-b67a-465ad787f24b req-8b375586-6b49-445a-b811-3a5ae7c8f5c0 tempest-VolumesGetTestJSON-1101315430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (843cddd0-6c95-42e2-a8b1-b1e56dafce7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:32:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1082765450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29bea1e6-5863-46a3-ac7b-2d5beca6b6d9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='53d5064d30db420fa2b08131de58be67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:32:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:32:52Z,use_quota=True,user_id='406a8ec074364484bb7634cfbbed8f54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:32:51 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-55979424-7a6c-4d0c-b67a-465ad787f24b req-8b375586-6b49-445a-b811-3a5ae7c8f5c0 tempest-VolumesGetTestJSON-1101315430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4550e9f-3f5e-4f30-a482-f31435e2bde5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:32:51 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-55979424-7a6c-4d0c-b67a-465ad787f24b req-8b375586-6b49-445a-b811-3a5ae7c8f5c0 tempest-VolumesGetTestJSON-1101315430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4550e9f-3f5e-4f30-a482-f31435e2bde5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:32:51 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-55979424-7a6c-4d0c-b67a-465ad787f24b req-8b375586-6b49-445a-b811-3a5ae7c8f5c0 tempest-VolumesGetTestJSON-1101315430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c12f0e4f-3688-413b-9fbe-a590172ad9c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:32:51 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-55979424-7a6c-4d0c-b67a-465ad787f24b req-8b375586-6b49-445a-b811-3a5ae7c8f5c0 tempest-VolumesGetTestJSON-1101315430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c12f0e4f-3688-413b-9fbe-a590172ad9c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29bea1e6-5863-46a3-ac7b-2d5beca6b6d9', 'volume_name': 'volume-29bea1e6-5863-46a3-ac7b-2d5beca6b6d9', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:32:51 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-55979424-7a6c-4d0c-b67a-465ad787f24b req-8b375586-6b49-445a-b811-3a5ae7c8f5c0 tempest-VolumesGetTestJSON-1101315430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2e13517-1676-4e5c-8520-63eb2f1539fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:32:51 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-55979424-7a6c-4d0c-b67a-465ad787f24b req-8b375586-6b49-445a-b811-3a5ae7c8f5c0 tempest-VolumesGetTestJSON-1101315430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2e13517-1676-4e5c-8520-63eb2f1539fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:32:51 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-55979424-7a6c-4d0c-b67a-465ad787f24b req-8b375586-6b49-445a-b811-3a5ae7c8f5c0 tempest-VolumesGetTestJSON-1101315430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52a9e096-9261-4610-a248-ce652e55c09d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:32:51 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [req-55979424-7a6c-4d0c-b67a-465ad787f24b req-8b375586-6b49-445a-b811-3a5ae7c8f5c0 tempest-VolumesGetTestJSON-1101315430 None] Volume 29bea1e6-5863-46a3-ac7b-2d5beca6b6d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29bea1e6-5863-46a3-ac7b-2d5beca6b6d9', 'volume_size': 1} Apr 29 15:32:51 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-55979424-7a6c-4d0c-b67a-465ad787f24b req-8b375586-6b49-445a-b811-3a5ae7c8f5c0 tempest-VolumesGetTestJSON-1101315430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:32:51 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-55979424-7a6c-4d0c-b67a-465ad787f24b req-8b375586-6b49-445a-b811-3a5ae7c8f5c0 tempest-VolumesGetTestJSON-1101315430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:32:51 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [req-55979424-7a6c-4d0c-b67a-465ad787f24b req-8b375586-6b49-445a-b811-3a5ae7c8f5c0 tempest-VolumesGetTestJSON-1101315430 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:32:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1082765450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29bea1e6-5863-46a3-ac7b-2d5beca6b6d9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='53d5064d30db420fa2b08131de58be67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:32:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:32:52Z,use_quota=True,user_id='406a8ec074364484bb7634cfbbed8f54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:32:51 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [req-55979424-7a6c-4d0c-b67a-465ad787f24b req-8b375586-6b49-445a-b811-3a5ae7c8f5c0 tempest-VolumesGetTestJSON-1101315430 None] Creating volume 29bea1e6-5863-46a3-ac7b-2d5beca6b6d9 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:32:51 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-55979424-7a6c-4d0c-b67a-465ad787f24b req-8b375586-6b49-445a-b811-3a5ae7c8f5c0 tempest-VolumesGetTestJSON-1101315430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:32:51 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-55979424-7a6c-4d0c-b67a-465ad787f24b req-8b375586-6b49-445a-b811-3a5ae7c8f5c0 tempest-VolumesGetTestJSON-1101315430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:32:51 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [req-55979424-7a6c-4d0c-b67a-465ad787f24b req-8b375586-6b49-445a-b811-3a5ae7c8f5c0 tempest-VolumesGetTestJSON-1101315430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:32:51 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [req-55979424-7a6c-4d0c-b67a-465ad787f24b req-8b375586-6b49-445a-b811-3a5ae7c8f5c0 tempest-VolumesGetTestJSON-1101315430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:32:51 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-55979424-7a6c-4d0c-b67a-465ad787f24b req-8b375586-6b49-445a-b811-3a5ae7c8f5c0 tempest-VolumesGetTestJSON-1101315430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:32:51 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [req-55979424-7a6c-4d0c-b67a-465ad787f24b req-8b375586-6b49-445a-b811-3a5ae7c8f5c0 tempest-VolumesGetTestJSON-1101315430 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:32:51 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [req-55979424-7a6c-4d0c-b67a-465ad787f24b req-8b375586-6b49-445a-b811-3a5ae7c8f5c0 tempest-VolumesGetTestJSON-1101315430 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:32:51 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-55979424-7a6c-4d0c-b67a-465ad787f24b req-8b375586-6b49-445a-b811-3a5ae7c8f5c0 tempest-VolumesGetTestJSON-1101315430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-29bea1e6-5863-46a3-ac7b-2d5beca6b6d9 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:32:51 devstack sudo[108351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-29bea1e6-5863-46a3-ac7b-2d5beca6b6d9 1073741824 Apr 29 15:32:51 devstack sudo[108351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:32:52 devstack sudo[108351]: pam_unix(sudo:session): session closed for user root Apr 29 15:32:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-55979424-7a6c-4d0c-b67a-465ad787f24b req-8b375586-6b49-445a-b811-3a5ae7c8f5c0 tempest-VolumesGetTestJSON-1101315430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-29bea1e6-5863-46a3-ac7b-2d5beca6b6d9 1073741824" returned: 0 in 0.747s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:32:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-55979424-7a6c-4d0c-b67a-465ad787f24b req-8b375586-6b49-445a-b811-3a5ae7c8f5c0 tempest-VolumesGetTestJSON-1101315430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-29bea1e6-5863-46a3-ac7b-2d5beca6b6d9 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:32:52 devstack sudo[108356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-29bea1e6-5863-46a3-ac7b-2d5beca6b6d9 Apr 29 15:32:52 devstack sudo[108356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:32:53 devstack sudo[108356]: pam_unix(sudo:session): session closed for user root Apr 29 15:32:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-55979424-7a6c-4d0c-b67a-465ad787f24b req-8b375586-6b49-445a-b811-3a5ae7c8f5c0 tempest-VolumesGetTestJSON-1101315430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-29bea1e6-5863-46a3-ac7b-2d5beca6b6d9" returned: 0 in 0.606s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:32:53 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [req-55979424-7a6c-4d0c-b67a-465ad787f24b req-8b375586-6b49-445a-b811-3a5ae7c8f5c0 tempest-VolumesGetTestJSON-1101315430 None] <== create_volume: return (1390ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:32:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-55979424-7a6c-4d0c-b67a-465ad787f24b req-8b375586-6b49-445a-b811-3a5ae7c8f5c0 tempest-VolumesGetTestJSON-1101315430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.392s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:32:53 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-55979424-7a6c-4d0c-b67a-465ad787f24b req-8b375586-6b49-445a-b811-3a5ae7c8f5c0 tempest-VolumesGetTestJSON-1101315430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52a9e096-9261-4610-a248-ce652e55c09d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29bea1e6-5863-46a3-ac7b-2d5beca6b6d9', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:32:53 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-55979424-7a6c-4d0c-b67a-465ad787f24b req-8b375586-6b49-445a-b811-3a5ae7c8f5c0 tempest-VolumesGetTestJSON-1101315430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc183e3f-3413-4463-88c0-2a20f14ff2bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:32:53 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [req-55979424-7a6c-4d0c-b67a-465ad787f24b req-8b375586-6b49-445a-b811-3a5ae7c8f5c0 tempest-VolumesGetTestJSON-1101315430 None] Volume volume-29bea1e6-5863-46a3-ac7b-2d5beca6b6d9 (29bea1e6-5863-46a3-ac7b-2d5beca6b6d9): created successfully Apr 29 15:32:53 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-55979424-7a6c-4d0c-b67a-465ad787f24b req-8b375586-6b49-445a-b811-3a5ae7c8f5c0 tempest-VolumesGetTestJSON-1101315430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc183e3f-3413-4463-88c0-2a20f14ff2bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:32:53 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-55979424-7a6c-4d0c-b67a-465ad787f24b req-8b375586-6b49-445a-b811-3a5ae7c8f5c0 tempest-VolumesGetTestJSON-1101315430 None] Flow 'volume_create_manager' (b780fa40-a43a-4153-a533-850a38b28ebd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:32:53 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-55979424-7a6c-4d0c-b67a-465ad787f24b req-8b375586-6b49-445a-b811-3a5ae7c8f5c0 tempest-VolumesGetTestJSON-1101315430 None] Created volume successfully. Apr 29 15:32:53 devstack cinder-volume[84448]: DEBUG cinder.coordination [req-2176e3cb-9c31-4070-b371-bd4aff7a3615 req-312125f5-8965-47cc-a37b-fa03339d53c6 tempest-VolumesGetTestJSON-1101315430 None] Acquiring lock "cinder-29bea1e6-5863-46a3-ac7b-2d5beca6b6d9-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:32:53 devstack cinder-volume[84448]: DEBUG cinder.coordination [req-2176e3cb-9c31-4070-b371-bd4aff7a3615 req-312125f5-8965-47cc-a37b-fa03339d53c6 tempest-VolumesGetTestJSON-1101315430 None] Lock "cinder-29bea1e6-5863-46a3-ac7b-2d5beca6b6d9-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:32:54 devstack cinder-volume[84448]: DEBUG cinder.coordination [req-2176e3cb-9c31-4070-b371-bd4aff7a3615 req-312125f5-8965-47cc-a37b-fa03339d53c6 tempest-VolumesGetTestJSON-1101315430 None] Acquiring lock "cinder-quobyte-29bea1e6-5863-46a3-ac7b-2d5beca6b6d9" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:32:54 devstack cinder-volume[84448]: DEBUG cinder.coordination [req-2176e3cb-9c31-4070-b371-bd4aff7a3615 req-312125f5-8965-47cc-a37b-fa03339d53c6 tempest-VolumesGetTestJSON-1101315430 None] Lock "cinder-quobyte-29bea1e6-5863-46a3-ac7b-2d5beca6b6d9" acquired by "delete_volume" :: waited 0.013s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:32:54 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[6891065b-b670-43ca-a9c2-85c1b94ef893]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:32:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-2176e3cb-9c31-4070-b371-bd4aff7a3615 req-312125f5-8965-47cc-a37b-fa03339d53c6 tempest-VolumesGetTestJSON-1101315430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-29bea1e6-5863-46a3-ac7b-2d5beca6b6d9 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:32:54 devstack sudo[108359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-29bea1e6-5863-46a3-ac7b-2d5beca6b6d9 Apr 29 15:32:54 devstack sudo[108359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:32:54 devstack sudo[108359]: pam_unix(sudo:session): session closed for user root Apr 29 15:32:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-2176e3cb-9c31-4070-b371-bd4aff7a3615 req-312125f5-8965-47cc-a37b-fa03339d53c6 tempest-VolumesGetTestJSON-1101315430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-29bea1e6-5863-46a3-ac7b-2d5beca6b6d9" returned: 0 in 0.713s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:32:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-2176e3cb-9c31-4070-b371-bd4aff7a3615 req-312125f5-8965-47cc-a37b-fa03339d53c6 tempest-VolumesGetTestJSON-1101315430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-29bea1e6-5863-46a3-ac7b-2d5beca6b6d9 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:32:54 devstack sudo[108364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-29bea1e6-5863-46a3-ac7b-2d5beca6b6d9 Apr 29 15:32:54 devstack sudo[108364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:32:55 devstack sudo[108364]: pam_unix(sudo:session): session closed for user root Apr 29 15:32:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-2176e3cb-9c31-4070-b371-bd4aff7a3615 req-312125f5-8965-47cc-a37b-fa03339d53c6 tempest-VolumesGetTestJSON-1101315430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-29bea1e6-5863-46a3-ac7b-2d5beca6b6d9" returned: 0 in 0.574s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:32:55 devstack cinder-volume[84448]: DEBUG cinder.coordination [req-2176e3cb-9c31-4070-b371-bd4aff7a3615 req-312125f5-8965-47cc-a37b-fa03339d53c6 tempest-VolumesGetTestJSON-1101315430 None] Lock "cinder-quobyte-29bea1e6-5863-46a3-ac7b-2d5beca6b6d9" released by "delete_volume" :: held 1.336s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:32:55 devstack cinder-volume[84448]: DEBUG cinder.quota [req-2176e3cb-9c31-4070-b371-bd4aff7a3615 req-312125f5-8965-47cc-a37b-fa03339d53c6 tempest-VolumesGetTestJSON-1101315430 None] Created reservations ['12b74318-b31e-4d27-93d1-17cb6a570fbc', '4f2a57b1-9c7d-4dc3-b677-4fc98118e8eb', '2a730332-2f93-40ad-bae8-12cfe695825a', '37c15fb9-15bf-4eb4-8738-d9da2234f3ea'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:32:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-2176e3cb-9c31-4070-b371-bd4aff7a3615 req-312125f5-8965-47cc-a37b-fa03339d53c6 tempest-VolumesGetTestJSON-1101315430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:32:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-2176e3cb-9c31-4070-b371-bd4aff7a3615 req-312125f5-8965-47cc-a37b-fa03339d53c6 tempest-VolumesGetTestJSON-1101315430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:32:55 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [req-2176e3cb-9c31-4070-b371-bd4aff7a3615 req-312125f5-8965-47cc-a37b-fa03339d53c6 tempest-VolumesGetTestJSON-1101315430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:32:55 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [req-2176e3cb-9c31-4070-b371-bd4aff7a3615 req-312125f5-8965-47cc-a37b-fa03339d53c6 tempest-VolumesGetTestJSON-1101315430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:32:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-2176e3cb-9c31-4070-b371-bd4aff7a3615 req-312125f5-8965-47cc-a37b-fa03339d53c6 tempest-VolumesGetTestJSON-1101315430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:32:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-2176e3cb-9c31-4070-b371-bd4aff7a3615 req-312125f5-8965-47cc-a37b-fa03339d53c6 tempest-VolumesGetTestJSON-1101315430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:32:55 devstack sudo[108367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:32:55 devstack sudo[108367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:32:56 devstack sudo[108367]: pam_unix(sudo:session): session closed for user root Apr 29 15:32:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-2176e3cb-9c31-4070-b371-bd4aff7a3615 req-312125f5-8965-47cc-a37b-fa03339d53c6 tempest-VolumesGetTestJSON-1101315430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.569s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:32:56 devstack cinder-volume[84448]: DEBUG cinder.manager [req-2176e3cb-9c31-4070-b371-bd4aff7a3615 req-312125f5-8965-47cc-a37b-fa03339d53c6 tempest-VolumesGetTestJSON-1101315430 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:32:56 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-2176e3cb-9c31-4070-b371-bd4aff7a3615 req-312125f5-8965-47cc-a37b-fa03339d53c6 tempest-VolumesGetTestJSON-1101315430 None] Deleted volume successfully. Apr 29 15:32:56 devstack cinder-volume[84448]: DEBUG cinder.coordination [req-2176e3cb-9c31-4070-b371-bd4aff7a3615 req-312125f5-8965-47cc-a37b-fa03339d53c6 tempest-VolumesGetTestJSON-1101315430 None] Lock "cinder-29bea1e6-5863-46a3-ac7b-2d5beca6b6d9-delete_volume" released by "delete_volume" :: held 2.088s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:32:59 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dffb097-07c9-4120-8ed6-3b0addc5b7dd tempest-VolumesTestJSON-1828905808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:32:59 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6dffb097-07c9-4120-8ed6-3b0addc5b7dd tempest-VolumesTestJSON-1828905808 None] Flow 'volume_create_manager' (398369a9-2352-483c-9878-9c1570cd90ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:32:59 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6dffb097-07c9-4120-8ed6-3b0addc5b7dd tempest-VolumesTestJSON-1828905808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60218051-51dc-4daa-9fd4-c89047ff8e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:32:59 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6dffb097-07c9-4120-8ed6-3b0addc5b7dd tempest-VolumesTestJSON-1828905808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60218051-51dc-4daa-9fd4-c89047ff8e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:32:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-562848992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0db2155-2a49-423a-a62e-ab8e9cc18d15,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ccfaa210660a4fc2827acb164f3779e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:32:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:32:59Z,use_quota=True,user_id='6f7a63876a224088b1ab7f382e103a08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:32:59 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6dffb097-07c9-4120-8ed6-3b0addc5b7dd tempest-VolumesTestJSON-1828905808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1862e645-779d-4929-adfd-791abf71b8f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:32:59 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6dffb097-07c9-4120-8ed6-3b0addc5b7dd tempest-VolumesTestJSON-1828905808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1862e645-779d-4929-adfd-791abf71b8f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:32:59 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6dffb097-07c9-4120-8ed6-3b0addc5b7dd tempest-VolumesTestJSON-1828905808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32032a05-7cc1-43ba-888d-ea9caa59c441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:32:59 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6dffb097-07c9-4120-8ed6-3b0addc5b7dd tempest-VolumesTestJSON-1828905808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32032a05-7cc1-43ba-888d-ea9caa59c441) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0db2155-2a49-423a-a62e-ab8e9cc18d15', 'volume_name': 'volume-c0db2155-2a49-423a-a62e-ab8e9cc18d15', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:32:59 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6dffb097-07c9-4120-8ed6-3b0addc5b7dd tempest-VolumesTestJSON-1828905808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14b587ba-c48d-4f7b-9d8d-efa5ac3f1cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:32:59 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6dffb097-07c9-4120-8ed6-3b0addc5b7dd tempest-VolumesTestJSON-1828905808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14b587ba-c48d-4f7b-9d8d-efa5ac3f1cbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:32:59 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6dffb097-07c9-4120-8ed6-3b0addc5b7dd tempest-VolumesTestJSON-1828905808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dd03d8b-168b-4284-a3b2-634a07981d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:32:59 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-6dffb097-07c9-4120-8ed6-3b0addc5b7dd tempest-VolumesTestJSON-1828905808 None] Volume c0db2155-2a49-423a-a62e-ab8e9cc18d15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0db2155-2a49-423a-a62e-ab8e9cc18d15', 'volume_size': 1} Apr 29 15:32:59 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-6dffb097-07c9-4120-8ed6-3b0addc5b7dd tempest-VolumesTestJSON-1828905808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:32:59 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-6dffb097-07c9-4120-8ed6-3b0addc5b7dd tempest-VolumesTestJSON-1828905808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:32:59 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-6dffb097-07c9-4120-8ed6-3b0addc5b7dd tempest-VolumesTestJSON-1828905808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:32:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-562848992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0db2155-2a49-423a-a62e-ab8e9cc18d15,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ccfaa210660a4fc2827acb164f3779e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:32:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:32:59Z,use_quota=True,user_id='6f7a63876a224088b1ab7f382e103a08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:32:59 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-6dffb097-07c9-4120-8ed6-3b0addc5b7dd tempest-VolumesTestJSON-1828905808 None] Creating volume c0db2155-2a49-423a-a62e-ab8e9cc18d15 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:32:59 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-6dffb097-07c9-4120-8ed6-3b0addc5b7dd tempest-VolumesTestJSON-1828905808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:32:59 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-6dffb097-07c9-4120-8ed6-3b0addc5b7dd tempest-VolumesTestJSON-1828905808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:32:59 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-6dffb097-07c9-4120-8ed6-3b0addc5b7dd tempest-VolumesTestJSON-1828905808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:32:59 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-6dffb097-07c9-4120-8ed6-3b0addc5b7dd tempest-VolumesTestJSON-1828905808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:32:59 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-6dffb097-07c9-4120-8ed6-3b0addc5b7dd tempest-VolumesTestJSON-1828905808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:32:59 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-6dffb097-07c9-4120-8ed6-3b0addc5b7dd tempest-VolumesTestJSON-1828905808 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:32:59 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-6dffb097-07c9-4120-8ed6-3b0addc5b7dd tempest-VolumesTestJSON-1828905808 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:32:59 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6dffb097-07c9-4120-8ed6-3b0addc5b7dd tempest-VolumesTestJSON-1828905808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c0db2155-2a49-423a-a62e-ab8e9cc18d15 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:32:59 devstack sudo[108371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c0db2155-2a49-423a-a62e-ab8e9cc18d15 1073741824 Apr 29 15:32:59 devstack sudo[108371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:33:00 devstack sudo[108371]: pam_unix(sudo:session): session closed for user root Apr 29 15:33:00 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6dffb097-07c9-4120-8ed6-3b0addc5b7dd tempest-VolumesTestJSON-1828905808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c0db2155-2a49-423a-a62e-ab8e9cc18d15 1073741824" returned: 0 in 0.742s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:33:00 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6dffb097-07c9-4120-8ed6-3b0addc5b7dd tempest-VolumesTestJSON-1828905808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c0db2155-2a49-423a-a62e-ab8e9cc18d15 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:33:00 devstack sudo[108376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c0db2155-2a49-423a-a62e-ab8e9cc18d15 Apr 29 15:33:00 devstack sudo[108376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:33:00 devstack sudo[108376]: pam_unix(sudo:session): session closed for user root Apr 29 15:33:00 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6dffb097-07c9-4120-8ed6-3b0addc5b7dd tempest-VolumesTestJSON-1828905808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c0db2155-2a49-423a-a62e-ab8e9cc18d15" returned: 0 in 0.566s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:33:00 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-6dffb097-07c9-4120-8ed6-3b0addc5b7dd tempest-VolumesTestJSON-1828905808 None] <== create_volume: return (1343ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:33:00 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-6dffb097-07c9-4120-8ed6-3b0addc5b7dd tempest-VolumesTestJSON-1828905808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.346s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:33:00 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6dffb097-07c9-4120-8ed6-3b0addc5b7dd tempest-VolumesTestJSON-1828905808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dd03d8b-168b-4284-a3b2-634a07981d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0db2155-2a49-423a-a62e-ab8e9cc18d15', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:33:00 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6dffb097-07c9-4120-8ed6-3b0addc5b7dd tempest-VolumesTestJSON-1828905808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e8ced6e-620f-42a1-884a-b368e8dece02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:33:00 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-6dffb097-07c9-4120-8ed6-3b0addc5b7dd tempest-VolumesTestJSON-1828905808 None] Volume volume-c0db2155-2a49-423a-a62e-ab8e9cc18d15 (c0db2155-2a49-423a-a62e-ab8e9cc18d15): created successfully Apr 29 15:33:00 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6dffb097-07c9-4120-8ed6-3b0addc5b7dd tempest-VolumesTestJSON-1828905808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e8ced6e-620f-42a1-884a-b368e8dece02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:33:00 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6dffb097-07c9-4120-8ed6-3b0addc5b7dd tempest-VolumesTestJSON-1828905808 None] Flow 'volume_create_manager' (398369a9-2352-483c-9878-9c1570cd90ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:33:00 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-6dffb097-07c9-4120-8ed6-3b0addc5b7dd tempest-VolumesTestJSON-1828905808 None] Created volume successfully. Apr 29 15:33:01 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-eead7674-6f3e-41aa-a572-98e4c49bcdb3 tempest-VolumesTestJSON-1828905808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:33:01 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-eead7674-6f3e-41aa-a572-98e4c49bcdb3 tempest-VolumesTestJSON-1828905808 None] Flow 'volume_create_manager' (81860b64-7089-48f9-9681-95e43fc664cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:33:01 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-eead7674-6f3e-41aa-a572-98e4c49bcdb3 tempest-VolumesTestJSON-1828905808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (961725fc-166d-4a53-8200-aef669aef411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:33:01 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-eead7674-6f3e-41aa-a572-98e4c49bcdb3 tempest-VolumesTestJSON-1828905808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (961725fc-166d-4a53-8200-aef669aef411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:33:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-785192067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99a68fa2-7742-48a1-8b06-886faf70d741,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ccfaa210660a4fc2827acb164f3779e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:33:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:33:02Z,use_quota=True,user_id='6f7a63876a224088b1ab7f382e103a08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:33:01 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-eead7674-6f3e-41aa-a572-98e4c49bcdb3 tempest-VolumesTestJSON-1828905808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10b4d2fd-011b-4ee6-90c2-e4aba425f582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:33:01 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-eead7674-6f3e-41aa-a572-98e4c49bcdb3 tempest-VolumesTestJSON-1828905808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10b4d2fd-011b-4ee6-90c2-e4aba425f582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:33:01 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-eead7674-6f3e-41aa-a572-98e4c49bcdb3 tempest-VolumesTestJSON-1828905808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad2f903a-a5d9-47d7-b59d-d2fe5aa34ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:33:01 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-eead7674-6f3e-41aa-a572-98e4c49bcdb3 tempest-VolumesTestJSON-1828905808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad2f903a-a5d9-47d7-b59d-d2fe5aa34ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99a68fa2-7742-48a1-8b06-886faf70d741', 'volume_name': 'volume-99a68fa2-7742-48a1-8b06-886faf70d741', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:33:01 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-eead7674-6f3e-41aa-a572-98e4c49bcdb3 tempest-VolumesTestJSON-1828905808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77d7b824-620d-453a-82c1-6338f10a9e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:33:01 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-eead7674-6f3e-41aa-a572-98e4c49bcdb3 tempest-VolumesTestJSON-1828905808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77d7b824-620d-453a-82c1-6338f10a9e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:33:01 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-eead7674-6f3e-41aa-a572-98e4c49bcdb3 tempest-VolumesTestJSON-1828905808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71e2504d-2a1e-452e-a948-8caf5c926a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:33:01 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-eead7674-6f3e-41aa-a572-98e4c49bcdb3 tempest-VolumesTestJSON-1828905808 None] Volume 99a68fa2-7742-48a1-8b06-886faf70d741: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99a68fa2-7742-48a1-8b06-886faf70d741', 'volume_size': 1} Apr 29 15:33:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-eead7674-6f3e-41aa-a572-98e4c49bcdb3 tempest-VolumesTestJSON-1828905808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:33:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-eead7674-6f3e-41aa-a572-98e4c49bcdb3 tempest-VolumesTestJSON-1828905808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:33:01 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-eead7674-6f3e-41aa-a572-98e4c49bcdb3 tempest-VolumesTestJSON-1828905808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:33:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-785192067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99a68fa2-7742-48a1-8b06-886faf70d741,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ccfaa210660a4fc2827acb164f3779e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:33:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:33:02Z,use_quota=True,user_id='6f7a63876a224088b1ab7f382e103a08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:33:01 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-eead7674-6f3e-41aa-a572-98e4c49bcdb3 tempest-VolumesTestJSON-1828905808 None] Creating volume 99a68fa2-7742-48a1-8b06-886faf70d741 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:33:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-eead7674-6f3e-41aa-a572-98e4c49bcdb3 tempest-VolumesTestJSON-1828905808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:33:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-eead7674-6f3e-41aa-a572-98e4c49bcdb3 tempest-VolumesTestJSON-1828905808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:33:01 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-eead7674-6f3e-41aa-a572-98e4c49bcdb3 tempest-VolumesTestJSON-1828905808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:33:01 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-eead7674-6f3e-41aa-a572-98e4c49bcdb3 tempest-VolumesTestJSON-1828905808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:33:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-eead7674-6f3e-41aa-a572-98e4c49bcdb3 tempest-VolumesTestJSON-1828905808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:33:01 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-eead7674-6f3e-41aa-a572-98e4c49bcdb3 tempest-VolumesTestJSON-1828905808 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:33:01 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-eead7674-6f3e-41aa-a572-98e4c49bcdb3 tempest-VolumesTestJSON-1828905808 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:33:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-eead7674-6f3e-41aa-a572-98e4c49bcdb3 tempest-VolumesTestJSON-1828905808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-99a68fa2-7742-48a1-8b06-886faf70d741 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:33:01 devstack sudo[108379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-99a68fa2-7742-48a1-8b06-886faf70d741 1073741824 Apr 29 15:33:01 devstack sudo[108379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:33:02 devstack sudo[108379]: pam_unix(sudo:session): session closed for user root Apr 29 15:33:02 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-eead7674-6f3e-41aa-a572-98e4c49bcdb3 tempest-VolumesTestJSON-1828905808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-99a68fa2-7742-48a1-8b06-886faf70d741 1073741824" returned: 0 in 0.749s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:33:02 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-eead7674-6f3e-41aa-a572-98e4c49bcdb3 tempest-VolumesTestJSON-1828905808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-99a68fa2-7742-48a1-8b06-886faf70d741 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:33:02 devstack sudo[108384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-99a68fa2-7742-48a1-8b06-886faf70d741 Apr 29 15:33:02 devstack sudo[108384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:33:03 devstack sudo[108384]: pam_unix(sudo:session): session closed for user root Apr 29 15:33:03 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-eead7674-6f3e-41aa-a572-98e4c49bcdb3 tempest-VolumesTestJSON-1828905808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-99a68fa2-7742-48a1-8b06-886faf70d741" returned: 0 in 0.594s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:33:03 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-eead7674-6f3e-41aa-a572-98e4c49bcdb3 tempest-VolumesTestJSON-1828905808 None] <== create_volume: return (1380ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:33:03 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-eead7674-6f3e-41aa-a572-98e4c49bcdb3 tempest-VolumesTestJSON-1828905808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.384s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:33:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-eead7674-6f3e-41aa-a572-98e4c49bcdb3 tempest-VolumesTestJSON-1828905808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71e2504d-2a1e-452e-a948-8caf5c926a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99a68fa2-7742-48a1-8b06-886faf70d741', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:33:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-eead7674-6f3e-41aa-a572-98e4c49bcdb3 tempest-VolumesTestJSON-1828905808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8df736e6-8b5a-406e-b20b-184c83bd4a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:33:03 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-eead7674-6f3e-41aa-a572-98e4c49bcdb3 tempest-VolumesTestJSON-1828905808 None] Volume volume-99a68fa2-7742-48a1-8b06-886faf70d741 (99a68fa2-7742-48a1-8b06-886faf70d741): created successfully Apr 29 15:33:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-eead7674-6f3e-41aa-a572-98e4c49bcdb3 tempest-VolumesTestJSON-1828905808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8df736e6-8b5a-406e-b20b-184c83bd4a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:33:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-eead7674-6f3e-41aa-a572-98e4c49bcdb3 tempest-VolumesTestJSON-1828905808 None] Flow 'volume_create_manager' (81860b64-7089-48f9-9681-95e43fc664cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:33:03 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-eead7674-6f3e-41aa-a572-98e4c49bcdb3 tempest-VolumesTestJSON-1828905808 None] Created volume successfully. Apr 29 15:33:04 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-65633612-e135-47e2-973a-44e4cd178845 tempest-VolumesTestJSON-1828905808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:33:04 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-65633612-e135-47e2-973a-44e4cd178845 tempest-VolumesTestJSON-1828905808 None] Flow 'volume_create_manager' (7cc937e4-42b2-43e4-8442-0f1eac3aa9df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:33:04 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-65633612-e135-47e2-973a-44e4cd178845 tempest-VolumesTestJSON-1828905808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45b44a59-f867-47bf-a040-063d5adf3ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:33:04 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-65633612-e135-47e2-973a-44e4cd178845 tempest-VolumesTestJSON-1828905808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45b44a59-f867-47bf-a040-063d5adf3ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:33:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1758250618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2b5b073-2004-4ad3-b059-c9f15e2fc6d2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ccfaa210660a4fc2827acb164f3779e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:33:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:33:04Z,use_quota=True,user_id='6f7a63876a224088b1ab7f382e103a08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:33:04 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-65633612-e135-47e2-973a-44e4cd178845 tempest-VolumesTestJSON-1828905808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (038e6f08-e24a-4c3c-abf7-a9d2a616d0eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:33:04 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-65633612-e135-47e2-973a-44e4cd178845 tempest-VolumesTestJSON-1828905808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (038e6f08-e24a-4c3c-abf7-a9d2a616d0eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:33:04 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-65633612-e135-47e2-973a-44e4cd178845 tempest-VolumesTestJSON-1828905808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92574846-da5f-46d4-a891-18ad7ce55636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:33:04 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-65633612-e135-47e2-973a-44e4cd178845 tempest-VolumesTestJSON-1828905808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92574846-da5f-46d4-a891-18ad7ce55636) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2b5b073-2004-4ad3-b059-c9f15e2fc6d2', 'volume_name': 'volume-f2b5b073-2004-4ad3-b059-c9f15e2fc6d2', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:33:04 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-65633612-e135-47e2-973a-44e4cd178845 tempest-VolumesTestJSON-1828905808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a560b590-a663-44f0-9609-893f9f43cd3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:33:04 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-65633612-e135-47e2-973a-44e4cd178845 tempest-VolumesTestJSON-1828905808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a560b590-a663-44f0-9609-893f9f43cd3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:33:04 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-65633612-e135-47e2-973a-44e4cd178845 tempest-VolumesTestJSON-1828905808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf7cd08f-bd91-4d8f-a8fe-f16b786fa16f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:33:04 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-65633612-e135-47e2-973a-44e4cd178845 tempest-VolumesTestJSON-1828905808 None] Volume f2b5b073-2004-4ad3-b059-c9f15e2fc6d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2b5b073-2004-4ad3-b059-c9f15e2fc6d2', 'volume_size': 1} Apr 29 15:33:04 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-65633612-e135-47e2-973a-44e4cd178845 tempest-VolumesTestJSON-1828905808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:33:04 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-65633612-e135-47e2-973a-44e4cd178845 tempest-VolumesTestJSON-1828905808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:33:04 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-65633612-e135-47e2-973a-44e4cd178845 tempest-VolumesTestJSON-1828905808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:33:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1758250618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2b5b073-2004-4ad3-b059-c9f15e2fc6d2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ccfaa210660a4fc2827acb164f3779e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:33:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:33:04Z,use_quota=True,user_id='6f7a63876a224088b1ab7f382e103a08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:33:04 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-65633612-e135-47e2-973a-44e4cd178845 tempest-VolumesTestJSON-1828905808 None] Creating volume f2b5b073-2004-4ad3-b059-c9f15e2fc6d2 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:33:04 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-65633612-e135-47e2-973a-44e4cd178845 tempest-VolumesTestJSON-1828905808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:33:04 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-65633612-e135-47e2-973a-44e4cd178845 tempest-VolumesTestJSON-1828905808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:33:04 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-65633612-e135-47e2-973a-44e4cd178845 tempest-VolumesTestJSON-1828905808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:33:04 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-65633612-e135-47e2-973a-44e4cd178845 tempest-VolumesTestJSON-1828905808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:33:04 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-65633612-e135-47e2-973a-44e4cd178845 tempest-VolumesTestJSON-1828905808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:33:04 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-65633612-e135-47e2-973a-44e4cd178845 tempest-VolumesTestJSON-1828905808 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:33:04 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-65633612-e135-47e2-973a-44e4cd178845 tempest-VolumesTestJSON-1828905808 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:33:04 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-65633612-e135-47e2-973a-44e4cd178845 tempest-VolumesTestJSON-1828905808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f2b5b073-2004-4ad3-b059-c9f15e2fc6d2 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:33:04 devstack sudo[108387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f2b5b073-2004-4ad3-b059-c9f15e2fc6d2 1073741824 Apr 29 15:33:04 devstack sudo[108387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:33:05 devstack sudo[108387]: pam_unix(sudo:session): session closed for user root Apr 29 15:33:05 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-65633612-e135-47e2-973a-44e4cd178845 tempest-VolumesTestJSON-1828905808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f2b5b073-2004-4ad3-b059-c9f15e2fc6d2 1073741824" returned: 0 in 0.777s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:33:05 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-65633612-e135-47e2-973a-44e4cd178845 tempest-VolumesTestJSON-1828905808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f2b5b073-2004-4ad3-b059-c9f15e2fc6d2 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:33:05 devstack sudo[108393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f2b5b073-2004-4ad3-b059-c9f15e2fc6d2 Apr 29 15:33:05 devstack sudo[108393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:33:05 devstack sudo[108393]: pam_unix(sudo:session): session closed for user root Apr 29 15:33:05 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-65633612-e135-47e2-973a-44e4cd178845 tempest-VolumesTestJSON-1828905808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f2b5b073-2004-4ad3-b059-c9f15e2fc6d2" returned: 0 in 0.592s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:33:05 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-65633612-e135-47e2-973a-44e4cd178845 tempest-VolumesTestJSON-1828905808 None] <== create_volume: return (1406ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:33:05 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-65633612-e135-47e2-973a-44e4cd178845 tempest-VolumesTestJSON-1828905808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.409s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:33:05 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-65633612-e135-47e2-973a-44e4cd178845 tempest-VolumesTestJSON-1828905808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf7cd08f-bd91-4d8f-a8fe-f16b786fa16f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2b5b073-2004-4ad3-b059-c9f15e2fc6d2', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:33:05 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-65633612-e135-47e2-973a-44e4cd178845 tempest-VolumesTestJSON-1828905808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3cb6519-98ce-4215-a88e-48f54c91ec0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:33:05 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-65633612-e135-47e2-973a-44e4cd178845 tempest-VolumesTestJSON-1828905808 None] Volume volume-f2b5b073-2004-4ad3-b059-c9f15e2fc6d2 (f2b5b073-2004-4ad3-b059-c9f15e2fc6d2): created successfully Apr 29 15:33:05 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-65633612-e135-47e2-973a-44e4cd178845 tempest-VolumesTestJSON-1828905808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3cb6519-98ce-4215-a88e-48f54c91ec0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:33:05 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-65633612-e135-47e2-973a-44e4cd178845 tempest-VolumesTestJSON-1828905808 None] Flow 'volume_create_manager' (7cc937e4-42b2-43e4-8442-0f1eac3aa9df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:33:05 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-65633612-e135-47e2-973a-44e4cd178845 tempest-VolumesTestJSON-1828905808 None] Created volume successfully. Apr 29 15:33:07 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-bcf9b0a7-dc3c-4ce8-b710-dea3f0e04d6a tempest-VolumesTestJSON-1828905808 None] Acquiring lock "cinder-f2b5b073-2004-4ad3-b059-c9f15e2fc6d2-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:33:07 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-bcf9b0a7-dc3c-4ce8-b710-dea3f0e04d6a tempest-VolumesTestJSON-1828905808 None] Lock "cinder-f2b5b073-2004-4ad3-b059-c9f15e2fc6d2-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:33:07 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-bcf9b0a7-dc3c-4ce8-b710-dea3f0e04d6a tempest-VolumesTestJSON-1828905808 None] Acquiring lock "cinder-quobyte-f2b5b073-2004-4ad3-b059-c9f15e2fc6d2" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:33:07 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-bcf9b0a7-dc3c-4ce8-b710-dea3f0e04d6a tempest-VolumesTestJSON-1828905808 None] Lock "cinder-quobyte-f2b5b073-2004-4ad3-b059-c9f15e2fc6d2" acquired by "delete_volume" :: waited 0.016s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:33:07 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b74ac39-58f7-42b5-b048-6ea157d9826b]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:33:07 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-bcf9b0a7-dc3c-4ce8-b710-dea3f0e04d6a tempest-VolumesTestJSON-1828905808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f2b5b073-2004-4ad3-b059-c9f15e2fc6d2 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:33:07 devstack sudo[108397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f2b5b073-2004-4ad3-b059-c9f15e2fc6d2 Apr 29 15:33:07 devstack sudo[108397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:33:07 devstack sudo[108397]: pam_unix(sudo:session): session closed for user root Apr 29 15:33:07 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-bcf9b0a7-dc3c-4ce8-b710-dea3f0e04d6a tempest-VolumesTestJSON-1828905808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f2b5b073-2004-4ad3-b059-c9f15e2fc6d2" returned: 0 in 0.699s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:33:07 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-bcf9b0a7-dc3c-4ce8-b710-dea3f0e04d6a tempest-VolumesTestJSON-1828905808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f2b5b073-2004-4ad3-b059-c9f15e2fc6d2 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:33:07 devstack sudo[108402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f2b5b073-2004-4ad3-b059-c9f15e2fc6d2 Apr 29 15:33:07 devstack sudo[108402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:33:08 devstack sudo[108402]: pam_unix(sudo:session): session closed for user root Apr 29 15:33:08 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-bcf9b0a7-dc3c-4ce8-b710-dea3f0e04d6a tempest-VolumesTestJSON-1828905808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f2b5b073-2004-4ad3-b059-c9f15e2fc6d2" returned: 0 in 0.582s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:33:08 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-bcf9b0a7-dc3c-4ce8-b710-dea3f0e04d6a tempest-VolumesTestJSON-1828905808 None] Lock "cinder-quobyte-f2b5b073-2004-4ad3-b059-c9f15e2fc6d2" released by "delete_volume" :: held 1.320s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:33:08 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-bcf9b0a7-dc3c-4ce8-b710-dea3f0e04d6a tempest-VolumesTestJSON-1828905808 None] Created reservations ['bd90aaca-c671-4e7f-8827-e68f1e5331e7', '7adfd466-f62f-4c52-b19f-af09d386c623', '44e94e64-7fc9-45d3-905a-f6a280abadfc', 'e7462c6e-c140-451f-9005-4be6aef62301'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:33:08 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-bcf9b0a7-dc3c-4ce8-b710-dea3f0e04d6a tempest-VolumesTestJSON-1828905808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:33:08 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-bcf9b0a7-dc3c-4ce8-b710-dea3f0e04d6a tempest-VolumesTestJSON-1828905808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:33:08 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-bcf9b0a7-dc3c-4ce8-b710-dea3f0e04d6a tempest-VolumesTestJSON-1828905808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:33:08 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-bcf9b0a7-dc3c-4ce8-b710-dea3f0e04d6a tempest-VolumesTestJSON-1828905808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:33:08 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-bcf9b0a7-dc3c-4ce8-b710-dea3f0e04d6a tempest-VolumesTestJSON-1828905808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:33:08 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-bcf9b0a7-dc3c-4ce8-b710-dea3f0e04d6a tempest-VolumesTestJSON-1828905808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:33:08 devstack sudo[108405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:33:08 devstack sudo[108405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:33:09 devstack sudo[108405]: pam_unix(sudo:session): session closed for user root Apr 29 15:33:09 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-bcf9b0a7-dc3c-4ce8-b710-dea3f0e04d6a tempest-VolumesTestJSON-1828905808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.578s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:33:09 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-bcf9b0a7-dc3c-4ce8-b710-dea3f0e04d6a tempest-VolumesTestJSON-1828905808 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:33:09 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-bcf9b0a7-dc3c-4ce8-b710-dea3f0e04d6a tempest-VolumesTestJSON-1828905808 None] Deleted volume successfully. Apr 29 15:33:09 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-bcf9b0a7-dc3c-4ce8-b710-dea3f0e04d6a tempest-VolumesTestJSON-1828905808 None] Lock "cinder-f2b5b073-2004-4ad3-b059-c9f15e2fc6d2-delete_volume" released by "delete_volume" :: held 2.073s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:33:09 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-e1e1c10c-cb7f-4711-8ae5-b828febbc38b tempest-VolumesTestJSON-1828905808 None] Acquiring lock "cinder-99a68fa2-7742-48a1-8b06-886faf70d741-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:33:09 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-e1e1c10c-cb7f-4711-8ae5-b828febbc38b tempest-VolumesTestJSON-1828905808 None] Lock "cinder-99a68fa2-7742-48a1-8b06-886faf70d741-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:33:09 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-e1e1c10c-cb7f-4711-8ae5-b828febbc38b tempest-VolumesTestJSON-1828905808 None] Acquiring lock "cinder-quobyte-99a68fa2-7742-48a1-8b06-886faf70d741" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:33:09 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-e1e1c10c-cb7f-4711-8ae5-b828febbc38b tempest-VolumesTestJSON-1828905808 None] Lock "cinder-quobyte-99a68fa2-7742-48a1-8b06-886faf70d741" acquired by "delete_volume" :: waited 0.014s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:33:09 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb0dc97-86c0-461a-a576-724303a2fc6d]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:33:09 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-e1e1c10c-cb7f-4711-8ae5-b828febbc38b tempest-VolumesTestJSON-1828905808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-99a68fa2-7742-48a1-8b06-886faf70d741 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:33:09 devstack sudo[108408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-99a68fa2-7742-48a1-8b06-886faf70d741 Apr 29 15:33:09 devstack sudo[108408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:33:10 devstack sudo[108408]: pam_unix(sudo:session): session closed for user root Apr 29 15:33:10 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-e1e1c10c-cb7f-4711-8ae5-b828febbc38b tempest-VolumesTestJSON-1828905808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-99a68fa2-7742-48a1-8b06-886faf70d741" returned: 0 in 0.675s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:33:10 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-e1e1c10c-cb7f-4711-8ae5-b828febbc38b tempest-VolumesTestJSON-1828905808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-99a68fa2-7742-48a1-8b06-886faf70d741 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:33:10 devstack sudo[108413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-99a68fa2-7742-48a1-8b06-886faf70d741 Apr 29 15:33:10 devstack sudo[108413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:33:10 devstack sudo[108413]: pam_unix(sudo:session): session closed for user root Apr 29 15:33:10 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-e1e1c10c-cb7f-4711-8ae5-b828febbc38b tempest-VolumesTestJSON-1828905808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-99a68fa2-7742-48a1-8b06-886faf70d741" returned: 0 in 0.579s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:33:10 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-e1e1c10c-cb7f-4711-8ae5-b828febbc38b tempest-VolumesTestJSON-1828905808 None] Lock "cinder-quobyte-99a68fa2-7742-48a1-8b06-886faf70d741" released by "delete_volume" :: held 1.292s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:33:10 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-e1e1c10c-cb7f-4711-8ae5-b828febbc38b tempest-VolumesTestJSON-1828905808 None] Created reservations ['4b7dd1ed-9317-45bf-af66-9610a42d1bf5', '254576c5-7012-404b-9c75-400898c55f49', '70548a5f-cca1-4589-943b-73ffb1abf7c2', 'acd84f65-0ca2-4a30-aa07-fa8cf92a0c4f'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:33:10 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-e1e1c10c-cb7f-4711-8ae5-b828febbc38b tempest-VolumesTestJSON-1828905808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:33:10 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-e1e1c10c-cb7f-4711-8ae5-b828febbc38b tempest-VolumesTestJSON-1828905808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:33:10 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-e1e1c10c-cb7f-4711-8ae5-b828febbc38b tempest-VolumesTestJSON-1828905808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:33:10 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-e1e1c10c-cb7f-4711-8ae5-b828febbc38b tempest-VolumesTestJSON-1828905808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:33:10 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-e1e1c10c-cb7f-4711-8ae5-b828febbc38b tempest-VolumesTestJSON-1828905808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:33:10 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-e1e1c10c-cb7f-4711-8ae5-b828febbc38b tempest-VolumesTestJSON-1828905808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:33:10 devstack sudo[108416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:33:10 devstack sudo[108416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:33:11 devstack sudo[108416]: pam_unix(sudo:session): session closed for user root Apr 29 15:33:11 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-e1e1c10c-cb7f-4711-8ae5-b828febbc38b tempest-VolumesTestJSON-1828905808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.571s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:33:11 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-e1e1c10c-cb7f-4711-8ae5-b828febbc38b tempest-VolumesTestJSON-1828905808 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:33:11 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-e1e1c10c-cb7f-4711-8ae5-b828febbc38b tempest-VolumesTestJSON-1828905808 None] Deleted volume successfully. Apr 29 15:33:11 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-e1e1c10c-cb7f-4711-8ae5-b828febbc38b tempest-VolumesTestJSON-1828905808 None] Lock "cinder-99a68fa2-7742-48a1-8b06-886faf70d741-delete_volume" released by "delete_volume" :: held 2.038s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:33:11 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-43a9029c-ba69-4b02-838e-c6177dc7636b tempest-VolumesTestJSON-1828905808 None] Acquiring lock "cinder-c0db2155-2a49-423a-a62e-ab8e9cc18d15-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:33:11 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-43a9029c-ba69-4b02-838e-c6177dc7636b tempest-VolumesTestJSON-1828905808 None] Lock "cinder-c0db2155-2a49-423a-a62e-ab8e9cc18d15-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:33:11 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-43a9029c-ba69-4b02-838e-c6177dc7636b tempest-VolumesTestJSON-1828905808 None] Acquiring lock "cinder-quobyte-c0db2155-2a49-423a-a62e-ab8e9cc18d15" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:33:11 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-43a9029c-ba69-4b02-838e-c6177dc7636b tempest-VolumesTestJSON-1828905808 None] Lock "cinder-quobyte-c0db2155-2a49-423a-a62e-ab8e9cc18d15" acquired by "delete_volume" :: waited 0.014s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:33:11 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2e5b3dc-6e19-47d4-914e-6d768450259e]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:33:11 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-43a9029c-ba69-4b02-838e-c6177dc7636b tempest-VolumesTestJSON-1828905808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c0db2155-2a49-423a-a62e-ab8e9cc18d15 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:33:11 devstack sudo[108419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c0db2155-2a49-423a-a62e-ab8e9cc18d15 Apr 29 15:33:11 devstack sudo[108419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:33:12 devstack sudo[108419]: pam_unix(sudo:session): session closed for user root Apr 29 15:33:12 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-43a9029c-ba69-4b02-838e-c6177dc7636b tempest-VolumesTestJSON-1828905808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c0db2155-2a49-423a-a62e-ab8e9cc18d15" returned: 0 in 0.694s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:33:12 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-43a9029c-ba69-4b02-838e-c6177dc7636b tempest-VolumesTestJSON-1828905808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c0db2155-2a49-423a-a62e-ab8e9cc18d15 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:33:12 devstack sudo[108424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c0db2155-2a49-423a-a62e-ab8e9cc18d15 Apr 29 15:33:12 devstack sudo[108424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:33:12 devstack sudo[108424]: pam_unix(sudo:session): session closed for user root Apr 29 15:33:12 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-43a9029c-ba69-4b02-838e-c6177dc7636b tempest-VolumesTestJSON-1828905808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c0db2155-2a49-423a-a62e-ab8e9cc18d15" returned: 0 in 0.580s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:33:12 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-43a9029c-ba69-4b02-838e-c6177dc7636b tempest-VolumesTestJSON-1828905808 None] Lock "cinder-quobyte-c0db2155-2a49-423a-a62e-ab8e9cc18d15" released by "delete_volume" :: held 1.312s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:33:12 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-43a9029c-ba69-4b02-838e-c6177dc7636b tempest-VolumesTestJSON-1828905808 None] Created reservations ['ff0f2592-9e66-44ee-9058-6a8b473e405c', '56687e19-328b-4052-9ea4-ac49407f3d90', '250eef4b-ee89-475e-83f8-c06f63d13141', '7417a477-9744-423b-a95e-7b08a6fdcbb6'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:33:13 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-43a9029c-ba69-4b02-838e-c6177dc7636b tempest-VolumesTestJSON-1828905808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:33:13 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-43a9029c-ba69-4b02-838e-c6177dc7636b tempest-VolumesTestJSON-1828905808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:33:13 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-43a9029c-ba69-4b02-838e-c6177dc7636b tempest-VolumesTestJSON-1828905808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:33:13 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-43a9029c-ba69-4b02-838e-c6177dc7636b tempest-VolumesTestJSON-1828905808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:33:13 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-43a9029c-ba69-4b02-838e-c6177dc7636b tempest-VolumesTestJSON-1828905808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:33:13 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-43a9029c-ba69-4b02-838e-c6177dc7636b tempest-VolumesTestJSON-1828905808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:33:13 devstack sudo[108427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:33:13 devstack sudo[108427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:33:13 devstack sudo[108427]: pam_unix(sudo:session): session closed for user root Apr 29 15:33:13 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-43a9029c-ba69-4b02-838e-c6177dc7636b tempest-VolumesTestJSON-1828905808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.570s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:33:13 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-43a9029c-ba69-4b02-838e-c6177dc7636b tempest-VolumesTestJSON-1828905808 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:33:13 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-43a9029c-ba69-4b02-838e-c6177dc7636b tempest-VolumesTestJSON-1828905808 None] Deleted volume successfully. Apr 29 15:33:13 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-43a9029c-ba69-4b02-838e-c6177dc7636b tempest-VolumesTestJSON-1828905808 None] Lock "cinder-c0db2155-2a49-423a-a62e-ab8e9cc18d15-delete_volume" released by "delete_volume" :: held 2.055s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:33:17 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-5e3b838a-0861-4869-8531-2b77980e5cf0 tempest-GroupsV320Test-1050107260 None] Group tempest-GroupsV320Test-Group-923701652: creating Apr 29 15:33:17 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-5e3b838a-0861-4869-8531-2b77980e5cf0 tempest-GroupsV320Test-1050107260 None] Group tempest-GroupsV320Test-Group-923701652: created successfully Apr 29 15:33:17 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-5e3b838a-0861-4869-8531-2b77980e5cf0 tempest-GroupsV320Test-1050107260 None] Create group completed successfully. Apr 29 15:33:18 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-7d5c1ed1-29ab-49a1-bb8d-f3e470f97dd9 tempest-GroupsV320Test-1050107260 None] Created reservations ['d58d5479-c500-44d4-b6b6-8c41546cb8e1'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:33:18 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-7d5c1ed1-29ab-49a1-bb8d-f3e470f97dd9 tempest-GroupsV320Test-1050107260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:33:18 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-7d5c1ed1-29ab-49a1-bb8d-f3e470f97dd9 tempest-GroupsV320Test-1050107260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:33:18 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-7d5c1ed1-29ab-49a1-bb8d-f3e470f97dd9 tempest-GroupsV320Test-1050107260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:33:18 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-7d5c1ed1-29ab-49a1-bb8d-f3e470f97dd9 tempest-GroupsV320Test-1050107260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:33:18 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-7d5c1ed1-29ab-49a1-bb8d-f3e470f97dd9 tempest-GroupsV320Test-1050107260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:33:18 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7d5c1ed1-29ab-49a1-bb8d-f3e470f97dd9 tempest-GroupsV320Test-1050107260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:33:18 devstack sudo[108431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:33:18 devstack sudo[108431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:33:19 devstack sudo[108431]: pam_unix(sudo:session): session closed for user root Apr 29 15:33:19 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7d5c1ed1-29ab-49a1-bb8d-f3e470f97dd9 tempest-GroupsV320Test-1050107260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.599s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:33:19 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-7d5c1ed1-29ab-49a1-bb8d-f3e470f97dd9 tempest-GroupsV320Test-1050107260 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:33:19 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-7d5c1ed1-29ab-49a1-bb8d-f3e470f97dd9 tempest-GroupsV320Test-1050107260 None] Delete group completed successfully. Apr 29 15:33:24 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3e1fb90-16cc-4112-87ee-31813c5be32d tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:33:24 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b3e1fb90-16cc-4112-87ee-31813c5be32d tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] Flow 'volume_create_manager' (0216092e-e148-4796-8e28-e96d35f5f7d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:33:24 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b3e1fb90-16cc-4112-87ee-31813c5be32d tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8226ea9d-c8b4-4660-8155-e7c0e45f34b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:33:24 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b3e1fb90-16cc-4112-87ee-31813c5be32d tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8226ea9d-c8b4-4660-8155-e7c0e45f34b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:33:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-501352556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5856c782-df0a-46bb-8a78-8143472da9a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd4a1f71644e4e6cad8e17d0cfebf4a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:33:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:33:24Z,use_quota=True,user_id='bfa4e95bc41d4c1e85de288501e64b33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:33:24 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b3e1fb90-16cc-4112-87ee-31813c5be32d tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d62208b7-52e7-4e8e-a282-4756196c8f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:33:24 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b3e1fb90-16cc-4112-87ee-31813c5be32d tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d62208b7-52e7-4e8e-a282-4756196c8f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:33:24 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b3e1fb90-16cc-4112-87ee-31813c5be32d tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c6514da-d88b-44ab-9f1f-6f44400c7e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:33:24 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b3e1fb90-16cc-4112-87ee-31813c5be32d tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c6514da-d88b-44ab-9f1f-6f44400c7e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5856c782-df0a-46bb-8a78-8143472da9a1', 'volume_name': 'volume-5856c782-df0a-46bb-8a78-8143472da9a1', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:33:24 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b3e1fb90-16cc-4112-87ee-31813c5be32d tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95da9f27-ff59-46e2-a38a-45c1b5c1c17b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:33:24 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b3e1fb90-16cc-4112-87ee-31813c5be32d tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95da9f27-ff59-46e2-a38a-45c1b5c1c17b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:33:24 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b3e1fb90-16cc-4112-87ee-31813c5be32d tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dec43f32-1d00-47e4-899e-4766999cc802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:33:24 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-b3e1fb90-16cc-4112-87ee-31813c5be32d tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] Volume 5856c782-df0a-46bb-8a78-8143472da9a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5856c782-df0a-46bb-8a78-8143472da9a1', 'volume_size': 1} Apr 29 15:33:24 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-b3e1fb90-16cc-4112-87ee-31813c5be32d tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:33:24 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-b3e1fb90-16cc-4112-87ee-31813c5be32d tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:33:24 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-b3e1fb90-16cc-4112-87ee-31813c5be32d tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:33:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-501352556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5856c782-df0a-46bb-8a78-8143472da9a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd4a1f71644e4e6cad8e17d0cfebf4a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:33:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:33:24Z,use_quota=True,user_id='bfa4e95bc41d4c1e85de288501e64b33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:33:24 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-b3e1fb90-16cc-4112-87ee-31813c5be32d tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] Creating volume 5856c782-df0a-46bb-8a78-8143472da9a1 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:33:24 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-b3e1fb90-16cc-4112-87ee-31813c5be32d tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:33:24 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-b3e1fb90-16cc-4112-87ee-31813c5be32d tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:33:24 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-b3e1fb90-16cc-4112-87ee-31813c5be32d tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:33:24 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-b3e1fb90-16cc-4112-87ee-31813c5be32d tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:33:24 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-b3e1fb90-16cc-4112-87ee-31813c5be32d tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:33:24 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-b3e1fb90-16cc-4112-87ee-31813c5be32d tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:33:24 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-b3e1fb90-16cc-4112-87ee-31813c5be32d tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:33:24 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-b3e1fb90-16cc-4112-87ee-31813c5be32d tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5856c782-df0a-46bb-8a78-8143472da9a1 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:33:24 devstack sudo[108434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5856c782-df0a-46bb-8a78-8143472da9a1 1073741824 Apr 29 15:33:24 devstack sudo[108434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:33:24 devstack sudo[108434]: pam_unix(sudo:session): session closed for user root Apr 29 15:33:24 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-b3e1fb90-16cc-4112-87ee-31813c5be32d tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5856c782-df0a-46bb-8a78-8143472da9a1 1073741824" returned: 0 in 0.752s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:33:24 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-b3e1fb90-16cc-4112-87ee-31813c5be32d tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5856c782-df0a-46bb-8a78-8143472da9a1 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:33:24 devstack sudo[108440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5856c782-df0a-46bb-8a78-8143472da9a1 Apr 29 15:33:24 devstack sudo[108440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:33:25 devstack sudo[108440]: pam_unix(sudo:session): session closed for user root Apr 29 15:33:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-b3e1fb90-16cc-4112-87ee-31813c5be32d tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5856c782-df0a-46bb-8a78-8143472da9a1" returned: 0 in 0.585s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:33:25 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-b3e1fb90-16cc-4112-87ee-31813c5be32d tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] <== create_volume: return (1376ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:33:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-b3e1fb90-16cc-4112-87ee-31813c5be32d tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.379s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:33:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b3e1fb90-16cc-4112-87ee-31813c5be32d tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dec43f32-1d00-47e4-899e-4766999cc802) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5856c782-df0a-46bb-8a78-8143472da9a1', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:33:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b3e1fb90-16cc-4112-87ee-31813c5be32d tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1614c57-0f15-4ad2-9078-6014530b79c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:33:25 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-b3e1fb90-16cc-4112-87ee-31813c5be32d tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] Volume volume-5856c782-df0a-46bb-8a78-8143472da9a1 (5856c782-df0a-46bb-8a78-8143472da9a1): created successfully Apr 29 15:33:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b3e1fb90-16cc-4112-87ee-31813c5be32d tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1614c57-0f15-4ad2-9078-6014530b79c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:33:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b3e1fb90-16cc-4112-87ee-31813c5be32d tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] Flow 'volume_create_manager' (0216092e-e148-4796-8e28-e96d35f5f7d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:33:25 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-b3e1fb90-16cc-4112-87ee-31813c5be32d tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] Created volume successfully. Apr 29 15:33:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-2080ed70-9a67-4667-9423-064d094efc82 tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:33:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-2080ed70-9a67-4667-9423-064d094efc82 tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:33:26 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-2080ed70-9a67-4667-9423-064d094efc82 tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] Creating offline snapshot abe9d186-b601-4d91-86b6-636c0e1d0764 of volume 5856c782-df0a-46bb-8a78-8143472da9a1 {{(pid=84448) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 15:33:26 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd5004af-450b-45f2-8b20-a1e40981885f]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:33:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-2080ed70-9a67-4667-9423-064d094efc82 tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5856c782-df0a-46bb-8a78-8143472da9a1 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:33:26 devstack sudo[108444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5856c782-df0a-46bb-8a78-8143472da9a1 Apr 29 15:33:26 devstack sudo[108444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:33:27 devstack sudo[108444]: pam_unix(sudo:session): session closed for user root Apr 29 15:33:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-2080ed70-9a67-4667-9423-064d094efc82 tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5856c782-df0a-46bb-8a78-8143472da9a1" returned: 0 in 0.678s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:33:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-2080ed70-9a67-4667-9423-064d094efc82 tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5856c782-df0a-46bb-8a78-8143472da9a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5856c782-df0a-46bb-8a78-8143472da9a1.abe9d186-b601-4d91-86b6-636c0e1d0764 1G {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:33:27 devstack sudo[108449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5856c782-df0a-46bb-8a78-8143472da9a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5856c782-df0a-46bb-8a78-8143472da9a1.abe9d186-b601-4d91-86b6-636c0e1d0764 1G Apr 29 15:33:27 devstack sudo[108449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:33:27 devstack sudo[108449]: pam_unix(sudo:session): session closed for user root Apr 29 15:33:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-2080ed70-9a67-4667-9423-064d094efc82 tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5856c782-df0a-46bb-8a78-8143472da9a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5856c782-df0a-46bb-8a78-8143472da9a1.abe9d186-b601-4d91-86b6-636c0e1d0764 1G" returned: 0 in 0.733s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:33:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-2080ed70-9a67-4667-9423-064d094efc82 tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5856c782-df0a-46bb-8a78-8143472da9a1 -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5856c782-df0a-46bb-8a78-8143472da9a1.abe9d186-b601-4d91-86b6-636c0e1d0764 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:33:27 devstack sudo[108454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5856c782-df0a-46bb-8a78-8143472da9a1 -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5856c782-df0a-46bb-8a78-8143472da9a1.abe9d186-b601-4d91-86b6-636c0e1d0764 Apr 29 15:33:27 devstack sudo[108454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:33:28 devstack sudo[108454]: pam_unix(sudo:session): session closed for user root Apr 29 15:33:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-2080ed70-9a67-4667-9423-064d094efc82 tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5856c782-df0a-46bb-8a78-8143472da9a1 -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5856c782-df0a-46bb-8a78-8143472da9a1.abe9d186-b601-4d91-86b6-636c0e1d0764" returned: 0 in 0.622s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:33:28 devstack cinder-volume[84448]: WARNING cinder.volume.drivers.remotefs [None req-2080ed70-9a67-4667-9423-064d094efc82 tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5856c782-df0a-46bb-8a78-8143472da9a1.abe9d186-b601-4d91-86b6-636c0e1d0764 is being set with open permissions: ugo+rw Apr 29 15:33:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-2080ed70-9a67-4667-9423-064d094efc82 tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5856c782-df0a-46bb-8a78-8143472da9a1.abe9d186-b601-4d91-86b6-636c0e1d0764 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:33:28 devstack sudo[108459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5856c782-df0a-46bb-8a78-8143472da9a1.abe9d186-b601-4d91-86b6-636c0e1d0764 Apr 29 15:33:28 devstack sudo[108459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:33:28 devstack sudo[108459]: pam_unix(sudo:session): session closed for user root Apr 29 15:33:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-2080ed70-9a67-4667-9423-064d094efc82 tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5856c782-df0a-46bb-8a78-8143472da9a1.abe9d186-b601-4d91-86b6-636c0e1d0764" returned: 0 in 0.577s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:33:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-2080ed70-9a67-4667-9423-064d094efc82 tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5856c782-df0a-46bb-8a78-8143472da9a1.info {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:33:28 devstack sudo[108462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5856c782-df0a-46bb-8a78-8143472da9a1.info Apr 29 15:33:28 devstack sudo[108462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:33:29 devstack sudo[108462]: pam_unix(sudo:session): session closed for user root Apr 29 15:33:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-2080ed70-9a67-4667-9423-064d094efc82 tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5856c782-df0a-46bb-8a78-8143472da9a1.info" returned: 0 in 0.585s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:33:29 devstack cinder-volume[84448]: WARNING cinder.volume.drivers.remotefs [None req-2080ed70-9a67-4667-9423-064d094efc82 tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5856c782-df0a-46bb-8a78-8143472da9a1.info is being set with open permissions: ugo+rw Apr 29 15:33:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-2080ed70-9a67-4667-9423-064d094efc82 tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5856c782-df0a-46bb-8a78-8143472da9a1.info {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:33:29 devstack sudo[108465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5856c782-df0a-46bb-8a78-8143472da9a1.info Apr 29 15:33:29 devstack sudo[108465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:33:30 devstack sudo[108465]: pam_unix(sudo:session): session closed for user root Apr 29 15:33:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-2080ed70-9a67-4667-9423-064d094efc82 tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5856c782-df0a-46bb-8a78-8143472da9a1.info" returned: 0 in 0.579s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:33:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-2080ed70-9a67-4667-9423-064d094efc82 tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.852s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:33:30 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-2080ed70-9a67-4667-9423-064d094efc82 tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] Create snapshot completed successfully Apr 29 15:33:30 devstack cinder-volume[84448]: DEBUG oslo_service.periodic_task [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84448) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 15:33:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:33:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:33:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:33:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:33:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:33:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:33:30 devstack sudo[108468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:33:30 devstack sudo[108468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:33:30 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-6b4fea5b-2fac-41f7-9d44-9a2f7e3758c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] Acquiring lock "cinder-abe9d186-b601-4d91-86b6-636c0e1d0764-delete_snapshot" by "delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:33:30 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-6b4fea5b-2fac-41f7-9d44-9a2f7e3758c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] Lock "cinder-abe9d186-b601-4d91-86b6-636c0e1d0764-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:33:30 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-6b4fea5b-2fac-41f7-9d44-9a2f7e3758c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] Acquiring lock "cinder-quobyte-5856c782-df0a-46bb-8a78-8143472da9a1" by "delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:33:30 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-6b4fea5b-2fac-41f7-9d44-9a2f7e3758c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] Lock "cinder-quobyte-5856c782-df0a-46bb-8a78-8143472da9a1" acquired by "delete_snapshot" :: waited 0.015s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:33:30 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-6b4fea5b-2fac-41f7-9d44-9a2f7e3758c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] Acquiring lock "cinder-quobyte-abe9d186-b601-4d91-86b6-636c0e1d0764" by "_delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:33:30 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-6b4fea5b-2fac-41f7-9d44-9a2f7e3758c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] Lock "cinder-quobyte-abe9d186-b601-4d91-86b6-636c0e1d0764" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:33:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-6b4fea5b-2fac-41f7-9d44-9a2f7e3758c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] Deleting offline snapshot abe9d186-b601-4d91-86b6-636c0e1d0764 of volume 5856c782-df0a-46bb-8a78-8143472da9a1 {{(pid=84448) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 15:33:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-6b4fea5b-2fac-41f7-9d44-9a2f7e3758c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] snapshot_file for this snap is: volume-5856c782-df0a-46bb-8a78-8143472da9a1.abe9d186-b601-4d91-86b6-636c0e1d0764 {{(pid=84448) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 15:33:30 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[c55ccce4-ff60-4ab9-b0ef-7db06f030f62]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:33:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6b4fea5b-2fac-41f7-9d44-9a2f7e3758c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5856c782-df0a-46bb-8a78-8143472da9a1.abe9d186-b601-4d91-86b6-636c0e1d0764 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:33:31 devstack sudo[108468]: pam_unix(sudo:session): session closed for user root Apr 29 15:33:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.613s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:33:31 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:33:31 devstack sudo[108471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5856c782-df0a-46bb-8a78-8143472da9a1.abe9d186-b601-4d91-86b6-636c0e1d0764 Apr 29 15:33:31 devstack sudo[108471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:33:31 devstack sudo[108471]: pam_unix(sudo:session): session closed for user root Apr 29 15:33:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6b4fea5b-2fac-41f7-9d44-9a2f7e3758c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5856c782-df0a-46bb-8a78-8143472da9a1.abe9d186-b601-4d91-86b6-636c0e1d0764" returned: 0 in 0.712s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:33:31 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-6b4fea5b-2fac-41f7-9d44-9a2f7e3758c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5856c782-df0a-46bb-8a78-8143472da9a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84448) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 15:33:31 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d21f8c-bc64-4d56-b6b8-45d4782b28b3]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:33:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6b4fea5b-2fac-41f7-9d44-9a2f7e3758c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5856c782-df0a-46bb-8a78-8143472da9a1 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:33:31 devstack sudo[108476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5856c782-df0a-46bb-8a78-8143472da9a1 Apr 29 15:33:31 devstack sudo[108476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:33:32 devstack sudo[108476]: pam_unix(sudo:session): session closed for user root Apr 29 15:33:32 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6b4fea5b-2fac-41f7-9d44-9a2f7e3758c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5856c782-df0a-46bb-8a78-8143472da9a1" returned: 0 in 0.699s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:33:32 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6b4fea5b-2fac-41f7-9d44-9a2f7e3758c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5856c782-df0a-46bb-8a78-8143472da9a1.abe9d186-b601-4d91-86b6-636c0e1d0764 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:33:32 devstack sudo[108487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5856c782-df0a-46bb-8a78-8143472da9a1.abe9d186-b601-4d91-86b6-636c0e1d0764 Apr 29 15:33:32 devstack sudo[108487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:33:33 devstack sudo[108487]: pam_unix(sudo:session): session closed for user root Apr 29 15:33:33 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6b4fea5b-2fac-41f7-9d44-9a2f7e3758c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5856c782-df0a-46bb-8a78-8143472da9a1.abe9d186-b601-4d91-86b6-636c0e1d0764" returned: 0 in 0.669s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:33:33 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6b4fea5b-2fac-41f7-9d44-9a2f7e3758c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5856c782-df0a-46bb-8a78-8143472da9a1.abe9d186-b601-4d91-86b6-636c0e1d0764 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:33:33 devstack sudo[108492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5856c782-df0a-46bb-8a78-8143472da9a1.abe9d186-b601-4d91-86b6-636c0e1d0764 Apr 29 15:33:33 devstack sudo[108492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:33:33 devstack sudo[108492]: pam_unix(sudo:session): session closed for user root Apr 29 15:33:33 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6b4fea5b-2fac-41f7-9d44-9a2f7e3758c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5856c782-df0a-46bb-8a78-8143472da9a1.abe9d186-b601-4d91-86b6-636c0e1d0764" returned: 0 in 0.580s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:33:33 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-6b4fea5b-2fac-41f7-9d44-9a2f7e3758c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] Lock "cinder-quobyte-abe9d186-b601-4d91-86b6-636c0e1d0764" released by "_delete_snapshot" :: held 2.758s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:33:33 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-6b4fea5b-2fac-41f7-9d44-9a2f7e3758c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] Lock "cinder-quobyte-5856c782-df0a-46bb-8a78-8143472da9a1" released by "delete_snapshot" :: held 2.778s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:33:33 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-6b4fea5b-2fac-41f7-9d44-9a2f7e3758c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] Created reservations ['a48d2a85-51aa-4783-8c6c-5a4cd35bda94', '3cd50ca2-741a-4f07-aee0-75cce8086ca1', '55fefdc0-4511-4aa2-b300-aa3a7d233ae1', '17812408-4117-4c8b-8a80-a9ec54c653b1'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:33:33 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-6b4fea5b-2fac-41f7-9d44-9a2f7e3758c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] Delete snapshot completed successfully. Apr 29 15:33:33 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-6b4fea5b-2fac-41f7-9d44-9a2f7e3758c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] Lock "cinder-abe9d186-b601-4d91-86b6-636c0e1d0764-delete_snapshot" released by "delete_snapshot" :: held 2.892s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:33:34 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-0402fabb-4dda-4c2b-92d3-3e810bc68f6a tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] Acquiring lock "cinder-5856c782-df0a-46bb-8a78-8143472da9a1-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:33:34 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-0402fabb-4dda-4c2b-92d3-3e810bc68f6a tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] Lock "cinder-5856c782-df0a-46bb-8a78-8143472da9a1-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:33:34 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-0402fabb-4dda-4c2b-92d3-3e810bc68f6a tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] Acquiring lock "cinder-quobyte-5856c782-df0a-46bb-8a78-8143472da9a1" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:33:34 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-0402fabb-4dda-4c2b-92d3-3e810bc68f6a tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] Lock "cinder-quobyte-5856c782-df0a-46bb-8a78-8143472da9a1" acquired by "delete_volume" :: waited 0.015s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:33:34 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddee0cb6-5f01-49fe-9041-1f1491229ba1]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:33:34 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-0402fabb-4dda-4c2b-92d3-3e810bc68f6a tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5856c782-df0a-46bb-8a78-8143472da9a1 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:33:34 devstack sudo[108495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5856c782-df0a-46bb-8a78-8143472da9a1 Apr 29 15:33:34 devstack sudo[108495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:33:34 devstack sudo[108495]: pam_unix(sudo:session): session closed for user root Apr 29 15:33:34 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-0402fabb-4dda-4c2b-92d3-3e810bc68f6a tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5856c782-df0a-46bb-8a78-8143472da9a1" returned: 0 in 0.678s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:33:34 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-0402fabb-4dda-4c2b-92d3-3e810bc68f6a tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5856c782-df0a-46bb-8a78-8143472da9a1 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:33:34 devstack sudo[108500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5856c782-df0a-46bb-8a78-8143472da9a1 Apr 29 15:33:34 devstack sudo[108500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:33:35 devstack sudo[108500]: pam_unix(sudo:session): session closed for user root Apr 29 15:33:35 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-0402fabb-4dda-4c2b-92d3-3e810bc68f6a tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5856c782-df0a-46bb-8a78-8143472da9a1" returned: 0 in 0.573s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:33:35 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-0402fabb-4dda-4c2b-92d3-3e810bc68f6a tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] Lock "cinder-quobyte-5856c782-df0a-46bb-8a78-8143472da9a1" released by "delete_volume" :: held 1.303s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:33:35 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-0402fabb-4dda-4c2b-92d3-3e810bc68f6a tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] Created reservations ['69a4fc94-fd10-463e-a5e3-25189d23f817', 'dbb39b8d-607e-448d-bdc7-b8c16f04fe53', 'df86f225-54fb-43c4-aafc-2f4a6d273b83', 'b5db11a3-5f68-4952-a204-35fd84c6f1c1'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:33:35 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-0402fabb-4dda-4c2b-92d3-3e810bc68f6a tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:33:35 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-0402fabb-4dda-4c2b-92d3-3e810bc68f6a tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:33:35 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-0402fabb-4dda-4c2b-92d3-3e810bc68f6a tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:33:35 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-0402fabb-4dda-4c2b-92d3-3e810bc68f6a tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:33:35 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-0402fabb-4dda-4c2b-92d3-3e810bc68f6a tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:33:35 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-0402fabb-4dda-4c2b-92d3-3e810bc68f6a tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:33:35 devstack sudo[108503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:33:35 devstack sudo[108503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:33:36 devstack sudo[108503]: pam_unix(sudo:session): session closed for user root Apr 29 15:33:36 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-0402fabb-4dda-4c2b-92d3-3e810bc68f6a tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.601s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:33:36 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-0402fabb-4dda-4c2b-92d3-3e810bc68f6a tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:33:36 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-0402fabb-4dda-4c2b-92d3-3e810bc68f6a tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] Deleted volume successfully. Apr 29 15:33:36 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-0402fabb-4dda-4c2b-92d3-3e810bc68f6a tempest-VolumeSnapshotQuotasNegativeTestJSON-53606154 None] Lock "cinder-5856c782-df0a-46bb-8a78-8143472da9a1-delete_volume" released by "delete_volume" :: held 2.072s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:33:45 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:UPDATE=73,cinder:INSERT=17,cinder:DELETE=3,cinder:SELECT=47 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:33:46 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:SELECT=55,cinder:UPDATE=59,cinder:INSERT=14,cinder:DELETE=8 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:34:17 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-52f0c87d-9d50-4f57-a740-ca8dab6b2198 tempest-VolumesActionsTest-689761871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:34:17 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-52f0c87d-9d50-4f57-a740-ca8dab6b2198 tempest-VolumesActionsTest-689761871 None] Flow 'volume_create_manager' (2f02f1c3-5838-4194-8733-249bad2e3971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:34:17 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-52f0c87d-9d50-4f57-a740-ca8dab6b2198 tempest-VolumesActionsTest-689761871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a71aa4c0-995f-4fdb-9cc2-75581a1cbe3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:34:17 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-52f0c87d-9d50-4f57-a740-ca8dab6b2198 tempest-VolumesActionsTest-689761871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a71aa4c0-995f-4fdb-9cc2-75581a1cbe3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:34:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2094313030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1c5eeed-e5f3-4099-a3f8-f880d498a10a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8fc9f763313466db45da3e5c27ad79e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:34:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:34:18Z,use_quota=True,user_id='00a1e3821b574da0adb72ff57065dd0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:34:17 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-52f0c87d-9d50-4f57-a740-ca8dab6b2198 tempest-VolumesActionsTest-689761871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd232409-2b5a-45a0-a7f0-8983f98548e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:34:17 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-52f0c87d-9d50-4f57-a740-ca8dab6b2198 tempest-VolumesActionsTest-689761871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd232409-2b5a-45a0-a7f0-8983f98548e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:34:17 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-52f0c87d-9d50-4f57-a740-ca8dab6b2198 tempest-VolumesActionsTest-689761871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6202503f-c890-470c-abf0-ef11bd2b8b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:34:17 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-52f0c87d-9d50-4f57-a740-ca8dab6b2198 tempest-VolumesActionsTest-689761871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6202503f-c890-470c-abf0-ef11bd2b8b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1c5eeed-e5f3-4099-a3f8-f880d498a10a', 'volume_name': 'volume-b1c5eeed-e5f3-4099-a3f8-f880d498a10a', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:34:17 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-52f0c87d-9d50-4f57-a740-ca8dab6b2198 tempest-VolumesActionsTest-689761871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dff4a73c-9061-4793-9ad4-63a89d4821b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:34:17 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-52f0c87d-9d50-4f57-a740-ca8dab6b2198 tempest-VolumesActionsTest-689761871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dff4a73c-9061-4793-9ad4-63a89d4821b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:34:17 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-52f0c87d-9d50-4f57-a740-ca8dab6b2198 tempest-VolumesActionsTest-689761871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (570c546e-eb48-4b1c-ae39-b6a9bcf4b661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:34:17 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-52f0c87d-9d50-4f57-a740-ca8dab6b2198 tempest-VolumesActionsTest-689761871 None] Volume b1c5eeed-e5f3-4099-a3f8-f880d498a10a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1c5eeed-e5f3-4099-a3f8-f880d498a10a', 'volume_size': 1} Apr 29 15:34:17 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-52f0c87d-9d50-4f57-a740-ca8dab6b2198 tempest-VolumesActionsTest-689761871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:34:17 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-52f0c87d-9d50-4f57-a740-ca8dab6b2198 tempest-VolumesActionsTest-689761871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:34:17 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-52f0c87d-9d50-4f57-a740-ca8dab6b2198 tempest-VolumesActionsTest-689761871 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:34:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2094313030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1c5eeed-e5f3-4099-a3f8-f880d498a10a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8fc9f763313466db45da3e5c27ad79e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:34:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:34:18Z,use_quota=True,user_id='00a1e3821b574da0adb72ff57065dd0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:34:17 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-52f0c87d-9d50-4f57-a740-ca8dab6b2198 tempest-VolumesActionsTest-689761871 None] Creating volume b1c5eeed-e5f3-4099-a3f8-f880d498a10a {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:34:17 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-52f0c87d-9d50-4f57-a740-ca8dab6b2198 tempest-VolumesActionsTest-689761871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:34:17 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-52f0c87d-9d50-4f57-a740-ca8dab6b2198 tempest-VolumesActionsTest-689761871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:34:17 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-52f0c87d-9d50-4f57-a740-ca8dab6b2198 tempest-VolumesActionsTest-689761871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:34:17 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-52f0c87d-9d50-4f57-a740-ca8dab6b2198 tempest-VolumesActionsTest-689761871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:34:17 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-52f0c87d-9d50-4f57-a740-ca8dab6b2198 tempest-VolumesActionsTest-689761871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:34:17 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-52f0c87d-9d50-4f57-a740-ca8dab6b2198 tempest-VolumesActionsTest-689761871 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:34:17 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-52f0c87d-9d50-4f57-a740-ca8dab6b2198 tempest-VolumesActionsTest-689761871 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:34:17 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-52f0c87d-9d50-4f57-a740-ca8dab6b2198 tempest-VolumesActionsTest-689761871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-b1c5eeed-e5f3-4099-a3f8-f880d498a10a 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:34:17 devstack sudo[108643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-b1c5eeed-e5f3-4099-a3f8-f880d498a10a 1073741824 Apr 29 15:34:17 devstack sudo[108643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:34:18 devstack sudo[108643]: pam_unix(sudo:session): session closed for user root Apr 29 15:34:18 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-52f0c87d-9d50-4f57-a740-ca8dab6b2198 tempest-VolumesActionsTest-689761871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-b1c5eeed-e5f3-4099-a3f8-f880d498a10a 1073741824" returned: 0 in 0.790s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:34:18 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-52f0c87d-9d50-4f57-a740-ca8dab6b2198 tempest-VolumesActionsTest-689761871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-b1c5eeed-e5f3-4099-a3f8-f880d498a10a {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:34:18 devstack sudo[108648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-b1c5eeed-e5f3-4099-a3f8-f880d498a10a Apr 29 15:34:18 devstack sudo[108648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:34:19 devstack sudo[108648]: pam_unix(sudo:session): session closed for user root Apr 29 15:34:19 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-52f0c87d-9d50-4f57-a740-ca8dab6b2198 tempest-VolumesActionsTest-689761871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-b1c5eeed-e5f3-4099-a3f8-f880d498a10a" returned: 0 in 0.591s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:34:19 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-52f0c87d-9d50-4f57-a740-ca8dab6b2198 tempest-VolumesActionsTest-689761871 None] <== create_volume: return (1423ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:34:19 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-52f0c87d-9d50-4f57-a740-ca8dab6b2198 tempest-VolumesActionsTest-689761871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.426s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:34:19 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-52f0c87d-9d50-4f57-a740-ca8dab6b2198 tempest-VolumesActionsTest-689761871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (570c546e-eb48-4b1c-ae39-b6a9bcf4b661) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1c5eeed-e5f3-4099-a3f8-f880d498a10a', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:34:19 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-52f0c87d-9d50-4f57-a740-ca8dab6b2198 tempest-VolumesActionsTest-689761871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95663c4f-c6a4-49f0-93dd-2ec3b5c0bcd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:34:19 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-52f0c87d-9d50-4f57-a740-ca8dab6b2198 tempest-VolumesActionsTest-689761871 None] Volume volume-b1c5eeed-e5f3-4099-a3f8-f880d498a10a (b1c5eeed-e5f3-4099-a3f8-f880d498a10a): created successfully Apr 29 15:34:19 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-52f0c87d-9d50-4f57-a740-ca8dab6b2198 tempest-VolumesActionsTest-689761871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95663c4f-c6a4-49f0-93dd-2ec3b5c0bcd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:34:19 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-52f0c87d-9d50-4f57-a740-ca8dab6b2198 tempest-VolumesActionsTest-689761871 None] Flow 'volume_create_manager' (2f02f1c3-5838-4194-8733-249bad2e3971) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:34:19 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-52f0c87d-9d50-4f57-a740-ca8dab6b2198 tempest-VolumesActionsTest-689761871 None] Created volume successfully. Apr 29 15:34:19 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-8cee7c6a-c241-4c5e-b403-5567be670272 tempest-VolumesActionsTest-689761871 None] Acquiring lock "cinder-b1c5eeed-e5f3-4099-a3f8-f880d498a10a" by "attach_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:34:19 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-8cee7c6a-c241-4c5e-b403-5567be670272 tempest-VolumesActionsTest-689761871 None] Lock "cinder-b1c5eeed-e5f3-4099-a3f8-f880d498a10a" acquired by "attach_volume" :: waited 0.023s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:34:19 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-8cee7c6a-c241-4c5e-b403-5567be670272 tempest-VolumesActionsTest-689761871 None] Attaching volume b1c5eeed-e5f3-4099-a3f8-f880d498a10a to instance 035b9b33-4fb7-4241-beab-70783db64c2c at mountpoint /dev/vdb on host None. Apr 29 15:34:19 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-8cee7c6a-c241-4c5e-b403-5567be670272 tempest-VolumesActionsTest-689761871 None] Attach volume completed successfully. Apr 29 15:34:20 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-8cee7c6a-c241-4c5e-b403-5567be670272 tempest-VolumesActionsTest-689761871 None] Lock "cinder-b1c5eeed-e5f3-4099-a3f8-f880d498a10a" released by "attach_volume" :: held 0.096s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:34:20 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-54bfc0f5-0d7c-4aed-b0c3-d5affb6ab15c tempest-VolumesActionsTest-521344647 None] Terminate volume connection completed successfully. Apr 29 15:34:21 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-54bfc0f5-0d7c-4aed-b0c3-d5affb6ab15c tempest-VolumesActionsTest-521344647 None] Acquiring lock "cinder-b1c5eeed-e5f3-4099-a3f8-f880d498a10a-detach_volume" by "detach_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:34:21 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-54bfc0f5-0d7c-4aed-b0c3-d5affb6ab15c tempest-VolumesActionsTest-521344647 None] Lock "cinder-b1c5eeed-e5f3-4099-a3f8-f880d498a10a-detach_volume" acquired by "detach_volume" :: waited 0.020s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:34:21 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-54bfc0f5-0d7c-4aed-b0c3-d5affb6ab15c tempest-VolumesActionsTest-521344647 None] Detaching volume b1c5eeed-e5f3-4099-a3f8-f880d498a10a from instance 035b9b33-4fb7-4241-beab-70783db64c2c. Apr 29 15:34:21 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-54bfc0f5-0d7c-4aed-b0c3-d5affb6ab15c tempest-VolumesActionsTest-521344647 None] Detach volume completed successfully. Apr 29 15:34:21 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-54bfc0f5-0d7c-4aed-b0c3-d5affb6ab15c tempest-VolumesActionsTest-521344647 None] Lock "cinder-b1c5eeed-e5f3-4099-a3f8-f880d498a10a-detach_volume" released by "detach_volume" :: held 0.064s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:34:22 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-f8002f2c-4c55-49ab-a7de-5e9f7ff664ad tempest-VolumesActionsTest-689761871 None] Acquiring lock "cinder-b1c5eeed-e5f3-4099-a3f8-f880d498a10a-detach_volume" by "detach_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:34:22 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-f8002f2c-4c55-49ab-a7de-5e9f7ff664ad tempest-VolumesActionsTest-689761871 None] Lock "cinder-b1c5eeed-e5f3-4099-a3f8-f880d498a10a-detach_volume" acquired by "detach_volume" :: waited 0.015s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:34:22 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-f8002f2c-4c55-49ab-a7de-5e9f7ff664ad tempest-VolumesActionsTest-689761871 None] Volume detach called, but volume not attached. Apr 29 15:34:22 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-f8002f2c-4c55-49ab-a7de-5e9f7ff664ad tempest-VolumesActionsTest-689761871 None] Lock "cinder-b1c5eeed-e5f3-4099-a3f8-f880d498a10a-detach_volume" released by "detach_volume" :: held 0.023s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:34:22 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-41b915db-d161-4aa8-bf88-187554c2c742 tempest-VolumesActionsTest-689761871 None] Acquiring lock "cinder-b1c5eeed-e5f3-4099-a3f8-f880d498a10a-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:34:22 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-41b915db-d161-4aa8-bf88-187554c2c742 tempest-VolumesActionsTest-689761871 None] Lock "cinder-b1c5eeed-e5f3-4099-a3f8-f880d498a10a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:34:22 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-41b915db-d161-4aa8-bf88-187554c2c742 tempest-VolumesActionsTest-689761871 None] Acquiring lock "cinder-quobyte-b1c5eeed-e5f3-4099-a3f8-f880d498a10a" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:34:22 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-41b915db-d161-4aa8-bf88-187554c2c742 tempest-VolumesActionsTest-689761871 None] Lock "cinder-quobyte-b1c5eeed-e5f3-4099-a3f8-f880d498a10a" acquired by "delete_volume" :: waited 0.028s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:34:22 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[acffdef7-d703-4d18-bfe1-ed2a4a7c00f0]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:34:22 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-41b915db-d161-4aa8-bf88-187554c2c742 tempest-VolumesActionsTest-689761871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-b1c5eeed-e5f3-4099-a3f8-f880d498a10a {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:34:22 devstack sudo[108651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-b1c5eeed-e5f3-4099-a3f8-f880d498a10a Apr 29 15:34:22 devstack sudo[108651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:34:23 devstack sudo[108651]: pam_unix(sudo:session): session closed for user root Apr 29 15:34:23 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-41b915db-d161-4aa8-bf88-187554c2c742 tempest-VolumesActionsTest-689761871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-b1c5eeed-e5f3-4099-a3f8-f880d498a10a" returned: 0 in 0.704s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:34:23 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-41b915db-d161-4aa8-bf88-187554c2c742 tempest-VolumesActionsTest-689761871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-b1c5eeed-e5f3-4099-a3f8-f880d498a10a {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:34:23 devstack sudo[108656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-b1c5eeed-e5f3-4099-a3f8-f880d498a10a Apr 29 15:34:23 devstack sudo[108656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:34:24 devstack sudo[108656]: pam_unix(sudo:session): session closed for user root Apr 29 15:34:24 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-41b915db-d161-4aa8-bf88-187554c2c742 tempest-VolumesActionsTest-689761871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-b1c5eeed-e5f3-4099-a3f8-f880d498a10a" returned: 0 in 0.604s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:34:24 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-41b915db-d161-4aa8-bf88-187554c2c742 tempest-VolumesActionsTest-689761871 None] Lock "cinder-quobyte-b1c5eeed-e5f3-4099-a3f8-f880d498a10a" released by "delete_volume" :: held 1.356s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:34:24 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-41b915db-d161-4aa8-bf88-187554c2c742 tempest-VolumesActionsTest-689761871 None] Created reservations ['0ee6bb9e-85d6-4137-a45d-8a90440767ef', 'c778e075-f59a-4ca7-b25d-697c99cad815', 'e82cfada-f738-4ae1-b2b6-ccffb645753a', '10abdea8-9b8c-4c28-8feb-6218704ca1df'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:34:24 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-41b915db-d161-4aa8-bf88-187554c2c742 tempest-VolumesActionsTest-689761871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:34:24 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-41b915db-d161-4aa8-bf88-187554c2c742 tempest-VolumesActionsTest-689761871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:34:24 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-41b915db-d161-4aa8-bf88-187554c2c742 tempest-VolumesActionsTest-689761871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:34:24 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-41b915db-d161-4aa8-bf88-187554c2c742 tempest-VolumesActionsTest-689761871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:34:24 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-41b915db-d161-4aa8-bf88-187554c2c742 tempest-VolumesActionsTest-689761871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:34:24 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-41b915db-d161-4aa8-bf88-187554c2c742 tempest-VolumesActionsTest-689761871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:34:24 devstack sudo[108661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:34:24 devstack sudo[108661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:34:24 devstack sudo[108661]: pam_unix(sudo:session): session closed for user root Apr 29 15:34:24 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-41b915db-d161-4aa8-bf88-187554c2c742 tempest-VolumesActionsTest-689761871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.600s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:34:24 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-41b915db-d161-4aa8-bf88-187554c2c742 tempest-VolumesActionsTest-689761871 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:34:24 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-41b915db-d161-4aa8-bf88-187554c2c742 tempest-VolumesActionsTest-689761871 None] Deleted volume successfully. Apr 29 15:34:24 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-41b915db-d161-4aa8-bf88-187554c2c742 tempest-VolumesActionsTest-689761871 None] Lock "cinder-b1c5eeed-e5f3-4099-a3f8-f880d498a10a-delete_volume" released by "delete_volume" :: held 2.176s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:34:30 devstack cinder-volume[84448]: DEBUG oslo_service.periodic_task [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84448) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 15:34:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:34:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:34:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:34:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:34:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:34:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:34:30 devstack sudo[108706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:34:30 devstack sudo[108706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:34:31 devstack sudo[108706]: pam_unix(sudo:session): session closed for user root Apr 29 15:34:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.595s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:34:31 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:34:32 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae586798-4331-461b-928c-05d5b61bc2b7 tempest-VolumesActionsTest-689761871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:34:32 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-ae586798-4331-461b-928c-05d5b61bc2b7 tempest-VolumesActionsTest-689761871 None] Flow 'volume_create_manager' (1d78b095-ec5f-4997-a348-6f12f7f03075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:34:32 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-ae586798-4331-461b-928c-05d5b61bc2b7 tempest-VolumesActionsTest-689761871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf61d50b-42bc-4570-88de-c23e681786bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:34:32 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-ae586798-4331-461b-928c-05d5b61bc2b7 tempest-VolumesActionsTest-689761871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf61d50b-42bc-4570-88de-c23e681786bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:34:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-834806273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d818a867-492f-4803-bb89-feb2d258ece7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8fc9f763313466db45da3e5c27ad79e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:34:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:34:33Z,use_quota=True,user_id='00a1e3821b574da0adb72ff57065dd0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:34:32 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-ae586798-4331-461b-928c-05d5b61bc2b7 tempest-VolumesActionsTest-689761871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9249600-1367-44ee-b7e0-b8809f2c6405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:34:32 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-ae586798-4331-461b-928c-05d5b61bc2b7 tempest-VolumesActionsTest-689761871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9249600-1367-44ee-b7e0-b8809f2c6405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:34:32 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-ae586798-4331-461b-928c-05d5b61bc2b7 tempest-VolumesActionsTest-689761871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8cfd513-4712-4828-aaf4-020c04db7af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:34:32 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-ae586798-4331-461b-928c-05d5b61bc2b7 tempest-VolumesActionsTest-689761871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8cfd513-4712-4828-aaf4-020c04db7af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd818a867-492f-4803-bb89-feb2d258ece7', 'volume_name': 'volume-d818a867-492f-4803-bb89-feb2d258ece7', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:34:32 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-ae586798-4331-461b-928c-05d5b61bc2b7 tempest-VolumesActionsTest-689761871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ff831c3-6069-4b30-931f-254e3ea26a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:34:32 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-ae586798-4331-461b-928c-05d5b61bc2b7 tempest-VolumesActionsTest-689761871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ff831c3-6069-4b30-931f-254e3ea26a80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:34:32 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-ae586798-4331-461b-928c-05d5b61bc2b7 tempest-VolumesActionsTest-689761871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13247f37-4e19-4c39-a3ef-1c9ca1681aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:34:32 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-ae586798-4331-461b-928c-05d5b61bc2b7 tempest-VolumesActionsTest-689761871 None] Volume d818a867-492f-4803-bb89-feb2d258ece7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d818a867-492f-4803-bb89-feb2d258ece7', 'volume_size': 1} Apr 29 15:34:32 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-ae586798-4331-461b-928c-05d5b61bc2b7 tempest-VolumesActionsTest-689761871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:34:32 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-ae586798-4331-461b-928c-05d5b61bc2b7 tempest-VolumesActionsTest-689761871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:34:32 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-ae586798-4331-461b-928c-05d5b61bc2b7 tempest-VolumesActionsTest-689761871 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:34:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-834806273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d818a867-492f-4803-bb89-feb2d258ece7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8fc9f763313466db45da3e5c27ad79e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:34:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:34:33Z,use_quota=True,user_id='00a1e3821b574da0adb72ff57065dd0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:34:32 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-ae586798-4331-461b-928c-05d5b61bc2b7 tempest-VolumesActionsTest-689761871 None] Creating volume d818a867-492f-4803-bb89-feb2d258ece7 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:34:32 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-ae586798-4331-461b-928c-05d5b61bc2b7 tempest-VolumesActionsTest-689761871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:34:32 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-ae586798-4331-461b-928c-05d5b61bc2b7 tempest-VolumesActionsTest-689761871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:34:32 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-ae586798-4331-461b-928c-05d5b61bc2b7 tempest-VolumesActionsTest-689761871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:34:32 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-ae586798-4331-461b-928c-05d5b61bc2b7 tempest-VolumesActionsTest-689761871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:34:32 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-ae586798-4331-461b-928c-05d5b61bc2b7 tempest-VolumesActionsTest-689761871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:34:32 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-ae586798-4331-461b-928c-05d5b61bc2b7 tempest-VolumesActionsTest-689761871 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:34:32 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-ae586798-4331-461b-928c-05d5b61bc2b7 tempest-VolumesActionsTest-689761871 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:34:32 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ae586798-4331-461b-928c-05d5b61bc2b7 tempest-VolumesActionsTest-689761871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d818a867-492f-4803-bb89-feb2d258ece7 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:34:32 devstack sudo[108715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d818a867-492f-4803-bb89-feb2d258ece7 1073741824 Apr 29 15:34:32 devstack sudo[108715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:34:33 devstack sudo[108715]: pam_unix(sudo:session): session closed for user root Apr 29 15:34:33 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ae586798-4331-461b-928c-05d5b61bc2b7 tempest-VolumesActionsTest-689761871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d818a867-492f-4803-bb89-feb2d258ece7 1073741824" returned: 0 in 0.757s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:34:33 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ae586798-4331-461b-928c-05d5b61bc2b7 tempest-VolumesActionsTest-689761871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d818a867-492f-4803-bb89-feb2d258ece7 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:34:33 devstack sudo[108720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d818a867-492f-4803-bb89-feb2d258ece7 Apr 29 15:34:33 devstack sudo[108720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:34:34 devstack sudo[108720]: pam_unix(sudo:session): session closed for user root Apr 29 15:34:34 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ae586798-4331-461b-928c-05d5b61bc2b7 tempest-VolumesActionsTest-689761871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d818a867-492f-4803-bb89-feb2d258ece7" returned: 0 in 0.595s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:34:34 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-ae586798-4331-461b-928c-05d5b61bc2b7 tempest-VolumesActionsTest-689761871 None] <== create_volume: return (1390ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:34:34 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-ae586798-4331-461b-928c-05d5b61bc2b7 tempest-VolumesActionsTest-689761871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.392s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:34:34 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-ae586798-4331-461b-928c-05d5b61bc2b7 tempest-VolumesActionsTest-689761871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13247f37-4e19-4c39-a3ef-1c9ca1681aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d818a867-492f-4803-bb89-feb2d258ece7', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:34:34 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-ae586798-4331-461b-928c-05d5b61bc2b7 tempest-VolumesActionsTest-689761871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbdcedba-9491-431f-be41-02cd6c07d92e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:34:34 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-ae586798-4331-461b-928c-05d5b61bc2b7 tempest-VolumesActionsTest-689761871 None] Volume volume-d818a867-492f-4803-bb89-feb2d258ece7 (d818a867-492f-4803-bb89-feb2d258ece7): created successfully Apr 29 15:34:34 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-ae586798-4331-461b-928c-05d5b61bc2b7 tempest-VolumesActionsTest-689761871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbdcedba-9491-431f-be41-02cd6c07d92e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:34:34 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-ae586798-4331-461b-928c-05d5b61bc2b7 tempest-VolumesActionsTest-689761871 None] Flow 'volume_create_manager' (1d78b095-ec5f-4997-a348-6f12f7f03075) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:34:34 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-ae586798-4331-461b-928c-05d5b61bc2b7 tempest-VolumesActionsTest-689761871 None] Created volume successfully. Apr 29 15:34:34 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-5907e3b1-713b-4a3d-a265-162517b7f728 tempest-VolumesActionsTest-521344647 None] Acquiring lock "cinder-d818a867-492f-4803-bb89-feb2d258ece7-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:34:34 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-5907e3b1-713b-4a3d-a265-162517b7f728 tempest-VolumesActionsTest-521344647 None] Lock "cinder-d818a867-492f-4803-bb89-feb2d258ece7-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:34:34 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-5907e3b1-713b-4a3d-a265-162517b7f728 tempest-VolumesActionsTest-521344647 None] Acquiring lock "cinder-quobyte-d818a867-492f-4803-bb89-feb2d258ece7" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:34:34 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-5907e3b1-713b-4a3d-a265-162517b7f728 tempest-VolumesActionsTest-521344647 None] Lock "cinder-quobyte-d818a867-492f-4803-bb89-feb2d258ece7" acquired by "delete_volume" :: waited 0.015s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:34:34 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a33b05a-0442-498c-a528-36b804b21171]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:34:34 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-5907e3b1-713b-4a3d-a265-162517b7f728 tempest-VolumesActionsTest-521344647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d818a867-492f-4803-bb89-feb2d258ece7 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:34:35 devstack sudo[108723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d818a867-492f-4803-bb89-feb2d258ece7 Apr 29 15:34:35 devstack sudo[108723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:34:35 devstack sudo[108723]: pam_unix(sudo:session): session closed for user root Apr 29 15:34:35 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-5907e3b1-713b-4a3d-a265-162517b7f728 tempest-VolumesActionsTest-521344647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d818a867-492f-4803-bb89-feb2d258ece7" returned: 0 in 0.682s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:34:35 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-5907e3b1-713b-4a3d-a265-162517b7f728 tempest-VolumesActionsTest-521344647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d818a867-492f-4803-bb89-feb2d258ece7 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:34:35 devstack sudo[108728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d818a867-492f-4803-bb89-feb2d258ece7 Apr 29 15:34:35 devstack sudo[108728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:34:36 devstack sudo[108728]: pam_unix(sudo:session): session closed for user root Apr 29 15:34:36 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-5907e3b1-713b-4a3d-a265-162517b7f728 tempest-VolumesActionsTest-521344647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d818a867-492f-4803-bb89-feb2d258ece7" returned: 0 in 0.586s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:34:36 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-5907e3b1-713b-4a3d-a265-162517b7f728 tempest-VolumesActionsTest-521344647 None] Lock "cinder-quobyte-d818a867-492f-4803-bb89-feb2d258ece7" released by "delete_volume" :: held 1.306s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:34:36 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-5907e3b1-713b-4a3d-a265-162517b7f728 tempest-VolumesActionsTest-521344647 None] Created reservations ['53451859-dc77-4b3b-9860-fe45c3967b6e', '8a39d8c1-3faa-41cf-b54f-b5836864f544', 'e6dace87-3ae0-4b86-9ebf-a386685f986e', '6d7eca04-960b-4311-b0ca-0705d94592ce'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:34:36 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-5907e3b1-713b-4a3d-a265-162517b7f728 tempest-VolumesActionsTest-521344647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:34:36 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-5907e3b1-713b-4a3d-a265-162517b7f728 tempest-VolumesActionsTest-521344647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:34:36 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-5907e3b1-713b-4a3d-a265-162517b7f728 tempest-VolumesActionsTest-521344647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:34:36 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-5907e3b1-713b-4a3d-a265-162517b7f728 tempest-VolumesActionsTest-521344647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:34:36 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-5907e3b1-713b-4a3d-a265-162517b7f728 tempest-VolumesActionsTest-521344647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:34:36 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-5907e3b1-713b-4a3d-a265-162517b7f728 tempest-VolumesActionsTest-521344647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:34:36 devstack sudo[108766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:34:36 devstack sudo[108766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:34:37 devstack sudo[108766]: pam_unix(sudo:session): session closed for user root Apr 29 15:34:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-5907e3b1-713b-4a3d-a265-162517b7f728 tempest-VolumesActionsTest-521344647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.601s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:34:37 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-5907e3b1-713b-4a3d-a265-162517b7f728 tempest-VolumesActionsTest-521344647 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:34:37 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-5907e3b1-713b-4a3d-a265-162517b7f728 tempest-VolumesActionsTest-521344647 None] Deleted volume successfully. Apr 29 15:34:37 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-5907e3b1-713b-4a3d-a265-162517b7f728 tempest-VolumesActionsTest-521344647 None] Lock "cinder-d818a867-492f-4803-bb89-feb2d258ece7-delete_volume" released by "delete_volume" :: held 2.109s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:34:37 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-1edac2ab-f059-42d0-bba4-9d5f23a6e0e9 tempest-VolumesActionsTest-689761871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:34:37 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-1edac2ab-f059-42d0-bba4-9d5f23a6e0e9 tempest-VolumesActionsTest-689761871 None] Flow 'volume_create_manager' (74be007f-d836-443c-a529-76e82a285439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:34:37 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-1edac2ab-f059-42d0-bba4-9d5f23a6e0e9 tempest-VolumesActionsTest-689761871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (841fbe45-e396-4878-a575-941059050cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:34:37 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-1edac2ab-f059-42d0-bba4-9d5f23a6e0e9 tempest-VolumesActionsTest-689761871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (841fbe45-e396-4878-a575-941059050cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:34:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1522368625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd41a94e-acc1-4890-90d4-9c49079b714f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8fc9f763313466db45da3e5c27ad79e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:34:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:34:37Z,use_quota=True,user_id='00a1e3821b574da0adb72ff57065dd0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:34:37 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-1edac2ab-f059-42d0-bba4-9d5f23a6e0e9 tempest-VolumesActionsTest-689761871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (091ce383-2913-4cd0-97ef-2e1ba7a74b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:34:37 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-1edac2ab-f059-42d0-bba4-9d5f23a6e0e9 tempest-VolumesActionsTest-689761871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (091ce383-2913-4cd0-97ef-2e1ba7a74b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:34:37 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-1edac2ab-f059-42d0-bba4-9d5f23a6e0e9 tempest-VolumesActionsTest-689761871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5b4bb05-10a0-4f3a-99fc-1ccb4338066e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:34:37 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-1edac2ab-f059-42d0-bba4-9d5f23a6e0e9 tempest-VolumesActionsTest-689761871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5b4bb05-10a0-4f3a-99fc-1ccb4338066e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd41a94e-acc1-4890-90d4-9c49079b714f', 'volume_name': 'volume-bd41a94e-acc1-4890-90d4-9c49079b714f', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:34:37 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-1edac2ab-f059-42d0-bba4-9d5f23a6e0e9 tempest-VolumesActionsTest-689761871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a372139-f192-4676-8fdd-4843614593ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:34:37 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-1edac2ab-f059-42d0-bba4-9d5f23a6e0e9 tempest-VolumesActionsTest-689761871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a372139-f192-4676-8fdd-4843614593ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:34:37 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-1edac2ab-f059-42d0-bba4-9d5f23a6e0e9 tempest-VolumesActionsTest-689761871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3960c47c-95ba-4b87-957f-cfcfca5c23d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:34:37 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-1edac2ab-f059-42d0-bba4-9d5f23a6e0e9 tempest-VolumesActionsTest-689761871 None] Volume bd41a94e-acc1-4890-90d4-9c49079b714f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd41a94e-acc1-4890-90d4-9c49079b714f', 'volume_size': 1} Apr 29 15:34:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-1edac2ab-f059-42d0-bba4-9d5f23a6e0e9 tempest-VolumesActionsTest-689761871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:34:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-1edac2ab-f059-42d0-bba4-9d5f23a6e0e9 tempest-VolumesActionsTest-689761871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:34:37 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-1edac2ab-f059-42d0-bba4-9d5f23a6e0e9 tempest-VolumesActionsTest-689761871 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:34:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1522368625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd41a94e-acc1-4890-90d4-9c49079b714f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8fc9f763313466db45da3e5c27ad79e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:34:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:34:37Z,use_quota=True,user_id='00a1e3821b574da0adb72ff57065dd0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:34:37 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-1edac2ab-f059-42d0-bba4-9d5f23a6e0e9 tempest-VolumesActionsTest-689761871 None] Creating volume bd41a94e-acc1-4890-90d4-9c49079b714f {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:34:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-1edac2ab-f059-42d0-bba4-9d5f23a6e0e9 tempest-VolumesActionsTest-689761871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:34:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-1edac2ab-f059-42d0-bba4-9d5f23a6e0e9 tempest-VolumesActionsTest-689761871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:34:37 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-1edac2ab-f059-42d0-bba4-9d5f23a6e0e9 tempest-VolumesActionsTest-689761871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:34:37 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-1edac2ab-f059-42d0-bba4-9d5f23a6e0e9 tempest-VolumesActionsTest-689761871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:34:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-1edac2ab-f059-42d0-bba4-9d5f23a6e0e9 tempest-VolumesActionsTest-689761871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:34:37 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-1edac2ab-f059-42d0-bba4-9d5f23a6e0e9 tempest-VolumesActionsTest-689761871 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:34:37 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-1edac2ab-f059-42d0-bba4-9d5f23a6e0e9 tempest-VolumesActionsTest-689761871 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:34:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1edac2ab-f059-42d0-bba4-9d5f23a6e0e9 tempest-VolumesActionsTest-689761871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-bd41a94e-acc1-4890-90d4-9c49079b714f 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:34:37 devstack sudo[108771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-bd41a94e-acc1-4890-90d4-9c49079b714f 1073741824 Apr 29 15:34:37 devstack sudo[108771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:34:38 devstack sudo[108771]: pam_unix(sudo:session): session closed for user root Apr 29 15:34:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1edac2ab-f059-42d0-bba4-9d5f23a6e0e9 tempest-VolumesActionsTest-689761871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-bd41a94e-acc1-4890-90d4-9c49079b714f 1073741824" returned: 0 in 0.736s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:34:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1edac2ab-f059-42d0-bba4-9d5f23a6e0e9 tempest-VolumesActionsTest-689761871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-bd41a94e-acc1-4890-90d4-9c49079b714f {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:34:38 devstack sudo[108776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-bd41a94e-acc1-4890-90d4-9c49079b714f Apr 29 15:34:38 devstack sudo[108776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:34:38 devstack sudo[108776]: pam_unix(sudo:session): session closed for user root Apr 29 15:34:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1edac2ab-f059-42d0-bba4-9d5f23a6e0e9 tempest-VolumesActionsTest-689761871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-bd41a94e-acc1-4890-90d4-9c49079b714f" returned: 0 in 0.574s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:34:38 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-1edac2ab-f059-42d0-bba4-9d5f23a6e0e9 tempest-VolumesActionsTest-689761871 None] <== create_volume: return (1347ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:34:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-1edac2ab-f059-42d0-bba4-9d5f23a6e0e9 tempest-VolumesActionsTest-689761871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.350s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:34:38 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-1edac2ab-f059-42d0-bba4-9d5f23a6e0e9 tempest-VolumesActionsTest-689761871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3960c47c-95ba-4b87-957f-cfcfca5c23d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd41a94e-acc1-4890-90d4-9c49079b714f', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:34:38 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-1edac2ab-f059-42d0-bba4-9d5f23a6e0e9 tempest-VolumesActionsTest-689761871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15780e65-8c90-4fa2-8f30-af530a52bc30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:34:38 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-1edac2ab-f059-42d0-bba4-9d5f23a6e0e9 tempest-VolumesActionsTest-689761871 None] Volume volume-bd41a94e-acc1-4890-90d4-9c49079b714f (bd41a94e-acc1-4890-90d4-9c49079b714f): created successfully Apr 29 15:34:38 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-1edac2ab-f059-42d0-bba4-9d5f23a6e0e9 tempest-VolumesActionsTest-689761871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15780e65-8c90-4fa2-8f30-af530a52bc30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:34:38 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-1edac2ab-f059-42d0-bba4-9d5f23a6e0e9 tempest-VolumesActionsTest-689761871 None] Flow 'volume_create_manager' (74be007f-d836-443c-a529-76e82a285439) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:34:38 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-1edac2ab-f059-42d0-bba4-9d5f23a6e0e9 tempest-VolumesActionsTest-689761871 None] Created volume successfully. Apr 29 15:34:39 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-0897751a-9735-4bfe-9b82-fab078ea04da tempest-VolumesActionsTest-521344647 None] Acquiring lock "cinder-bd41a94e-acc1-4890-90d4-9c49079b714f-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:34:39 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-0897751a-9735-4bfe-9b82-fab078ea04da tempest-VolumesActionsTest-521344647 None] Lock "cinder-bd41a94e-acc1-4890-90d4-9c49079b714f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:34:39 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-0897751a-9735-4bfe-9b82-fab078ea04da tempest-VolumesActionsTest-521344647 None] Acquiring lock "cinder-quobyte-bd41a94e-acc1-4890-90d4-9c49079b714f" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:34:39 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-0897751a-9735-4bfe-9b82-fab078ea04da tempest-VolumesActionsTest-521344647 None] Lock "cinder-quobyte-bd41a94e-acc1-4890-90d4-9c49079b714f" acquired by "delete_volume" :: waited 0.015s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:34:39 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71cc091-2903-44ce-847e-87d5a21d1315]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:34:39 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-0897751a-9735-4bfe-9b82-fab078ea04da tempest-VolumesActionsTest-521344647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-bd41a94e-acc1-4890-90d4-9c49079b714f {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:34:39 devstack sudo[108780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-bd41a94e-acc1-4890-90d4-9c49079b714f Apr 29 15:34:39 devstack sudo[108780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:34:40 devstack sudo[108780]: pam_unix(sudo:session): session closed for user root Apr 29 15:34:40 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-0897751a-9735-4bfe-9b82-fab078ea04da tempest-VolumesActionsTest-521344647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-bd41a94e-acc1-4890-90d4-9c49079b714f" returned: 0 in 0.707s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:34:40 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-0897751a-9735-4bfe-9b82-fab078ea04da tempest-VolumesActionsTest-521344647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-bd41a94e-acc1-4890-90d4-9c49079b714f {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:34:40 devstack sudo[108785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-bd41a94e-acc1-4890-90d4-9c49079b714f Apr 29 15:34:40 devstack sudo[108785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:34:41 devstack sudo[108785]: pam_unix(sudo:session): session closed for user root Apr 29 15:34:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-0897751a-9735-4bfe-9b82-fab078ea04da tempest-VolumesActionsTest-521344647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-bd41a94e-acc1-4890-90d4-9c49079b714f" returned: 0 in 0.579s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:34:41 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-0897751a-9735-4bfe-9b82-fab078ea04da tempest-VolumesActionsTest-521344647 None] Lock "cinder-quobyte-bd41a94e-acc1-4890-90d4-9c49079b714f" released by "delete_volume" :: held 1.323s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:34:41 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-0897751a-9735-4bfe-9b82-fab078ea04da tempest-VolumesActionsTest-521344647 None] Created reservations ['fb4e9bc7-ff71-4a2f-9d61-ceb168cf7e91', '7e9707f0-01d3-4234-82b2-45e7f085b53f', '49f1c162-baac-4fd3-ba3c-816c99758ee1', '14b86385-9859-4ff1-927d-c14d0da14fd1'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:34:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-0897751a-9735-4bfe-9b82-fab078ea04da tempest-VolumesActionsTest-521344647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:34:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-0897751a-9735-4bfe-9b82-fab078ea04da tempest-VolumesActionsTest-521344647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:34:41 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-0897751a-9735-4bfe-9b82-fab078ea04da tempest-VolumesActionsTest-521344647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:34:41 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-0897751a-9735-4bfe-9b82-fab078ea04da tempest-VolumesActionsTest-521344647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:34:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-0897751a-9735-4bfe-9b82-fab078ea04da tempest-VolumesActionsTest-521344647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:34:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-0897751a-9735-4bfe-9b82-fab078ea04da tempest-VolumesActionsTest-521344647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:34:41 devstack sudo[108788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:34:41 devstack sudo[108788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:34:41 devstack sudo[108788]: pam_unix(sudo:session): session closed for user root Apr 29 15:34:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-0897751a-9735-4bfe-9b82-fab078ea04da tempest-VolumesActionsTest-521344647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.576s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:34:41 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-0897751a-9735-4bfe-9b82-fab078ea04da tempest-VolumesActionsTest-521344647 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:34:41 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-0897751a-9735-4bfe-9b82-fab078ea04da tempest-VolumesActionsTest-521344647 None] Deleted volume successfully. Apr 29 15:34:41 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-0897751a-9735-4bfe-9b82-fab078ea04da tempest-VolumesActionsTest-521344647 None] Lock "cinder-bd41a94e-acc1-4890-90d4-9c49079b714f-delete_volume" released by "delete_volume" :: held 2.076s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:34:42 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfe02bbe-132a-481e-bab6-175508fb3d40 tempest-VolumesActionsTest-689761871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:34:42 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cfe02bbe-132a-481e-bab6-175508fb3d40 tempest-VolumesActionsTest-689761871 None] Flow 'volume_create_manager' (0726f8f5-8cba-49b6-ab7e-51307b8d72eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:34:42 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cfe02bbe-132a-481e-bab6-175508fb3d40 tempest-VolumesActionsTest-689761871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3eab1c78-a67b-40ef-8f8d-1bcf98c13438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:34:42 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cfe02bbe-132a-481e-bab6-175508fb3d40 tempest-VolumesActionsTest-689761871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3eab1c78-a67b-40ef-8f8d-1bcf98c13438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:34:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-664387544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97e59326-0c2a-478d-aedb-fbbfcf48fd4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8fc9f763313466db45da3e5c27ad79e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:34:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:34:42Z,use_quota=True,user_id='00a1e3821b574da0adb72ff57065dd0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:34:42 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cfe02bbe-132a-481e-bab6-175508fb3d40 tempest-VolumesActionsTest-689761871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58a9f12a-4e28-40ff-8645-2f432d21041f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:34:42 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cfe02bbe-132a-481e-bab6-175508fb3d40 tempest-VolumesActionsTest-689761871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58a9f12a-4e28-40ff-8645-2f432d21041f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:34:42 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cfe02bbe-132a-481e-bab6-175508fb3d40 tempest-VolumesActionsTest-689761871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17cc266f-fd9d-48f0-99de-be077ca1d09e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:34:42 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cfe02bbe-132a-481e-bab6-175508fb3d40 tempest-VolumesActionsTest-689761871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17cc266f-fd9d-48f0-99de-be077ca1d09e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97e59326-0c2a-478d-aedb-fbbfcf48fd4e', 'volume_name': 'volume-97e59326-0c2a-478d-aedb-fbbfcf48fd4e', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:34:42 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cfe02bbe-132a-481e-bab6-175508fb3d40 tempest-VolumesActionsTest-689761871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa23d29f-124a-4796-8f2c-cfec77cc82a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:34:42 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cfe02bbe-132a-481e-bab6-175508fb3d40 tempest-VolumesActionsTest-689761871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa23d29f-124a-4796-8f2c-cfec77cc82a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:34:42 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cfe02bbe-132a-481e-bab6-175508fb3d40 tempest-VolumesActionsTest-689761871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ab2cffe-2752-448a-88fb-96d684822106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:34:42 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-cfe02bbe-132a-481e-bab6-175508fb3d40 tempest-VolumesActionsTest-689761871 None] Volume 97e59326-0c2a-478d-aedb-fbbfcf48fd4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97e59326-0c2a-478d-aedb-fbbfcf48fd4e', 'volume_size': 1} Apr 29 15:34:42 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-cfe02bbe-132a-481e-bab6-175508fb3d40 tempest-VolumesActionsTest-689761871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:34:42 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-cfe02bbe-132a-481e-bab6-175508fb3d40 tempest-VolumesActionsTest-689761871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:34:42 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-cfe02bbe-132a-481e-bab6-175508fb3d40 tempest-VolumesActionsTest-689761871 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:34:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-664387544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97e59326-0c2a-478d-aedb-fbbfcf48fd4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8fc9f763313466db45da3e5c27ad79e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:34:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:34:42Z,use_quota=True,user_id='00a1e3821b574da0adb72ff57065dd0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:34:42 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-cfe02bbe-132a-481e-bab6-175508fb3d40 tempest-VolumesActionsTest-689761871 None] Creating volume 97e59326-0c2a-478d-aedb-fbbfcf48fd4e {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:34:42 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-cfe02bbe-132a-481e-bab6-175508fb3d40 tempest-VolumesActionsTest-689761871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:34:42 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-cfe02bbe-132a-481e-bab6-175508fb3d40 tempest-VolumesActionsTest-689761871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:34:42 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-cfe02bbe-132a-481e-bab6-175508fb3d40 tempest-VolumesActionsTest-689761871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:34:42 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-cfe02bbe-132a-481e-bab6-175508fb3d40 tempest-VolumesActionsTest-689761871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:34:42 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-cfe02bbe-132a-481e-bab6-175508fb3d40 tempest-VolumesActionsTest-689761871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:34:42 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-cfe02bbe-132a-481e-bab6-175508fb3d40 tempest-VolumesActionsTest-689761871 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:34:42 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-cfe02bbe-132a-481e-bab6-175508fb3d40 tempest-VolumesActionsTest-689761871 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:34:42 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cfe02bbe-132a-481e-bab6-175508fb3d40 tempest-VolumesActionsTest-689761871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-97e59326-0c2a-478d-aedb-fbbfcf48fd4e 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:34:42 devstack sudo[108793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-97e59326-0c2a-478d-aedb-fbbfcf48fd4e 1073741824 Apr 29 15:34:42 devstack sudo[108793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:34:43 devstack sudo[108793]: pam_unix(sudo:session): session closed for user root Apr 29 15:34:43 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cfe02bbe-132a-481e-bab6-175508fb3d40 tempest-VolumesActionsTest-689761871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-97e59326-0c2a-478d-aedb-fbbfcf48fd4e 1073741824" returned: 0 in 0.776s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:34:43 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cfe02bbe-132a-481e-bab6-175508fb3d40 tempest-VolumesActionsTest-689761871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-97e59326-0c2a-478d-aedb-fbbfcf48fd4e {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:34:43 devstack sudo[108798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-97e59326-0c2a-478d-aedb-fbbfcf48fd4e Apr 29 15:34:43 devstack sudo[108798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:34:43 devstack sudo[108798]: pam_unix(sudo:session): session closed for user root Apr 29 15:34:43 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cfe02bbe-132a-481e-bab6-175508fb3d40 tempest-VolumesActionsTest-689761871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-97e59326-0c2a-478d-aedb-fbbfcf48fd4e" returned: 0 in 0.594s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:34:43 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-cfe02bbe-132a-481e-bab6-175508fb3d40 tempest-VolumesActionsTest-689761871 None] <== create_volume: return (1409ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:34:43 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-cfe02bbe-132a-481e-bab6-175508fb3d40 tempest-VolumesActionsTest-689761871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.411s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:34:43 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cfe02bbe-132a-481e-bab6-175508fb3d40 tempest-VolumesActionsTest-689761871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ab2cffe-2752-448a-88fb-96d684822106) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97e59326-0c2a-478d-aedb-fbbfcf48fd4e', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:34:43 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cfe02bbe-132a-481e-bab6-175508fb3d40 tempest-VolumesActionsTest-689761871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f3d664d-ea31-4a78-987c-3cbcfd54c00c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:34:43 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-cfe02bbe-132a-481e-bab6-175508fb3d40 tempest-VolumesActionsTest-689761871 None] Volume volume-97e59326-0c2a-478d-aedb-fbbfcf48fd4e (97e59326-0c2a-478d-aedb-fbbfcf48fd4e): created successfully Apr 29 15:34:43 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cfe02bbe-132a-481e-bab6-175508fb3d40 tempest-VolumesActionsTest-689761871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f3d664d-ea31-4a78-987c-3cbcfd54c00c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:34:43 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cfe02bbe-132a-481e-bab6-175508fb3d40 tempest-VolumesActionsTest-689761871 None] Flow 'volume_create_manager' (0726f8f5-8cba-49b6-ab7e-51307b8d72eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:34:43 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-cfe02bbe-132a-481e-bab6-175508fb3d40 tempest-VolumesActionsTest-689761871 None] Created volume successfully. Apr 29 15:34:44 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-4ed8a12a-c136-4f83-9f59-db433d2d1581 tempest-VolumesActionsTest-521344647 None] Acquiring lock "cinder-97e59326-0c2a-478d-aedb-fbbfcf48fd4e-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:34:44 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-4ed8a12a-c136-4f83-9f59-db433d2d1581 tempest-VolumesActionsTest-521344647 None] Lock "cinder-97e59326-0c2a-478d-aedb-fbbfcf48fd4e-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:34:44 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-4ed8a12a-c136-4f83-9f59-db433d2d1581 tempest-VolumesActionsTest-521344647 None] Acquiring lock "cinder-quobyte-97e59326-0c2a-478d-aedb-fbbfcf48fd4e" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:34:44 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-4ed8a12a-c136-4f83-9f59-db433d2d1581 tempest-VolumesActionsTest-521344647 None] Lock "cinder-quobyte-97e59326-0c2a-478d-aedb-fbbfcf48fd4e" acquired by "delete_volume" :: waited 0.013s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:34:44 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a61bbf5-db53-452d-8972-087337283fb1]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:34:44 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-4ed8a12a-c136-4f83-9f59-db433d2d1581 tempest-VolumesActionsTest-521344647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-97e59326-0c2a-478d-aedb-fbbfcf48fd4e {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:34:44 devstack sudo[108802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-97e59326-0c2a-478d-aedb-fbbfcf48fd4e Apr 29 15:34:44 devstack sudo[108802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:34:45 devstack sudo[108802]: pam_unix(sudo:session): session closed for user root Apr 29 15:34:45 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-4ed8a12a-c136-4f83-9f59-db433d2d1581 tempest-VolumesActionsTest-521344647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-97e59326-0c2a-478d-aedb-fbbfcf48fd4e" returned: 0 in 0.682s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:34:45 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-4ed8a12a-c136-4f83-9f59-db433d2d1581 tempest-VolumesActionsTest-521344647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-97e59326-0c2a-478d-aedb-fbbfcf48fd4e {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:34:45 devstack sudo[108807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-97e59326-0c2a-478d-aedb-fbbfcf48fd4e Apr 29 15:34:45 devstack sudo[108807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:34:45 devstack sudo[108807]: pam_unix(sudo:session): session closed for user root Apr 29 15:34:45 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-4ed8a12a-c136-4f83-9f59-db433d2d1581 tempest-VolumesActionsTest-521344647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-97e59326-0c2a-478d-aedb-fbbfcf48fd4e" returned: 0 in 0.575s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:34:45 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-4ed8a12a-c136-4f83-9f59-db433d2d1581 tempest-VolumesActionsTest-521344647 None] Lock "cinder-quobyte-97e59326-0c2a-478d-aedb-fbbfcf48fd4e" released by "delete_volume" :: held 1.294s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:34:45 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-4ed8a12a-c136-4f83-9f59-db433d2d1581 tempest-VolumesActionsTest-521344647 None] Created reservations ['695bb984-cc0a-4721-b4f1-15d0e3f42018', '2fe8bcd6-a33e-47bb-867d-fab048b82402', 'bb936eed-2786-42c2-8029-bb9e197b7dc0', '1cb29fe4-3153-461e-86f9-c4f994bfb5c8'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:34:45 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-4ed8a12a-c136-4f83-9f59-db433d2d1581 tempest-VolumesActionsTest-521344647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:34:45 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-4ed8a12a-c136-4f83-9f59-db433d2d1581 tempest-VolumesActionsTest-521344647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:34:45 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-4ed8a12a-c136-4f83-9f59-db433d2d1581 tempest-VolumesActionsTest-521344647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:34:45 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-4ed8a12a-c136-4f83-9f59-db433d2d1581 tempest-VolumesActionsTest-521344647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:34:45 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-4ed8a12a-c136-4f83-9f59-db433d2d1581 tempest-VolumesActionsTest-521344647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:34:45 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-4ed8a12a-c136-4f83-9f59-db433d2d1581 tempest-VolumesActionsTest-521344647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:34:46 devstack sudo[108810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:34:46 devstack sudo[108810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:34:46 devstack sudo[108810]: pam_unix(sudo:session): session closed for user root Apr 29 15:34:46 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-4ed8a12a-c136-4f83-9f59-db433d2d1581 tempest-VolumesActionsTest-521344647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.596s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:34:46 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-4ed8a12a-c136-4f83-9f59-db433d2d1581 tempest-VolumesActionsTest-521344647 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:34:46 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-4ed8a12a-c136-4f83-9f59-db433d2d1581 tempest-VolumesActionsTest-521344647 None] Deleted volume successfully. Apr 29 15:34:46 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-4ed8a12a-c136-4f83-9f59-db433d2d1581 tempest-VolumesActionsTest-521344647 None] Lock "cinder-97e59326-0c2a-478d-aedb-fbbfcf48fd4e-delete_volume" released by "delete_volume" :: held 2.062s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:34:47 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-71a9b641-0179-472c-9c9f-ef42f1011509 tempest-VolumesActionsTest-689761871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:34:47 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-71a9b641-0179-472c-9c9f-ef42f1011509 tempest-VolumesActionsTest-689761871 None] Flow 'volume_create_manager' (8cf3f199-9199-42d8-ae06-48dcb50d6234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:34:47 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-71a9b641-0179-472c-9c9f-ef42f1011509 tempest-VolumesActionsTest-689761871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3947f8f-86ab-4abe-83bb-76eb339c3a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:34:47 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-71a9b641-0179-472c-9c9f-ef42f1011509 tempest-VolumesActionsTest-689761871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3947f8f-86ab-4abe-83bb-76eb339c3a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:34:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-832400844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c511e116-b81a-48ce-99fc-7c6a99865100,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8fc9f763313466db45da3e5c27ad79e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:34:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:34:47Z,use_quota=True,user_id='00a1e3821b574da0adb72ff57065dd0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:34:47 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-71a9b641-0179-472c-9c9f-ef42f1011509 tempest-VolumesActionsTest-689761871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72b767ad-fc11-4821-ae52-6429ca295afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:34:47 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-71a9b641-0179-472c-9c9f-ef42f1011509 tempest-VolumesActionsTest-689761871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72b767ad-fc11-4821-ae52-6429ca295afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:34:47 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-71a9b641-0179-472c-9c9f-ef42f1011509 tempest-VolumesActionsTest-689761871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f51eb64-0752-46e2-a4eb-9266ab46f47f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:34:47 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-71a9b641-0179-472c-9c9f-ef42f1011509 tempest-VolumesActionsTest-689761871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f51eb64-0752-46e2-a4eb-9266ab46f47f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c511e116-b81a-48ce-99fc-7c6a99865100', 'volume_name': 'volume-c511e116-b81a-48ce-99fc-7c6a99865100', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:34:47 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-71a9b641-0179-472c-9c9f-ef42f1011509 tempest-VolumesActionsTest-689761871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf5fc747-9675-4bba-8da7-e9024cf695dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:34:47 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-71a9b641-0179-472c-9c9f-ef42f1011509 tempest-VolumesActionsTest-689761871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf5fc747-9675-4bba-8da7-e9024cf695dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:34:47 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-71a9b641-0179-472c-9c9f-ef42f1011509 tempest-VolumesActionsTest-689761871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a9dfa42-be87-4ef8-8f07-962503c8c95c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:34:47 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-71a9b641-0179-472c-9c9f-ef42f1011509 tempest-VolumesActionsTest-689761871 None] Volume c511e116-b81a-48ce-99fc-7c6a99865100: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c511e116-b81a-48ce-99fc-7c6a99865100', 'volume_size': 1} Apr 29 15:34:47 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-71a9b641-0179-472c-9c9f-ef42f1011509 tempest-VolumesActionsTest-689761871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:34:47 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-71a9b641-0179-472c-9c9f-ef42f1011509 tempest-VolumesActionsTest-689761871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:34:47 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-71a9b641-0179-472c-9c9f-ef42f1011509 tempest-VolumesActionsTest-689761871 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:34:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-832400844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c511e116-b81a-48ce-99fc-7c6a99865100,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8fc9f763313466db45da3e5c27ad79e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:34:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:34:47Z,use_quota=True,user_id='00a1e3821b574da0adb72ff57065dd0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:34:47 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-71a9b641-0179-472c-9c9f-ef42f1011509 tempest-VolumesActionsTest-689761871 None] Creating volume c511e116-b81a-48ce-99fc-7c6a99865100 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:34:47 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-71a9b641-0179-472c-9c9f-ef42f1011509 tempest-VolumesActionsTest-689761871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:34:47 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-71a9b641-0179-472c-9c9f-ef42f1011509 tempest-VolumesActionsTest-689761871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:34:47 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-71a9b641-0179-472c-9c9f-ef42f1011509 tempest-VolumesActionsTest-689761871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:34:47 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-71a9b641-0179-472c-9c9f-ef42f1011509 tempest-VolumesActionsTest-689761871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:34:47 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-71a9b641-0179-472c-9c9f-ef42f1011509 tempest-VolumesActionsTest-689761871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:34:47 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-71a9b641-0179-472c-9c9f-ef42f1011509 tempest-VolumesActionsTest-689761871 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:34:47 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-71a9b641-0179-472c-9c9f-ef42f1011509 tempest-VolumesActionsTest-689761871 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:34:47 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-71a9b641-0179-472c-9c9f-ef42f1011509 tempest-VolumesActionsTest-689761871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c511e116-b81a-48ce-99fc-7c6a99865100 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:34:47 devstack sudo[108814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c511e116-b81a-48ce-99fc-7c6a99865100 1073741824 Apr 29 15:34:47 devstack sudo[108814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:34:47 devstack sudo[108814]: pam_unix(sudo:session): session closed for user root Apr 29 15:34:47 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-71a9b641-0179-472c-9c9f-ef42f1011509 tempest-VolumesActionsTest-689761871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c511e116-b81a-48ce-99fc-7c6a99865100 1073741824" returned: 0 in 0.739s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:34:47 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-71a9b641-0179-472c-9c9f-ef42f1011509 tempest-VolumesActionsTest-689761871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c511e116-b81a-48ce-99fc-7c6a99865100 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:34:47 devstack sudo[108820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c511e116-b81a-48ce-99fc-7c6a99865100 Apr 29 15:34:47 devstack sudo[108820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:34:48 devstack sudo[108820]: pam_unix(sudo:session): session closed for user root Apr 29 15:34:48 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-71a9b641-0179-472c-9c9f-ef42f1011509 tempest-VolumesActionsTest-689761871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c511e116-b81a-48ce-99fc-7c6a99865100" returned: 0 in 0.616s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:34:48 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-71a9b641-0179-472c-9c9f-ef42f1011509 tempest-VolumesActionsTest-689761871 None] <== create_volume: return (1392ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:34:48 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-71a9b641-0179-472c-9c9f-ef42f1011509 tempest-VolumesActionsTest-689761871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.395s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:34:48 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-71a9b641-0179-472c-9c9f-ef42f1011509 tempest-VolumesActionsTest-689761871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a9dfa42-be87-4ef8-8f07-962503c8c95c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c511e116-b81a-48ce-99fc-7c6a99865100', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:34:48 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-71a9b641-0179-472c-9c9f-ef42f1011509 tempest-VolumesActionsTest-689761871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91f1f5c6-bfa2-4854-b7da-fb77d68cff40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:34:48 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-71a9b641-0179-472c-9c9f-ef42f1011509 tempest-VolumesActionsTest-689761871 None] Volume volume-c511e116-b81a-48ce-99fc-7c6a99865100 (c511e116-b81a-48ce-99fc-7c6a99865100): created successfully Apr 29 15:34:48 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-71a9b641-0179-472c-9c9f-ef42f1011509 tempest-VolumesActionsTest-689761871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91f1f5c6-bfa2-4854-b7da-fb77d68cff40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:34:48 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-71a9b641-0179-472c-9c9f-ef42f1011509 tempest-VolumesActionsTest-689761871 None] Flow 'volume_create_manager' (8cf3f199-9199-42d8-ae06-48dcb50d6234) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:34:48 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-71a9b641-0179-472c-9c9f-ef42f1011509 tempest-VolumesActionsTest-689761871 None] Created volume successfully. Apr 29 15:34:49 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-73e37b28-84be-428b-b7bd-360a5c036af7 tempest-VolumesActionsTest-521344647 None] Acquiring lock "cinder-c511e116-b81a-48ce-99fc-7c6a99865100-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:34:49 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-73e37b28-84be-428b-b7bd-360a5c036af7 tempest-VolumesActionsTest-521344647 None] Lock "cinder-c511e116-b81a-48ce-99fc-7c6a99865100-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:34:49 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-73e37b28-84be-428b-b7bd-360a5c036af7 tempest-VolumesActionsTest-521344647 None] Acquiring lock "cinder-quobyte-c511e116-b81a-48ce-99fc-7c6a99865100" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:34:49 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-73e37b28-84be-428b-b7bd-360a5c036af7 tempest-VolumesActionsTest-521344647 None] Lock "cinder-quobyte-c511e116-b81a-48ce-99fc-7c6a99865100" acquired by "delete_volume" :: waited 0.016s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:34:49 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15b087f-ec9b-4161-8a3d-a9338859226e]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:34:49 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-73e37b28-84be-428b-b7bd-360a5c036af7 tempest-VolumesActionsTest-521344647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c511e116-b81a-48ce-99fc-7c6a99865100 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:34:49 devstack sudo[108823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c511e116-b81a-48ce-99fc-7c6a99865100 Apr 29 15:34:49 devstack sudo[108823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:34:50 devstack sudo[108823]: pam_unix(sudo:session): session closed for user root Apr 29 15:34:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-73e37b28-84be-428b-b7bd-360a5c036af7 tempest-VolumesActionsTest-521344647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c511e116-b81a-48ce-99fc-7c6a99865100" returned: 0 in 0.701s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:34:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-73e37b28-84be-428b-b7bd-360a5c036af7 tempest-VolumesActionsTest-521344647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c511e116-b81a-48ce-99fc-7c6a99865100 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:34:50 devstack sudo[108828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c511e116-b81a-48ce-99fc-7c6a99865100 Apr 29 15:34:50 devstack sudo[108828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:34:50 devstack sudo[108828]: pam_unix(sudo:session): session closed for user root Apr 29 15:34:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-73e37b28-84be-428b-b7bd-360a5c036af7 tempest-VolumesActionsTest-521344647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-c511e116-b81a-48ce-99fc-7c6a99865100" returned: 0 in 0.602s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:34:50 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-73e37b28-84be-428b-b7bd-360a5c036af7 tempest-VolumesActionsTest-521344647 None] Lock "cinder-quobyte-c511e116-b81a-48ce-99fc-7c6a99865100" released by "delete_volume" :: held 1.342s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:34:50 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-73e37b28-84be-428b-b7bd-360a5c036af7 tempest-VolumesActionsTest-521344647 None] Created reservations ['52ba332b-b2a7-417c-bb19-50ee5e4c6dfa', 'bd37f437-7bd2-41c3-99bf-eaf49d1b4e45', 'e82672b9-82c3-42f5-8a50-8cba2acffff5', 'b34e9684-0979-490e-bc9c-35c506f08788'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:34:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-73e37b28-84be-428b-b7bd-360a5c036af7 tempest-VolumesActionsTest-521344647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:34:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-73e37b28-84be-428b-b7bd-360a5c036af7 tempest-VolumesActionsTest-521344647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:34:50 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-73e37b28-84be-428b-b7bd-360a5c036af7 tempest-VolumesActionsTest-521344647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:34:50 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-73e37b28-84be-428b-b7bd-360a5c036af7 tempest-VolumesActionsTest-521344647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:34:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-73e37b28-84be-428b-b7bd-360a5c036af7 tempest-VolumesActionsTest-521344647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:34:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-73e37b28-84be-428b-b7bd-360a5c036af7 tempest-VolumesActionsTest-521344647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:34:50 devstack sudo[108831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:34:50 devstack sudo[108831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:34:51 devstack sudo[108831]: pam_unix(sudo:session): session closed for user root Apr 29 15:34:51 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-73e37b28-84be-428b-b7bd-360a5c036af7 tempest-VolumesActionsTest-521344647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.582s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:34:51 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-73e37b28-84be-428b-b7bd-360a5c036af7 tempest-VolumesActionsTest-521344647 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:34:51 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-73e37b28-84be-428b-b7bd-360a5c036af7 tempest-VolumesActionsTest-521344647 None] Deleted volume successfully. Apr 29 15:34:51 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-73e37b28-84be-428b-b7bd-360a5c036af7 tempest-VolumesActionsTest-521344647 None] Lock "cinder-c511e116-b81a-48ce-99fc-7c6a99865100-delete_volume" released by "delete_volume" :: held 2.102s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:34:51 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-b190263d-9a80-4346-8c8f-31bdf5d4dbaf tempest-VolumesActionsTest-689761871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:34:51 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b190263d-9a80-4346-8c8f-31bdf5d4dbaf tempest-VolumesActionsTest-689761871 None] Flow 'volume_create_manager' (278c286e-c915-4c79-b3ce-8f3cb233e8dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:34:51 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b190263d-9a80-4346-8c8f-31bdf5d4dbaf tempest-VolumesActionsTest-689761871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fa20ec4-fb31-4d98-a259-2e28272ba899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:34:51 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b190263d-9a80-4346-8c8f-31bdf5d4dbaf tempest-VolumesActionsTest-689761871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fa20ec4-fb31-4d98-a259-2e28272ba899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:34:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1432058213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92e4db9e-2e47-4466-9ecf-5bba8f10611c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8fc9f763313466db45da3e5c27ad79e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:34:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:34:52Z,use_quota=True,user_id='00a1e3821b574da0adb72ff57065dd0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:34:51 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b190263d-9a80-4346-8c8f-31bdf5d4dbaf tempest-VolumesActionsTest-689761871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7e365f8-f19b-4adf-a809-9d963b99844b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:34:51 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b190263d-9a80-4346-8c8f-31bdf5d4dbaf tempest-VolumesActionsTest-689761871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7e365f8-f19b-4adf-a809-9d963b99844b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:34:51 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b190263d-9a80-4346-8c8f-31bdf5d4dbaf tempest-VolumesActionsTest-689761871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd608439-85a1-4ae6-80da-ae8a8c6d2dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:34:51 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b190263d-9a80-4346-8c8f-31bdf5d4dbaf tempest-VolumesActionsTest-689761871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd608439-85a1-4ae6-80da-ae8a8c6d2dd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92e4db9e-2e47-4466-9ecf-5bba8f10611c', 'volume_name': 'volume-92e4db9e-2e47-4466-9ecf-5bba8f10611c', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:34:51 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b190263d-9a80-4346-8c8f-31bdf5d4dbaf tempest-VolumesActionsTest-689761871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9314b66d-c25a-49c8-9430-a7b49af367ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:34:51 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b190263d-9a80-4346-8c8f-31bdf5d4dbaf tempest-VolumesActionsTest-689761871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9314b66d-c25a-49c8-9430-a7b49af367ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:34:51 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b190263d-9a80-4346-8c8f-31bdf5d4dbaf tempest-VolumesActionsTest-689761871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b70c7017-90c8-4c93-9bab-58d288086925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:34:51 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-b190263d-9a80-4346-8c8f-31bdf5d4dbaf tempest-VolumesActionsTest-689761871 None] Volume 92e4db9e-2e47-4466-9ecf-5bba8f10611c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92e4db9e-2e47-4466-9ecf-5bba8f10611c', 'volume_size': 1} Apr 29 15:34:51 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-b190263d-9a80-4346-8c8f-31bdf5d4dbaf tempest-VolumesActionsTest-689761871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:34:51 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-b190263d-9a80-4346-8c8f-31bdf5d4dbaf tempest-VolumesActionsTest-689761871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:34:51 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-b190263d-9a80-4346-8c8f-31bdf5d4dbaf tempest-VolumesActionsTest-689761871 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:34:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1432058213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92e4db9e-2e47-4466-9ecf-5bba8f10611c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8fc9f763313466db45da3e5c27ad79e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:34:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:34:52Z,use_quota=True,user_id='00a1e3821b574da0adb72ff57065dd0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:34:51 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-b190263d-9a80-4346-8c8f-31bdf5d4dbaf tempest-VolumesActionsTest-689761871 None] Creating volume 92e4db9e-2e47-4466-9ecf-5bba8f10611c {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:34:51 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-b190263d-9a80-4346-8c8f-31bdf5d4dbaf tempest-VolumesActionsTest-689761871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:34:51 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-b190263d-9a80-4346-8c8f-31bdf5d4dbaf tempest-VolumesActionsTest-689761871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:34:51 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-b190263d-9a80-4346-8c8f-31bdf5d4dbaf tempest-VolumesActionsTest-689761871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:34:52 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-b190263d-9a80-4346-8c8f-31bdf5d4dbaf tempest-VolumesActionsTest-689761871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:34:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-b190263d-9a80-4346-8c8f-31bdf5d4dbaf tempest-VolumesActionsTest-689761871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:34:52 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-b190263d-9a80-4346-8c8f-31bdf5d4dbaf tempest-VolumesActionsTest-689761871 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:34:52 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-b190263d-9a80-4346-8c8f-31bdf5d4dbaf tempest-VolumesActionsTest-689761871 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:34:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-b190263d-9a80-4346-8c8f-31bdf5d4dbaf tempest-VolumesActionsTest-689761871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-92e4db9e-2e47-4466-9ecf-5bba8f10611c 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:34:52 devstack sudo[108834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-92e4db9e-2e47-4466-9ecf-5bba8f10611c 1073741824 Apr 29 15:34:52 devstack sudo[108834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:34:52 devstack sudo[108834]: pam_unix(sudo:session): session closed for user root Apr 29 15:34:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-b190263d-9a80-4346-8c8f-31bdf5d4dbaf tempest-VolumesActionsTest-689761871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-92e4db9e-2e47-4466-9ecf-5bba8f10611c 1073741824" returned: 0 in 0.767s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:34:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-b190263d-9a80-4346-8c8f-31bdf5d4dbaf tempest-VolumesActionsTest-689761871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-92e4db9e-2e47-4466-9ecf-5bba8f10611c {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:34:52 devstack sudo[108840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-92e4db9e-2e47-4466-9ecf-5bba8f10611c Apr 29 15:34:52 devstack sudo[108840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:34:53 devstack sudo[108840]: pam_unix(sudo:session): session closed for user root Apr 29 15:34:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-b190263d-9a80-4346-8c8f-31bdf5d4dbaf tempest-VolumesActionsTest-689761871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-92e4db9e-2e47-4466-9ecf-5bba8f10611c" returned: 0 in 0.598s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:34:53 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-b190263d-9a80-4346-8c8f-31bdf5d4dbaf tempest-VolumesActionsTest-689761871 None] <== create_volume: return (1401ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:34:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-b190263d-9a80-4346-8c8f-31bdf5d4dbaf tempest-VolumesActionsTest-689761871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.404s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:34:53 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b190263d-9a80-4346-8c8f-31bdf5d4dbaf tempest-VolumesActionsTest-689761871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b70c7017-90c8-4c93-9bab-58d288086925) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92e4db9e-2e47-4466-9ecf-5bba8f10611c', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:34:53 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b190263d-9a80-4346-8c8f-31bdf5d4dbaf tempest-VolumesActionsTest-689761871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb8ecb35-86f0-4fe0-88e7-e99a72f86d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:34:53 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-b190263d-9a80-4346-8c8f-31bdf5d4dbaf tempest-VolumesActionsTest-689761871 None] Volume volume-92e4db9e-2e47-4466-9ecf-5bba8f10611c (92e4db9e-2e47-4466-9ecf-5bba8f10611c): created successfully Apr 29 15:34:53 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b190263d-9a80-4346-8c8f-31bdf5d4dbaf tempest-VolumesActionsTest-689761871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb8ecb35-86f0-4fe0-88e7-e99a72f86d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:34:53 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b190263d-9a80-4346-8c8f-31bdf5d4dbaf tempest-VolumesActionsTest-689761871 None] Flow 'volume_create_manager' (278c286e-c915-4c79-b3ce-8f3cb233e8dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:34:53 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-b190263d-9a80-4346-8c8f-31bdf5d4dbaf tempest-VolumesActionsTest-689761871 None] Created volume successfully. Apr 29 15:34:54 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-b751a3e1-e24d-44de-ab85-09b54357f062 tempest-VolumesActionsTest-689761871 None] Acquiring lock "cinder-92e4db9e-2e47-4466-9ecf-5bba8f10611c-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:34:54 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-b751a3e1-e24d-44de-ab85-09b54357f062 tempest-VolumesActionsTest-689761871 None] Lock "cinder-92e4db9e-2e47-4466-9ecf-5bba8f10611c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:34:54 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-b751a3e1-e24d-44de-ab85-09b54357f062 tempest-VolumesActionsTest-689761871 None] Acquiring lock "cinder-quobyte-92e4db9e-2e47-4466-9ecf-5bba8f10611c" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:34:54 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-b751a3e1-e24d-44de-ab85-09b54357f062 tempest-VolumesActionsTest-689761871 None] Lock "cinder-quobyte-92e4db9e-2e47-4466-9ecf-5bba8f10611c" acquired by "delete_volume" :: waited 0.014s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:34:54 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[529f089e-2538-4304-aa23-a11326e94a59]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:34:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-b751a3e1-e24d-44de-ab85-09b54357f062 tempest-VolumesActionsTest-689761871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-92e4db9e-2e47-4466-9ecf-5bba8f10611c {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:34:54 devstack sudo[108845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-92e4db9e-2e47-4466-9ecf-5bba8f10611c Apr 29 15:34:54 devstack sudo[108845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:34:55 devstack sudo[108845]: pam_unix(sudo:session): session closed for user root Apr 29 15:34:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-b751a3e1-e24d-44de-ab85-09b54357f062 tempest-VolumesActionsTest-689761871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-92e4db9e-2e47-4466-9ecf-5bba8f10611c" returned: 0 in 0.690s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:34:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-b751a3e1-e24d-44de-ab85-09b54357f062 tempest-VolumesActionsTest-689761871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-92e4db9e-2e47-4466-9ecf-5bba8f10611c {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:34:55 devstack sudo[108851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-92e4db9e-2e47-4466-9ecf-5bba8f10611c Apr 29 15:34:55 devstack sudo[108851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:34:55 devstack sudo[108851]: pam_unix(sudo:session): session closed for user root Apr 29 15:34:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-b751a3e1-e24d-44de-ab85-09b54357f062 tempest-VolumesActionsTest-689761871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-92e4db9e-2e47-4466-9ecf-5bba8f10611c" returned: 0 in 0.574s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:34:55 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-b751a3e1-e24d-44de-ab85-09b54357f062 tempest-VolumesActionsTest-689761871 None] Lock "cinder-quobyte-92e4db9e-2e47-4466-9ecf-5bba8f10611c" released by "delete_volume" :: held 1.303s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:34:55 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-b751a3e1-e24d-44de-ab85-09b54357f062 tempest-VolumesActionsTest-689761871 None] Created reservations ['c2ca165c-da37-40ac-81c5-3453fd990944', '89a9fc5e-191e-4fbb-b924-80f0ca50f27f', 'd72745a7-a949-4e0a-b2a7-c3112ea5eb4e', 'd85effbe-a069-4502-9ab1-85d8f8703d99'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:34:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-b751a3e1-e24d-44de-ab85-09b54357f062 tempest-VolumesActionsTest-689761871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:34:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-b751a3e1-e24d-44de-ab85-09b54357f062 tempest-VolumesActionsTest-689761871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:34:56 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-b751a3e1-e24d-44de-ab85-09b54357f062 tempest-VolumesActionsTest-689761871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:34:56 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-b751a3e1-e24d-44de-ab85-09b54357f062 tempest-VolumesActionsTest-689761871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:34:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-b751a3e1-e24d-44de-ab85-09b54357f062 tempest-VolumesActionsTest-689761871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:34:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-b751a3e1-e24d-44de-ab85-09b54357f062 tempest-VolumesActionsTest-689761871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:34:56 devstack sudo[108854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:34:56 devstack sudo[108854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:34:56 devstack sudo[108854]: pam_unix(sudo:session): session closed for user root Apr 29 15:34:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-b751a3e1-e24d-44de-ab85-09b54357f062 tempest-VolumesActionsTest-689761871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.582s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:34:56 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-b751a3e1-e24d-44de-ab85-09b54357f062 tempest-VolumesActionsTest-689761871 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:34:56 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-b751a3e1-e24d-44de-ab85-09b54357f062 tempest-VolumesActionsTest-689761871 None] Deleted volume successfully. Apr 29 15:34:56 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-b751a3e1-e24d-44de-ab85-09b54357f062 tempest-VolumesActionsTest-689761871 None] Lock "cinder-92e4db9e-2e47-4466-9ecf-5bba8f10611c-delete_volume" released by "delete_volume" :: held 2.054s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:35:06 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:UPDATE=61,cinder:SELECT=51,cinder:DELETE=6,cinder:INSERT=18 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:35:06 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcdf7c5e-b687-4ebd-9c50-1699cc8d5401 tempest-AbsoluteLimitsTests-1735907037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:35:06 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-dcdf7c5e-b687-4ebd-9c50-1699cc8d5401 tempest-AbsoluteLimitsTests-1735907037 None] Flow 'volume_create_manager' (99d97548-466f-4059-a184-975873d0e704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:35:06 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-dcdf7c5e-b687-4ebd-9c50-1699cc8d5401 tempest-AbsoluteLimitsTests-1735907037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80f625cb-8d65-4636-8050-1519d6fe160b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:35:06 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-dcdf7c5e-b687-4ebd-9c50-1699cc8d5401 tempest-AbsoluteLimitsTests-1735907037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80f625cb-8d65-4636-8050-1519d6fe160b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:35:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-157486562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a41bf9a-95b6-496b-8905-e51a2748922e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='166b22767ae14ea6b14c516ca3cceb17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:35:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:35:06Z,use_quota=True,user_id='7ac1610112174346b5bf3422a26caf0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:35:06 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-dcdf7c5e-b687-4ebd-9c50-1699cc8d5401 tempest-AbsoluteLimitsTests-1735907037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32c81820-a83d-42c4-8a5d-710a6ced7dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:35:06 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-dcdf7c5e-b687-4ebd-9c50-1699cc8d5401 tempest-AbsoluteLimitsTests-1735907037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32c81820-a83d-42c4-8a5d-710a6ced7dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:35:06 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-dcdf7c5e-b687-4ebd-9c50-1699cc8d5401 tempest-AbsoluteLimitsTests-1735907037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7937c88-cd7a-4be3-9081-2e12cdd3b029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:35:06 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-dcdf7c5e-b687-4ebd-9c50-1699cc8d5401 tempest-AbsoluteLimitsTests-1735907037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7937c88-cd7a-4be3-9081-2e12cdd3b029) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a41bf9a-95b6-496b-8905-e51a2748922e', 'volume_name': 'volume-8a41bf9a-95b6-496b-8905-e51a2748922e', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:35:06 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-dcdf7c5e-b687-4ebd-9c50-1699cc8d5401 tempest-AbsoluteLimitsTests-1735907037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c4c5642-dafb-4bcd-8848-14e4a35a6647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:35:06 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-dcdf7c5e-b687-4ebd-9c50-1699cc8d5401 tempest-AbsoluteLimitsTests-1735907037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c4c5642-dafb-4bcd-8848-14e4a35a6647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:35:06 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-dcdf7c5e-b687-4ebd-9c50-1699cc8d5401 tempest-AbsoluteLimitsTests-1735907037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f585d27-7edd-433c-855f-5bc32a255d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:35:06 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-dcdf7c5e-b687-4ebd-9c50-1699cc8d5401 tempest-AbsoluteLimitsTests-1735907037 None] Volume 8a41bf9a-95b6-496b-8905-e51a2748922e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a41bf9a-95b6-496b-8905-e51a2748922e', 'volume_size': 1} Apr 29 15:35:06 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-dcdf7c5e-b687-4ebd-9c50-1699cc8d5401 tempest-AbsoluteLimitsTests-1735907037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:35:06 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-dcdf7c5e-b687-4ebd-9c50-1699cc8d5401 tempest-AbsoluteLimitsTests-1735907037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:35:06 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-dcdf7c5e-b687-4ebd-9c50-1699cc8d5401 tempest-AbsoluteLimitsTests-1735907037 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:35:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-157486562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a41bf9a-95b6-496b-8905-e51a2748922e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='166b22767ae14ea6b14c516ca3cceb17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:35:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:35:06Z,use_quota=True,user_id='7ac1610112174346b5bf3422a26caf0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:35:06 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-dcdf7c5e-b687-4ebd-9c50-1699cc8d5401 tempest-AbsoluteLimitsTests-1735907037 None] Creating volume 8a41bf9a-95b6-496b-8905-e51a2748922e {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:35:06 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-dcdf7c5e-b687-4ebd-9c50-1699cc8d5401 tempest-AbsoluteLimitsTests-1735907037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:35:06 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-dcdf7c5e-b687-4ebd-9c50-1699cc8d5401 tempest-AbsoluteLimitsTests-1735907037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:35:06 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-dcdf7c5e-b687-4ebd-9c50-1699cc8d5401 tempest-AbsoluteLimitsTests-1735907037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:35:06 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-dcdf7c5e-b687-4ebd-9c50-1699cc8d5401 tempest-AbsoluteLimitsTests-1735907037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:35:06 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-dcdf7c5e-b687-4ebd-9c50-1699cc8d5401 tempest-AbsoluteLimitsTests-1735907037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:35:06 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-dcdf7c5e-b687-4ebd-9c50-1699cc8d5401 tempest-AbsoluteLimitsTests-1735907037 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:35:06 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-dcdf7c5e-b687-4ebd-9c50-1699cc8d5401 tempest-AbsoluteLimitsTests-1735907037 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:35:06 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-dcdf7c5e-b687-4ebd-9c50-1699cc8d5401 tempest-AbsoluteLimitsTests-1735907037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-8a41bf9a-95b6-496b-8905-e51a2748922e 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:35:06 devstack sudo[108867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-8a41bf9a-95b6-496b-8905-e51a2748922e 1073741824 Apr 29 15:35:06 devstack sudo[108867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:35:07 devstack sudo[108867]: pam_unix(sudo:session): session closed for user root Apr 29 15:35:07 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-dcdf7c5e-b687-4ebd-9c50-1699cc8d5401 tempest-AbsoluteLimitsTests-1735907037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-8a41bf9a-95b6-496b-8905-e51a2748922e 1073741824" returned: 0 in 0.728s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:35:07 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-dcdf7c5e-b687-4ebd-9c50-1699cc8d5401 tempest-AbsoluteLimitsTests-1735907037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-8a41bf9a-95b6-496b-8905-e51a2748922e {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:35:07 devstack sudo[108872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-8a41bf9a-95b6-496b-8905-e51a2748922e Apr 29 15:35:07 devstack sudo[108872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:35:07 devstack sudo[108872]: pam_unix(sudo:session): session closed for user root Apr 29 15:35:07 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-dcdf7c5e-b687-4ebd-9c50-1699cc8d5401 tempest-AbsoluteLimitsTests-1735907037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-8a41bf9a-95b6-496b-8905-e51a2748922e" returned: 0 in 0.582s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:35:07 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-dcdf7c5e-b687-4ebd-9c50-1699cc8d5401 tempest-AbsoluteLimitsTests-1735907037 None] <== create_volume: return (1346ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:35:07 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-dcdf7c5e-b687-4ebd-9c50-1699cc8d5401 tempest-AbsoluteLimitsTests-1735907037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.348s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:35:07 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-dcdf7c5e-b687-4ebd-9c50-1699cc8d5401 tempest-AbsoluteLimitsTests-1735907037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f585d27-7edd-433c-855f-5bc32a255d6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a41bf9a-95b6-496b-8905-e51a2748922e', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:35:07 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-dcdf7c5e-b687-4ebd-9c50-1699cc8d5401 tempest-AbsoluteLimitsTests-1735907037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f23a1ec-fb2e-456d-9d28-5b30083fe854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:35:07 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-dcdf7c5e-b687-4ebd-9c50-1699cc8d5401 tempest-AbsoluteLimitsTests-1735907037 None] Volume volume-8a41bf9a-95b6-496b-8905-e51a2748922e (8a41bf9a-95b6-496b-8905-e51a2748922e): created successfully Apr 29 15:35:07 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-dcdf7c5e-b687-4ebd-9c50-1699cc8d5401 tempest-AbsoluteLimitsTests-1735907037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f23a1ec-fb2e-456d-9d28-5b30083fe854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:35:07 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-dcdf7c5e-b687-4ebd-9c50-1699cc8d5401 tempest-AbsoluteLimitsTests-1735907037 None] Flow 'volume_create_manager' (99d97548-466f-4059-a184-975873d0e704) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:35:07 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-dcdf7c5e-b687-4ebd-9c50-1699cc8d5401 tempest-AbsoluteLimitsTests-1735907037 None] Created volume successfully. Apr 29 15:35:08 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-55fca92c-6b36-437c-b574-8a7ab435b30d tempest-AbsoluteLimitsTests-1735907037 None] Acquiring lock "cinder-8a41bf9a-95b6-496b-8905-e51a2748922e-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:35:08 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-55fca92c-6b36-437c-b574-8a7ab435b30d tempest-AbsoluteLimitsTests-1735907037 None] Lock "cinder-8a41bf9a-95b6-496b-8905-e51a2748922e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:35:08 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-55fca92c-6b36-437c-b574-8a7ab435b30d tempest-AbsoluteLimitsTests-1735907037 None] Acquiring lock "cinder-quobyte-8a41bf9a-95b6-496b-8905-e51a2748922e" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:35:08 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-55fca92c-6b36-437c-b574-8a7ab435b30d tempest-AbsoluteLimitsTests-1735907037 None] Lock "cinder-quobyte-8a41bf9a-95b6-496b-8905-e51a2748922e" acquired by "delete_volume" :: waited 0.015s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:35:08 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb0c41a-1252-4bd9-b180-9a3ae7f0830b]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:35:08 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-55fca92c-6b36-437c-b574-8a7ab435b30d tempest-AbsoluteLimitsTests-1735907037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-8a41bf9a-95b6-496b-8905-e51a2748922e {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:35:08 devstack sudo[108875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-8a41bf9a-95b6-496b-8905-e51a2748922e Apr 29 15:35:08 devstack sudo[108875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:35:09 devstack sudo[108875]: pam_unix(sudo:session): session closed for user root Apr 29 15:35:09 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-55fca92c-6b36-437c-b574-8a7ab435b30d tempest-AbsoluteLimitsTests-1735907037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-8a41bf9a-95b6-496b-8905-e51a2748922e" returned: 0 in 0.700s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:35:09 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-55fca92c-6b36-437c-b574-8a7ab435b30d tempest-AbsoluteLimitsTests-1735907037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-8a41bf9a-95b6-496b-8905-e51a2748922e {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:35:09 devstack sudo[108880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-8a41bf9a-95b6-496b-8905-e51a2748922e Apr 29 15:35:09 devstack sudo[108880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:35:09 devstack sudo[108880]: pam_unix(sudo:session): session closed for user root Apr 29 15:35:09 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-55fca92c-6b36-437c-b574-8a7ab435b30d tempest-AbsoluteLimitsTests-1735907037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-8a41bf9a-95b6-496b-8905-e51a2748922e" returned: 0 in 0.579s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:35:09 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-55fca92c-6b36-437c-b574-8a7ab435b30d tempest-AbsoluteLimitsTests-1735907037 None] Lock "cinder-quobyte-8a41bf9a-95b6-496b-8905-e51a2748922e" released by "delete_volume" :: held 1.318s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:35:10 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-55fca92c-6b36-437c-b574-8a7ab435b30d tempest-AbsoluteLimitsTests-1735907037 None] Created reservations ['4ad2c6cc-4c84-4654-acc0-1fa53c973c24', 'b5fdeae6-92a7-45a6-af91-bfcfce36e7cc', '97543fa1-892e-4567-9abd-01919d5bc34d', '5b08b73e-f936-4172-9c95-29fc176b8604'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:35:10 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-55fca92c-6b36-437c-b574-8a7ab435b30d tempest-AbsoluteLimitsTests-1735907037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:35:10 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-55fca92c-6b36-437c-b574-8a7ab435b30d tempest-AbsoluteLimitsTests-1735907037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:35:10 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-55fca92c-6b36-437c-b574-8a7ab435b30d tempest-AbsoluteLimitsTests-1735907037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:35:10 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-55fca92c-6b36-437c-b574-8a7ab435b30d tempest-AbsoluteLimitsTests-1735907037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:35:10 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-55fca92c-6b36-437c-b574-8a7ab435b30d tempest-AbsoluteLimitsTests-1735907037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:35:10 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-55fca92c-6b36-437c-b574-8a7ab435b30d tempest-AbsoluteLimitsTests-1735907037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:35:10 devstack sudo[108883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:35:10 devstack sudo[108883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:35:10 devstack sudo[108883]: pam_unix(sudo:session): session closed for user root Apr 29 15:35:10 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-55fca92c-6b36-437c-b574-8a7ab435b30d tempest-AbsoluteLimitsTests-1735907037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.578s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:35:10 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-55fca92c-6b36-437c-b574-8a7ab435b30d tempest-AbsoluteLimitsTests-1735907037 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:35:10 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-55fca92c-6b36-437c-b574-8a7ab435b30d tempest-AbsoluteLimitsTests-1735907037 None] Deleted volume successfully. Apr 29 15:35:10 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-55fca92c-6b36-437c-b574-8a7ab435b30d tempest-AbsoluteLimitsTests-1735907037 None] Lock "cinder-8a41bf9a-95b6-496b-8905-e51a2748922e-delete_volume" released by "delete_volume" :: held 2.067s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:35:14 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-07578a16-c410-4546-ac29-c198dcdc0d04 tempest-VolumesMetadataTest-60454213 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:35:14 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-07578a16-c410-4546-ac29-c198dcdc0d04 tempest-VolumesMetadataTest-60454213 None] Flow 'volume_create_manager' (9e306503-8282-44ef-83e5-1bfe381b34bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:35:14 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-07578a16-c410-4546-ac29-c198dcdc0d04 tempest-VolumesMetadataTest-60454213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2693f93-6796-4e86-abb5-e5eccd046737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:35:14 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-07578a16-c410-4546-ac29-c198dcdc0d04 tempest-VolumesMetadataTest-60454213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2693f93-6796-4e86-abb5-e5eccd046737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:35:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-106438271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0b3ff04-24ef-4ea9-9195-f86d56da7503,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='547e022c65b948b4b89c6970e9908d06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:35:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:35:14Z,use_quota=True,user_id='890fbc9f69d64b58b950c1c1f5457977',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:35:14 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-07578a16-c410-4546-ac29-c198dcdc0d04 tempest-VolumesMetadataTest-60454213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aacda4c4-09ef-41d7-a2aa-b39525edf69d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:35:14 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-07578a16-c410-4546-ac29-c198dcdc0d04 tempest-VolumesMetadataTest-60454213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aacda4c4-09ef-41d7-a2aa-b39525edf69d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:35:14 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-07578a16-c410-4546-ac29-c198dcdc0d04 tempest-VolumesMetadataTest-60454213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ff315c0-83db-4cb8-b31d-16d4d7f2e44a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:35:14 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-07578a16-c410-4546-ac29-c198dcdc0d04 tempest-VolumesMetadataTest-60454213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ff315c0-83db-4cb8-b31d-16d4d7f2e44a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0b3ff04-24ef-4ea9-9195-f86d56da7503', 'volume_name': 'volume-a0b3ff04-24ef-4ea9-9195-f86d56da7503', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:35:14 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-07578a16-c410-4546-ac29-c198dcdc0d04 tempest-VolumesMetadataTest-60454213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c000aee6-51dd-4734-9fec-2ba12dc216b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:35:14 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-07578a16-c410-4546-ac29-c198dcdc0d04 tempest-VolumesMetadataTest-60454213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c000aee6-51dd-4734-9fec-2ba12dc216b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:35:14 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-07578a16-c410-4546-ac29-c198dcdc0d04 tempest-VolumesMetadataTest-60454213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (611d0e70-b907-4cf2-a620-f7f1aba8bebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:35:14 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-07578a16-c410-4546-ac29-c198dcdc0d04 tempest-VolumesMetadataTest-60454213 None] Volume a0b3ff04-24ef-4ea9-9195-f86d56da7503: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0b3ff04-24ef-4ea9-9195-f86d56da7503', 'volume_size': 1} Apr 29 15:35:14 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-07578a16-c410-4546-ac29-c198dcdc0d04 tempest-VolumesMetadataTest-60454213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:35:14 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-07578a16-c410-4546-ac29-c198dcdc0d04 tempest-VolumesMetadataTest-60454213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:35:14 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-07578a16-c410-4546-ac29-c198dcdc0d04 tempest-VolumesMetadataTest-60454213 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:35:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-106438271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0b3ff04-24ef-4ea9-9195-f86d56da7503,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='547e022c65b948b4b89c6970e9908d06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:35:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:35:14Z,use_quota=True,user_id='890fbc9f69d64b58b950c1c1f5457977',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:35:14 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-07578a16-c410-4546-ac29-c198dcdc0d04 tempest-VolumesMetadataTest-60454213 None] Creating volume a0b3ff04-24ef-4ea9-9195-f86d56da7503 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:35:14 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-07578a16-c410-4546-ac29-c198dcdc0d04 tempest-VolumesMetadataTest-60454213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:35:14 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-07578a16-c410-4546-ac29-c198dcdc0d04 tempest-VolumesMetadataTest-60454213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:35:14 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-07578a16-c410-4546-ac29-c198dcdc0d04 tempest-VolumesMetadataTest-60454213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:35:14 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-07578a16-c410-4546-ac29-c198dcdc0d04 tempest-VolumesMetadataTest-60454213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:35:14 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-07578a16-c410-4546-ac29-c198dcdc0d04 tempest-VolumesMetadataTest-60454213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:35:14 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-07578a16-c410-4546-ac29-c198dcdc0d04 tempest-VolumesMetadataTest-60454213 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:35:14 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-07578a16-c410-4546-ac29-c198dcdc0d04 tempest-VolumesMetadataTest-60454213 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:35:14 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-07578a16-c410-4546-ac29-c198dcdc0d04 tempest-VolumesMetadataTest-60454213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a0b3ff04-24ef-4ea9-9195-f86d56da7503 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:35:14 devstack sudo[108886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a0b3ff04-24ef-4ea9-9195-f86d56da7503 1073741824 Apr 29 15:35:14 devstack sudo[108886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:35:15 devstack sudo[108886]: pam_unix(sudo:session): session closed for user root Apr 29 15:35:15 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-07578a16-c410-4546-ac29-c198dcdc0d04 tempest-VolumesMetadataTest-60454213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a0b3ff04-24ef-4ea9-9195-f86d56da7503 1073741824" returned: 0 in 0.732s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:35:15 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-07578a16-c410-4546-ac29-c198dcdc0d04 tempest-VolumesMetadataTest-60454213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a0b3ff04-24ef-4ea9-9195-f86d56da7503 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:35:15 devstack sudo[108892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a0b3ff04-24ef-4ea9-9195-f86d56da7503 Apr 29 15:35:15 devstack sudo[108892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:35:15 devstack sudo[108892]: pam_unix(sudo:session): session closed for user root Apr 29 15:35:15 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-07578a16-c410-4546-ac29-c198dcdc0d04 tempest-VolumesMetadataTest-60454213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a0b3ff04-24ef-4ea9-9195-f86d56da7503" returned: 0 in 0.589s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:35:15 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-07578a16-c410-4546-ac29-c198dcdc0d04 tempest-VolumesMetadataTest-60454213 None] <== create_volume: return (1360ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:35:15 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-07578a16-c410-4546-ac29-c198dcdc0d04 tempest-VolumesMetadataTest-60454213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.363s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:35:15 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:SELECT=59,cinder:INSERT=15,cinder:UPDATE=92,cinder:DELETE=6 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:35:15 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-07578a16-c410-4546-ac29-c198dcdc0d04 tempest-VolumesMetadataTest-60454213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (611d0e70-b907-4cf2-a620-f7f1aba8bebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0b3ff04-24ef-4ea9-9195-f86d56da7503', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:35:15 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-07578a16-c410-4546-ac29-c198dcdc0d04 tempest-VolumesMetadataTest-60454213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d6551de-8e1b-4e13-977f-79c5973dc2d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:35:15 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-07578a16-c410-4546-ac29-c198dcdc0d04 tempest-VolumesMetadataTest-60454213 None] Volume volume-a0b3ff04-24ef-4ea9-9195-f86d56da7503 (a0b3ff04-24ef-4ea9-9195-f86d56da7503): created successfully Apr 29 15:35:15 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-07578a16-c410-4546-ac29-c198dcdc0d04 tempest-VolumesMetadataTest-60454213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d6551de-8e1b-4e13-977f-79c5973dc2d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:35:15 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-07578a16-c410-4546-ac29-c198dcdc0d04 tempest-VolumesMetadataTest-60454213 None] Flow 'volume_create_manager' (9e306503-8282-44ef-83e5-1bfe381b34bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:35:15 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-07578a16-c410-4546-ac29-c198dcdc0d04 tempest-VolumesMetadataTest-60454213 None] Created volume successfully. Apr 29 15:35:16 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-01931891-afd1-41b0-9acb-f38caf52da23 tempest-VolumesMetadataTest-60454213 None] Acquiring lock "cinder-a0b3ff04-24ef-4ea9-9195-f86d56da7503-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:35:17 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-01931891-afd1-41b0-9acb-f38caf52da23 tempest-VolumesMetadataTest-60454213 None] Lock "cinder-a0b3ff04-24ef-4ea9-9195-f86d56da7503-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:35:17 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-01931891-afd1-41b0-9acb-f38caf52da23 tempest-VolumesMetadataTest-60454213 None] Acquiring lock "cinder-quobyte-a0b3ff04-24ef-4ea9-9195-f86d56da7503" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:35:17 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-01931891-afd1-41b0-9acb-f38caf52da23 tempest-VolumesMetadataTest-60454213 None] Lock "cinder-quobyte-a0b3ff04-24ef-4ea9-9195-f86d56da7503" acquired by "delete_volume" :: waited 0.014s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:35:17 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f324ce1-54e7-4a8f-a3d8-0f1019151046]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:35:17 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-01931891-afd1-41b0-9acb-f38caf52da23 tempest-VolumesMetadataTest-60454213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a0b3ff04-24ef-4ea9-9195-f86d56da7503 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:35:17 devstack sudo[108896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a0b3ff04-24ef-4ea9-9195-f86d56da7503 Apr 29 15:35:17 devstack sudo[108896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:35:17 devstack sudo[108896]: pam_unix(sudo:session): session closed for user root Apr 29 15:35:17 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-01931891-afd1-41b0-9acb-f38caf52da23 tempest-VolumesMetadataTest-60454213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a0b3ff04-24ef-4ea9-9195-f86d56da7503" returned: 0 in 0.681s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:35:17 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-01931891-afd1-41b0-9acb-f38caf52da23 tempest-VolumesMetadataTest-60454213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a0b3ff04-24ef-4ea9-9195-f86d56da7503 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:35:17 devstack sudo[108901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a0b3ff04-24ef-4ea9-9195-f86d56da7503 Apr 29 15:35:17 devstack sudo[108901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:35:18 devstack sudo[108901]: pam_unix(sudo:session): session closed for user root Apr 29 15:35:18 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-01931891-afd1-41b0-9acb-f38caf52da23 tempest-VolumesMetadataTest-60454213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-a0b3ff04-24ef-4ea9-9195-f86d56da7503" returned: 0 in 0.595s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:35:18 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-01931891-afd1-41b0-9acb-f38caf52da23 tempest-VolumesMetadataTest-60454213 None] Lock "cinder-quobyte-a0b3ff04-24ef-4ea9-9195-f86d56da7503" released by "delete_volume" :: held 1.314s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:35:18 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-01931891-afd1-41b0-9acb-f38caf52da23 tempest-VolumesMetadataTest-60454213 None] Created reservations ['565e9f4b-2393-4548-9e23-a341323323b0', 'a0a2c96a-9d9a-4165-b137-ba1cfd7641cc', '559e1a01-aee7-4cd9-be2d-235b83ebae33', '53d09265-5f9f-4811-b9ec-81b8aa899d4e'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:35:18 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-01931891-afd1-41b0-9acb-f38caf52da23 tempest-VolumesMetadataTest-60454213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:35:18 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-01931891-afd1-41b0-9acb-f38caf52da23 tempest-VolumesMetadataTest-60454213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:35:18 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-01931891-afd1-41b0-9acb-f38caf52da23 tempest-VolumesMetadataTest-60454213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:35:18 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-01931891-afd1-41b0-9acb-f38caf52da23 tempest-VolumesMetadataTest-60454213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:35:18 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-01931891-afd1-41b0-9acb-f38caf52da23 tempest-VolumesMetadataTest-60454213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:35:18 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-01931891-afd1-41b0-9acb-f38caf52da23 tempest-VolumesMetadataTest-60454213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:35:18 devstack sudo[108904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:35:18 devstack sudo[108904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:35:19 devstack sudo[108904]: pam_unix(sudo:session): session closed for user root Apr 29 15:35:19 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-01931891-afd1-41b0-9acb-f38caf52da23 tempest-VolumesMetadataTest-60454213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.589s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:35:19 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-01931891-afd1-41b0-9acb-f38caf52da23 tempest-VolumesMetadataTest-60454213 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:35:19 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-01931891-afd1-41b0-9acb-f38caf52da23 tempest-VolumesMetadataTest-60454213 None] Deleted volume successfully. Apr 29 15:35:19 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-01931891-afd1-41b0-9acb-f38caf52da23 tempest-VolumesMetadataTest-60454213 None] Lock "cinder-a0b3ff04-24ef-4ea9-9195-f86d56da7503-delete_volume" released by "delete_volume" :: held 2.078s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:35:22 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-1606af69-9cce-4f71-8e4f-75b37a220329 tempest-VolumesTransfersV355Test-1871821054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:35:22 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-1606af69-9cce-4f71-8e4f-75b37a220329 tempest-VolumesTransfersV355Test-1871821054 None] Flow 'volume_create_manager' (4cef3fdd-da21-41d5-9b9c-4fc3a17d76a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:35:22 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-1606af69-9cce-4f71-8e4f-75b37a220329 tempest-VolumesTransfersV355Test-1871821054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b42020e8-aed7-473a-a413-b98dc41eea4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:35:22 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-1606af69-9cce-4f71-8e4f-75b37a220329 tempest-VolumesTransfersV355Test-1871821054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b42020e8-aed7-473a-a413-b98dc41eea4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:35:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-555808983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e89fd3e8-9f63-4aa1-8ff8-5066921fc457,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c2891878dc54ca9972a2bc9b76c6162',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:35:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:35:23Z,use_quota=True,user_id='681d7e2e63234013b16cd072036d5056',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:35:22 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-1606af69-9cce-4f71-8e4f-75b37a220329 tempest-VolumesTransfersV355Test-1871821054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37840b8c-8e57-489b-826c-ff846a645997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:35:22 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-1606af69-9cce-4f71-8e4f-75b37a220329 tempest-VolumesTransfersV355Test-1871821054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37840b8c-8e57-489b-826c-ff846a645997) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:35:22 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-1606af69-9cce-4f71-8e4f-75b37a220329 tempest-VolumesTransfersV355Test-1871821054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92635a45-e023-410b-ae6e-6e9285613593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:35:22 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-1606af69-9cce-4f71-8e4f-75b37a220329 tempest-VolumesTransfersV355Test-1871821054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92635a45-e023-410b-ae6e-6e9285613593) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e89fd3e8-9f63-4aa1-8ff8-5066921fc457', 'volume_name': 'volume-e89fd3e8-9f63-4aa1-8ff8-5066921fc457', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:35:22 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-1606af69-9cce-4f71-8e4f-75b37a220329 tempest-VolumesTransfersV355Test-1871821054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8764e46a-066f-4536-b13f-2304aebfba90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:35:22 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-1606af69-9cce-4f71-8e4f-75b37a220329 tempest-VolumesTransfersV355Test-1871821054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8764e46a-066f-4536-b13f-2304aebfba90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:35:22 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-1606af69-9cce-4f71-8e4f-75b37a220329 tempest-VolumesTransfersV355Test-1871821054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff68bdb6-4345-487b-8d81-341769f96ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:35:22 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-1606af69-9cce-4f71-8e4f-75b37a220329 tempest-VolumesTransfersV355Test-1871821054 None] Volume e89fd3e8-9f63-4aa1-8ff8-5066921fc457: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e89fd3e8-9f63-4aa1-8ff8-5066921fc457', 'volume_size': 1} Apr 29 15:35:22 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-1606af69-9cce-4f71-8e4f-75b37a220329 tempest-VolumesTransfersV355Test-1871821054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:35:22 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-1606af69-9cce-4f71-8e4f-75b37a220329 tempest-VolumesTransfersV355Test-1871821054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:35:22 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-1606af69-9cce-4f71-8e4f-75b37a220329 tempest-VolumesTransfersV355Test-1871821054 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:35:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-555808983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e89fd3e8-9f63-4aa1-8ff8-5066921fc457,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c2891878dc54ca9972a2bc9b76c6162',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:35:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:35:23Z,use_quota=True,user_id='681d7e2e63234013b16cd072036d5056',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:35:22 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-1606af69-9cce-4f71-8e4f-75b37a220329 tempest-VolumesTransfersV355Test-1871821054 None] Creating volume e89fd3e8-9f63-4aa1-8ff8-5066921fc457 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:35:22 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-1606af69-9cce-4f71-8e4f-75b37a220329 tempest-VolumesTransfersV355Test-1871821054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:35:22 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-1606af69-9cce-4f71-8e4f-75b37a220329 tempest-VolumesTransfersV355Test-1871821054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:35:22 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-1606af69-9cce-4f71-8e4f-75b37a220329 tempest-VolumesTransfersV355Test-1871821054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:35:22 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-1606af69-9cce-4f71-8e4f-75b37a220329 tempest-VolumesTransfersV355Test-1871821054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:35:22 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-1606af69-9cce-4f71-8e4f-75b37a220329 tempest-VolumesTransfersV355Test-1871821054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:35:23 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-1606af69-9cce-4f71-8e4f-75b37a220329 tempest-VolumesTransfersV355Test-1871821054 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:35:23 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-1606af69-9cce-4f71-8e4f-75b37a220329 tempest-VolumesTransfersV355Test-1871821054 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:35:23 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1606af69-9cce-4f71-8e4f-75b37a220329 tempest-VolumesTransfersV355Test-1871821054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-e89fd3e8-9f63-4aa1-8ff8-5066921fc457 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:35:23 devstack sudo[108907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-e89fd3e8-9f63-4aa1-8ff8-5066921fc457 1073741824 Apr 29 15:35:23 devstack sudo[108907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:35:23 devstack sudo[108907]: pam_unix(sudo:session): session closed for user root Apr 29 15:35:23 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1606af69-9cce-4f71-8e4f-75b37a220329 tempest-VolumesTransfersV355Test-1871821054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-e89fd3e8-9f63-4aa1-8ff8-5066921fc457 1073741824" returned: 0 in 0.752s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:35:23 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1606af69-9cce-4f71-8e4f-75b37a220329 tempest-VolumesTransfersV355Test-1871821054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-e89fd3e8-9f63-4aa1-8ff8-5066921fc457 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:35:23 devstack sudo[108912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-e89fd3e8-9f63-4aa1-8ff8-5066921fc457 Apr 29 15:35:23 devstack sudo[108912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:35:24 devstack sudo[108912]: pam_unix(sudo:session): session closed for user root Apr 29 15:35:24 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1606af69-9cce-4f71-8e4f-75b37a220329 tempest-VolumesTransfersV355Test-1871821054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-e89fd3e8-9f63-4aa1-8ff8-5066921fc457" returned: 0 in 0.572s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:35:24 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-1606af69-9cce-4f71-8e4f-75b37a220329 tempest-VolumesTransfersV355Test-1871821054 None] <== create_volume: return (1362ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:35:24 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-1606af69-9cce-4f71-8e4f-75b37a220329 tempest-VolumesTransfersV355Test-1871821054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.364s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:35:24 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-1606af69-9cce-4f71-8e4f-75b37a220329 tempest-VolumesTransfersV355Test-1871821054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff68bdb6-4345-487b-8d81-341769f96ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e89fd3e8-9f63-4aa1-8ff8-5066921fc457', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:35:24 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-1606af69-9cce-4f71-8e4f-75b37a220329 tempest-VolumesTransfersV355Test-1871821054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0416971-52a1-4867-88f5-833c9738246c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:35:24 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-1606af69-9cce-4f71-8e4f-75b37a220329 tempest-VolumesTransfersV355Test-1871821054 None] Volume volume-e89fd3e8-9f63-4aa1-8ff8-5066921fc457 (e89fd3e8-9f63-4aa1-8ff8-5066921fc457): created successfully Apr 29 15:35:24 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-1606af69-9cce-4f71-8e4f-75b37a220329 tempest-VolumesTransfersV355Test-1871821054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0416971-52a1-4867-88f5-833c9738246c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:35:24 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-1606af69-9cce-4f71-8e4f-75b37a220329 tempest-VolumesTransfersV355Test-1871821054 None] Flow 'volume_create_manager' (4cef3fdd-da21-41d5-9b9c-4fc3a17d76a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:35:24 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-1606af69-9cce-4f71-8e4f-75b37a220329 tempest-VolumesTransfersV355Test-1871821054 None] Created volume successfully. Apr 29 15:35:25 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-4c701923-4a20-4b8f-b86c-cbe715d84b59 tempest-VolumesTransfersV355Test-1874479894 None] Transfer volume completed successfully. Apr 29 15:35:26 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-fa6b2806-19b2-42e3-a334-ea4695251507 tempest-VolumesTransfersV355Test-238971377 None] Acquiring lock "cinder-e89fd3e8-9f63-4aa1-8ff8-5066921fc457-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:35:26 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-fa6b2806-19b2-42e3-a334-ea4695251507 tempest-VolumesTransfersV355Test-238971377 None] Lock "cinder-e89fd3e8-9f63-4aa1-8ff8-5066921fc457-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:35:26 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-fa6b2806-19b2-42e3-a334-ea4695251507 tempest-VolumesTransfersV355Test-238971377 None] Acquiring lock "cinder-quobyte-e89fd3e8-9f63-4aa1-8ff8-5066921fc457" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:35:26 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-fa6b2806-19b2-42e3-a334-ea4695251507 tempest-VolumesTransfersV355Test-238971377 None] Lock "cinder-quobyte-e89fd3e8-9f63-4aa1-8ff8-5066921fc457" acquired by "delete_volume" :: waited 0.016s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:35:26 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f2eae9a-9481-4b7f-ad1c-c73973dfd569]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:35:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-fa6b2806-19b2-42e3-a334-ea4695251507 tempest-VolumesTransfersV355Test-238971377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-e89fd3e8-9f63-4aa1-8ff8-5066921fc457 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:35:26 devstack sudo[108916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-e89fd3e8-9f63-4aa1-8ff8-5066921fc457 Apr 29 15:35:26 devstack sudo[108916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:35:27 devstack sudo[108916]: pam_unix(sudo:session): session closed for user root Apr 29 15:35:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-fa6b2806-19b2-42e3-a334-ea4695251507 tempest-VolumesTransfersV355Test-238971377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-e89fd3e8-9f63-4aa1-8ff8-5066921fc457" returned: 0 in 0.688s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:35:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-fa6b2806-19b2-42e3-a334-ea4695251507 tempest-VolumesTransfersV355Test-238971377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-e89fd3e8-9f63-4aa1-8ff8-5066921fc457 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:35:27 devstack sudo[108921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-e89fd3e8-9f63-4aa1-8ff8-5066921fc457 Apr 29 15:35:27 devstack sudo[108921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:35:27 devstack sudo[108921]: pam_unix(sudo:session): session closed for user root Apr 29 15:35:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-fa6b2806-19b2-42e3-a334-ea4695251507 tempest-VolumesTransfersV355Test-238971377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-e89fd3e8-9f63-4aa1-8ff8-5066921fc457" returned: 0 in 0.584s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:35:27 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-fa6b2806-19b2-42e3-a334-ea4695251507 tempest-VolumesTransfersV355Test-238971377 None] Lock "cinder-quobyte-e89fd3e8-9f63-4aa1-8ff8-5066921fc457" released by "delete_volume" :: held 1.314s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:35:27 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-fa6b2806-19b2-42e3-a334-ea4695251507 tempest-VolumesTransfersV355Test-238971377 None] Created reservations ['5476459d-d3ef-4603-9cb4-3a66aa62949c', '105994a7-dec1-4c3c-9910-5deaa6e3b743', '2142f1b2-e315-4ba5-a80b-b5fc8d411b33', '33d21049-ea63-4d9d-a21f-252e94128752'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:35:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-fa6b2806-19b2-42e3-a334-ea4695251507 tempest-VolumesTransfersV355Test-238971377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:35:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-fa6b2806-19b2-42e3-a334-ea4695251507 tempest-VolumesTransfersV355Test-238971377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:35:27 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-fa6b2806-19b2-42e3-a334-ea4695251507 tempest-VolumesTransfersV355Test-238971377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:35:27 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-fa6b2806-19b2-42e3-a334-ea4695251507 tempest-VolumesTransfersV355Test-238971377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:35:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-fa6b2806-19b2-42e3-a334-ea4695251507 tempest-VolumesTransfersV355Test-238971377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:35:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-fa6b2806-19b2-42e3-a334-ea4695251507 tempest-VolumesTransfersV355Test-238971377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:35:27 devstack sudo[108924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:35:27 devstack sudo[108924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:35:28 devstack sudo[108924]: pam_unix(sudo:session): session closed for user root Apr 29 15:35:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-fa6b2806-19b2-42e3-a334-ea4695251507 tempest-VolumesTransfersV355Test-238971377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.577s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:35:28 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-fa6b2806-19b2-42e3-a334-ea4695251507 tempest-VolumesTransfersV355Test-238971377 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:35:28 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-fa6b2806-19b2-42e3-a334-ea4695251507 tempest-VolumesTransfersV355Test-238971377 None] Deleted volume successfully. Apr 29 15:35:28 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-fa6b2806-19b2-42e3-a334-ea4695251507 tempest-VolumesTransfersV355Test-238971377 None] Lock "cinder-e89fd3e8-9f63-4aa1-8ff8-5066921fc457-delete_volume" released by "delete_volume" :: held 2.069s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:35:29 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-13d5a436-e557-490b-82f7-00bf27a83dc8 tempest-VolumesTransfersV355Test-1871821054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:35:29 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-13d5a436-e557-490b-82f7-00bf27a83dc8 tempest-VolumesTransfersV355Test-1871821054 None] Flow 'volume_create_manager' (98f07e2f-90ea-4cec-afcc-dd62429c27fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:35:29 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-13d5a436-e557-490b-82f7-00bf27a83dc8 tempest-VolumesTransfersV355Test-1871821054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b8d6e0d-febe-412a-b870-181f825842e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:35:29 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-13d5a436-e557-490b-82f7-00bf27a83dc8 tempest-VolumesTransfersV355Test-1871821054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b8d6e0d-febe-412a-b870-181f825842e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:35:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1039150186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5afe3e80-78c5-4839-8dd1-8160851b77cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c2891878dc54ca9972a2bc9b76c6162',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:35:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:35:29Z,use_quota=True,user_id='681d7e2e63234013b16cd072036d5056',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:35:29 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-13d5a436-e557-490b-82f7-00bf27a83dc8 tempest-VolumesTransfersV355Test-1871821054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8506c2c6-71be-4f6c-847b-5cdafaf65845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:35:29 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-13d5a436-e557-490b-82f7-00bf27a83dc8 tempest-VolumesTransfersV355Test-1871821054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8506c2c6-71be-4f6c-847b-5cdafaf65845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:35:29 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-13d5a436-e557-490b-82f7-00bf27a83dc8 tempest-VolumesTransfersV355Test-1871821054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a973496-a8e6-4aab-8a5b-8dd6a2f0078b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:35:29 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-13d5a436-e557-490b-82f7-00bf27a83dc8 tempest-VolumesTransfersV355Test-1871821054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a973496-a8e6-4aab-8a5b-8dd6a2f0078b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5afe3e80-78c5-4839-8dd1-8160851b77cc', 'volume_name': 'volume-5afe3e80-78c5-4839-8dd1-8160851b77cc', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:35:29 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-13d5a436-e557-490b-82f7-00bf27a83dc8 tempest-VolumesTransfersV355Test-1871821054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2c4701e-d4b3-462b-9cdd-e80ecd10818f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:35:29 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-13d5a436-e557-490b-82f7-00bf27a83dc8 tempest-VolumesTransfersV355Test-1871821054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2c4701e-d4b3-462b-9cdd-e80ecd10818f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:35:29 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-13d5a436-e557-490b-82f7-00bf27a83dc8 tempest-VolumesTransfersV355Test-1871821054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f40d269-e433-4a04-9d27-ebd2f62c1e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:35:29 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-13d5a436-e557-490b-82f7-00bf27a83dc8 tempest-VolumesTransfersV355Test-1871821054 None] Volume 5afe3e80-78c5-4839-8dd1-8160851b77cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5afe3e80-78c5-4839-8dd1-8160851b77cc', 'volume_size': 1} Apr 29 15:35:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-13d5a436-e557-490b-82f7-00bf27a83dc8 tempest-VolumesTransfersV355Test-1871821054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:35:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-13d5a436-e557-490b-82f7-00bf27a83dc8 tempest-VolumesTransfersV355Test-1871821054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:35:29 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-13d5a436-e557-490b-82f7-00bf27a83dc8 tempest-VolumesTransfersV355Test-1871821054 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:35:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1039150186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5afe3e80-78c5-4839-8dd1-8160851b77cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c2891878dc54ca9972a2bc9b76c6162',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:35:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:35:29Z,use_quota=True,user_id='681d7e2e63234013b16cd072036d5056',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:35:29 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-13d5a436-e557-490b-82f7-00bf27a83dc8 tempest-VolumesTransfersV355Test-1871821054 None] Creating volume 5afe3e80-78c5-4839-8dd1-8160851b77cc {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:35:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-13d5a436-e557-490b-82f7-00bf27a83dc8 tempest-VolumesTransfersV355Test-1871821054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:35:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-13d5a436-e557-490b-82f7-00bf27a83dc8 tempest-VolumesTransfersV355Test-1871821054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:35:29 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-13d5a436-e557-490b-82f7-00bf27a83dc8 tempest-VolumesTransfersV355Test-1871821054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:35:29 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-13d5a436-e557-490b-82f7-00bf27a83dc8 tempest-VolumesTransfersV355Test-1871821054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:35:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-13d5a436-e557-490b-82f7-00bf27a83dc8 tempest-VolumesTransfersV355Test-1871821054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:35:29 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-13d5a436-e557-490b-82f7-00bf27a83dc8 tempest-VolumesTransfersV355Test-1871821054 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:35:29 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-13d5a436-e557-490b-82f7-00bf27a83dc8 tempest-VolumesTransfersV355Test-1871821054 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:35:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-13d5a436-e557-490b-82f7-00bf27a83dc8 tempest-VolumesTransfersV355Test-1871821054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5afe3e80-78c5-4839-8dd1-8160851b77cc 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:35:29 devstack sudo[108927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5afe3e80-78c5-4839-8dd1-8160851b77cc 1073741824 Apr 29 15:35:29 devstack sudo[108927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:35:29 devstack sudo[108927]: pam_unix(sudo:session): session closed for user root Apr 29 15:35:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-13d5a436-e557-490b-82f7-00bf27a83dc8 tempest-VolumesTransfersV355Test-1871821054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5afe3e80-78c5-4839-8dd1-8160851b77cc 1073741824" returned: 0 in 0.764s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:35:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-13d5a436-e557-490b-82f7-00bf27a83dc8 tempest-VolumesTransfersV355Test-1871821054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5afe3e80-78c5-4839-8dd1-8160851b77cc {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:35:29 devstack sudo[108932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5afe3e80-78c5-4839-8dd1-8160851b77cc Apr 29 15:35:29 devstack sudo[108932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:35:30 devstack cinder-volume[84448]: DEBUG oslo_service.periodic_task [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84448) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 15:35:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:35:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:35:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:35:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:35:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:35:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:35:30 devstack sudo[108935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:35:30 devstack sudo[108935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:35:30 devstack sudo[108932]: pam_unix(sudo:session): session closed for user root Apr 29 15:35:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-13d5a436-e557-490b-82f7-00bf27a83dc8 tempest-VolumesTransfersV355Test-1871821054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5afe3e80-78c5-4839-8dd1-8160851b77cc" returned: 0 in 0.577s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:35:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-13d5a436-e557-490b-82f7-00bf27a83dc8 tempest-VolumesTransfersV355Test-1871821054 None] <== create_volume: return (1377ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:35:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-13d5a436-e557-490b-82f7-00bf27a83dc8 tempest-VolumesTransfersV355Test-1871821054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.379s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:35:30 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-13d5a436-e557-490b-82f7-00bf27a83dc8 tempest-VolumesTransfersV355Test-1871821054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f40d269-e433-4a04-9d27-ebd2f62c1e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5afe3e80-78c5-4839-8dd1-8160851b77cc', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:35:30 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-13d5a436-e557-490b-82f7-00bf27a83dc8 tempest-VolumesTransfersV355Test-1871821054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e03fe8df-49e2-4864-9aba-1cbe18d33ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:35:30 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-13d5a436-e557-490b-82f7-00bf27a83dc8 tempest-VolumesTransfersV355Test-1871821054 None] Volume volume-5afe3e80-78c5-4839-8dd1-8160851b77cc (5afe3e80-78c5-4839-8dd1-8160851b77cc): created successfully Apr 29 15:35:30 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-13d5a436-e557-490b-82f7-00bf27a83dc8 tempest-VolumesTransfersV355Test-1871821054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e03fe8df-49e2-4864-9aba-1cbe18d33ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:35:30 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-13d5a436-e557-490b-82f7-00bf27a83dc8 tempest-VolumesTransfersV355Test-1871821054 None] Flow 'volume_create_manager' (98f07e2f-90ea-4cec-afcc-dd62429c27fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:35:30 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-13d5a436-e557-490b-82f7-00bf27a83dc8 tempest-VolumesTransfersV355Test-1871821054 None] Created volume successfully. Apr 29 15:35:30 devstack sudo[108935]: pam_unix(sudo:session): session closed for user root Apr 29 15:35:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.581s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:35:30 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:35:31 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-77f182c6-1b2b-4444-894e-a5023294c237 tempest-VolumesTransfersV355Test-238971377 None] Acquiring lock "cinder-5afe3e80-78c5-4839-8dd1-8160851b77cc-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:35:31 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-77f182c6-1b2b-4444-894e-a5023294c237 tempest-VolumesTransfersV355Test-238971377 None] Lock "cinder-5afe3e80-78c5-4839-8dd1-8160851b77cc-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:35:31 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-77f182c6-1b2b-4444-894e-a5023294c237 tempest-VolumesTransfersV355Test-238971377 None] Acquiring lock "cinder-quobyte-5afe3e80-78c5-4839-8dd1-8160851b77cc" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:35:31 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-77f182c6-1b2b-4444-894e-a5023294c237 tempest-VolumesTransfersV355Test-238971377 None] Lock "cinder-quobyte-5afe3e80-78c5-4839-8dd1-8160851b77cc" acquired by "delete_volume" :: waited 0.017s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:35:31 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b8b871-9f0a-41d1-904c-17577ea7bfa9]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:35:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-77f182c6-1b2b-4444-894e-a5023294c237 tempest-VolumesTransfersV355Test-238971377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5afe3e80-78c5-4839-8dd1-8160851b77cc {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:35:31 devstack sudo[108938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5afe3e80-78c5-4839-8dd1-8160851b77cc Apr 29 15:35:31 devstack sudo[108938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:35:32 devstack sudo[108938]: pam_unix(sudo:session): session closed for user root Apr 29 15:35:32 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-77f182c6-1b2b-4444-894e-a5023294c237 tempest-VolumesTransfersV355Test-238971377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5afe3e80-78c5-4839-8dd1-8160851b77cc" returned: 0 in 0.686s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:35:32 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-77f182c6-1b2b-4444-894e-a5023294c237 tempest-VolumesTransfersV355Test-238971377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5afe3e80-78c5-4839-8dd1-8160851b77cc {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:35:32 devstack sudo[108943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5afe3e80-78c5-4839-8dd1-8160851b77cc Apr 29 15:35:32 devstack sudo[108943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:35:32 devstack sudo[108943]: pam_unix(sudo:session): session closed for user root Apr 29 15:35:32 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-77f182c6-1b2b-4444-894e-a5023294c237 tempest-VolumesTransfersV355Test-238971377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5afe3e80-78c5-4839-8dd1-8160851b77cc" returned: 0 in 0.586s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:35:32 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-77f182c6-1b2b-4444-894e-a5023294c237 tempest-VolumesTransfersV355Test-238971377 None] Lock "cinder-quobyte-5afe3e80-78c5-4839-8dd1-8160851b77cc" released by "delete_volume" :: held 1.311s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:35:32 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-77f182c6-1b2b-4444-894e-a5023294c237 tempest-VolumesTransfersV355Test-238971377 None] Created reservations ['f2e4a7a0-aa75-43d2-b14c-dbc325cccf34', '9cfd32d6-609f-4b81-bdb6-a631b6b51949', 'b6bfbccb-731f-4686-9fb5-f01d235bddf3', '6664b1c9-4695-4e2a-b888-5b4bfe898636'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:35:32 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-77f182c6-1b2b-4444-894e-a5023294c237 tempest-VolumesTransfersV355Test-238971377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:35:32 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-77f182c6-1b2b-4444-894e-a5023294c237 tempest-VolumesTransfersV355Test-238971377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:35:32 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-77f182c6-1b2b-4444-894e-a5023294c237 tempest-VolumesTransfersV355Test-238971377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:35:32 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-77f182c6-1b2b-4444-894e-a5023294c237 tempest-VolumesTransfersV355Test-238971377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:35:32 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-77f182c6-1b2b-4444-894e-a5023294c237 tempest-VolumesTransfersV355Test-238971377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:35:32 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-77f182c6-1b2b-4444-894e-a5023294c237 tempest-VolumesTransfersV355Test-238971377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:35:32 devstack sudo[108952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:35:32 devstack sudo[108952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:35:33 devstack sudo[108952]: pam_unix(sudo:session): session closed for user root Apr 29 15:35:33 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-77f182c6-1b2b-4444-894e-a5023294c237 tempest-VolumesTransfersV355Test-238971377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.565s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:35:33 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-77f182c6-1b2b-4444-894e-a5023294c237 tempest-VolumesTransfersV355Test-238971377 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:35:33 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-77f182c6-1b2b-4444-894e-a5023294c237 tempest-VolumesTransfersV355Test-238971377 None] Deleted volume successfully. Apr 29 15:35:33 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-77f182c6-1b2b-4444-894e-a5023294c237 tempest-VolumesTransfersV355Test-238971377 None] Lock "cinder-5afe3e80-78c5-4839-8dd1-8160851b77cc-delete_volume" released by "delete_volume" :: held 2.075s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:35:38 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-72a9bcd5-fef9-41b2-851e-2d853cb5818f tempest-VolumesCloneNegativeTest-162637333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:35:38 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-72a9bcd5-fef9-41b2-851e-2d853cb5818f tempest-VolumesCloneNegativeTest-162637333 None] Flow 'volume_create_manager' (370909aa-2918-466b-b328-c0816370da85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:35:38 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-72a9bcd5-fef9-41b2-851e-2d853cb5818f tempest-VolumesCloneNegativeTest-162637333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03033e2e-9dc3-4afc-aacf-ad18402c0c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:35:38 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-72a9bcd5-fef9-41b2-851e-2d853cb5818f tempest-VolumesCloneNegativeTest-162637333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03033e2e-9dc3-4afc-aacf-ad18402c0c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:35:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-781948152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fbfdd26-3e5d-4612-8983-43b35e05023a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75f303d9fdbe4e729aa40de11f176805',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:35:38Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:35:38Z,use_quota=True,user_id='e15d63ff084b49d3949190e8525c352d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:35:38 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-72a9bcd5-fef9-41b2-851e-2d853cb5818f tempest-VolumesCloneNegativeTest-162637333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de4413d1-97f8-4366-a77e-72435e2000c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:35:38 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-72a9bcd5-fef9-41b2-851e-2d853cb5818f tempest-VolumesCloneNegativeTest-162637333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de4413d1-97f8-4366-a77e-72435e2000c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:35:38 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-72a9bcd5-fef9-41b2-851e-2d853cb5818f tempest-VolumesCloneNegativeTest-162637333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d03bd0c7-5c8b-40f2-96c4-083163b76384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:35:38 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-72a9bcd5-fef9-41b2-851e-2d853cb5818f tempest-VolumesCloneNegativeTest-162637333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d03bd0c7-5c8b-40f2-96c4-083163b76384) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fbfdd26-3e5d-4612-8983-43b35e05023a', 'volume_name': 'volume-7fbfdd26-3e5d-4612-8983-43b35e05023a', 'volume_size': 2}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:35:38 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-72a9bcd5-fef9-41b2-851e-2d853cb5818f tempest-VolumesCloneNegativeTest-162637333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e1f25ce-ee0a-4f7d-9845-6d949ef3a5f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:35:38 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-72a9bcd5-fef9-41b2-851e-2d853cb5818f tempest-VolumesCloneNegativeTest-162637333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e1f25ce-ee0a-4f7d-9845-6d949ef3a5f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:35:38 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-72a9bcd5-fef9-41b2-851e-2d853cb5818f tempest-VolumesCloneNegativeTest-162637333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba79a764-61ee-4981-b575-d398bccefee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:35:38 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-72a9bcd5-fef9-41b2-851e-2d853cb5818f tempest-VolumesCloneNegativeTest-162637333 None] Volume 7fbfdd26-3e5d-4612-8983-43b35e05023a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fbfdd26-3e5d-4612-8983-43b35e05023a', 'volume_size': 2} Apr 29 15:35:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-72a9bcd5-fef9-41b2-851e-2d853cb5818f tempest-VolumesCloneNegativeTest-162637333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:35:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-72a9bcd5-fef9-41b2-851e-2d853cb5818f tempest-VolumesCloneNegativeTest-162637333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:35:38 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-72a9bcd5-fef9-41b2-851e-2d853cb5818f tempest-VolumesCloneNegativeTest-162637333 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:35:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-781948152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fbfdd26-3e5d-4612-8983-43b35e05023a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75f303d9fdbe4e729aa40de11f176805',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:35:38Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:35:38Z,use_quota=True,user_id='e15d63ff084b49d3949190e8525c352d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:35:38 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-72a9bcd5-fef9-41b2-851e-2d853cb5818f tempest-VolumesCloneNegativeTest-162637333 None] Creating volume 7fbfdd26-3e5d-4612-8983-43b35e05023a {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:35:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-72a9bcd5-fef9-41b2-851e-2d853cb5818f tempest-VolumesCloneNegativeTest-162637333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:35:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-72a9bcd5-fef9-41b2-851e-2d853cb5818f tempest-VolumesCloneNegativeTest-162637333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:35:38 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-72a9bcd5-fef9-41b2-851e-2d853cb5818f tempest-VolumesCloneNegativeTest-162637333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:35:38 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-72a9bcd5-fef9-41b2-851e-2d853cb5818f tempest-VolumesCloneNegativeTest-162637333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:35:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-72a9bcd5-fef9-41b2-851e-2d853cb5818f tempest-VolumesCloneNegativeTest-162637333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:35:38 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-72a9bcd5-fef9-41b2-851e-2d853cb5818f tempest-VolumesCloneNegativeTest-162637333 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:35:38 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-72a9bcd5-fef9-41b2-851e-2d853cb5818f tempest-VolumesCloneNegativeTest-162637333 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:35:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-72a9bcd5-fef9-41b2-851e-2d853cb5818f tempest-VolumesCloneNegativeTest-162637333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7fbfdd26-3e5d-4612-8983-43b35e05023a 2147483648 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:35:38 devstack sudo[108992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7fbfdd26-3e5d-4612-8983-43b35e05023a 2147483648 Apr 29 15:35:38 devstack sudo[108992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:35:39 devstack sudo[108992]: pam_unix(sudo:session): session closed for user root Apr 29 15:35:39 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-72a9bcd5-fef9-41b2-851e-2d853cb5818f tempest-VolumesCloneNegativeTest-162637333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7fbfdd26-3e5d-4612-8983-43b35e05023a 2147483648" returned: 0 in 0.776s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:35:39 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-72a9bcd5-fef9-41b2-851e-2d853cb5818f tempest-VolumesCloneNegativeTest-162637333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7fbfdd26-3e5d-4612-8983-43b35e05023a {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:35:39 devstack sudo[108997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7fbfdd26-3e5d-4612-8983-43b35e05023a Apr 29 15:35:39 devstack sudo[108997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:35:39 devstack sudo[108997]: pam_unix(sudo:session): session closed for user root Apr 29 15:35:39 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-72a9bcd5-fef9-41b2-851e-2d853cb5818f tempest-VolumesCloneNegativeTest-162637333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7fbfdd26-3e5d-4612-8983-43b35e05023a" returned: 0 in 0.562s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:35:39 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-72a9bcd5-fef9-41b2-851e-2d853cb5818f tempest-VolumesCloneNegativeTest-162637333 None] <== create_volume: return (1380ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:35:39 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-72a9bcd5-fef9-41b2-851e-2d853cb5818f tempest-VolumesCloneNegativeTest-162637333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.382s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:35:39 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-72a9bcd5-fef9-41b2-851e-2d853cb5818f tempest-VolumesCloneNegativeTest-162637333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba79a764-61ee-4981-b575-d398bccefee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fbfdd26-3e5d-4612-8983-43b35e05023a', 'volume_size': 2}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:35:39 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-72a9bcd5-fef9-41b2-851e-2d853cb5818f tempest-VolumesCloneNegativeTest-162637333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36432fbd-6e48-4399-b095-d1e575e239b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:35:39 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-72a9bcd5-fef9-41b2-851e-2d853cb5818f tempest-VolumesCloneNegativeTest-162637333 None] Volume volume-7fbfdd26-3e5d-4612-8983-43b35e05023a (7fbfdd26-3e5d-4612-8983-43b35e05023a): created successfully Apr 29 15:35:39 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-72a9bcd5-fef9-41b2-851e-2d853cb5818f tempest-VolumesCloneNegativeTest-162637333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36432fbd-6e48-4399-b095-d1e575e239b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:35:39 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-72a9bcd5-fef9-41b2-851e-2d853cb5818f tempest-VolumesCloneNegativeTest-162637333 None] Flow 'volume_create_manager' (370909aa-2918-466b-b328-c0816370da85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:35:39 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-72a9bcd5-fef9-41b2-851e-2d853cb5818f tempest-VolumesCloneNegativeTest-162637333 None] Created volume successfully. Apr 29 15:35:40 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-e807b15f-ff33-4981-bae0-416c202abf4e tempest-VolumesCloneNegativeTest-162637333 None] Acquiring lock "cinder-7fbfdd26-3e5d-4612-8983-43b35e05023a-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:35:40 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-e807b15f-ff33-4981-bae0-416c202abf4e tempest-VolumesCloneNegativeTest-162637333 None] Lock "cinder-7fbfdd26-3e5d-4612-8983-43b35e05023a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:35:40 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-e807b15f-ff33-4981-bae0-416c202abf4e tempest-VolumesCloneNegativeTest-162637333 None] Acquiring lock "cinder-quobyte-7fbfdd26-3e5d-4612-8983-43b35e05023a" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:35:40 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-e807b15f-ff33-4981-bae0-416c202abf4e tempest-VolumesCloneNegativeTest-162637333 None] Lock "cinder-quobyte-7fbfdd26-3e5d-4612-8983-43b35e05023a" acquired by "delete_volume" :: waited 0.014s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:35:40 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[d17ab187-68e6-484f-8579-371b413d238c]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:35:40 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-e807b15f-ff33-4981-bae0-416c202abf4e tempest-VolumesCloneNegativeTest-162637333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7fbfdd26-3e5d-4612-8983-43b35e05023a {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:35:40 devstack sudo[109001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7fbfdd26-3e5d-4612-8983-43b35e05023a Apr 29 15:35:40 devstack sudo[109001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:35:41 devstack sudo[109001]: pam_unix(sudo:session): session closed for user root Apr 29 15:35:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-e807b15f-ff33-4981-bae0-416c202abf4e tempest-VolumesCloneNegativeTest-162637333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7fbfdd26-3e5d-4612-8983-43b35e05023a" returned: 0 in 0.696s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:35:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-e807b15f-ff33-4981-bae0-416c202abf4e tempest-VolumesCloneNegativeTest-162637333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7fbfdd26-3e5d-4612-8983-43b35e05023a {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:35:41 devstack sudo[109006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7fbfdd26-3e5d-4612-8983-43b35e05023a Apr 29 15:35:41 devstack sudo[109006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:35:41 devstack sudo[109006]: pam_unix(sudo:session): session closed for user root Apr 29 15:35:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-e807b15f-ff33-4981-bae0-416c202abf4e tempest-VolumesCloneNegativeTest-162637333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7fbfdd26-3e5d-4612-8983-43b35e05023a" returned: 0 in 0.573s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:35:41 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-e807b15f-ff33-4981-bae0-416c202abf4e tempest-VolumesCloneNegativeTest-162637333 None] Lock "cinder-quobyte-7fbfdd26-3e5d-4612-8983-43b35e05023a" released by "delete_volume" :: held 1.309s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:35:41 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-e807b15f-ff33-4981-bae0-416c202abf4e tempest-VolumesCloneNegativeTest-162637333 None] Created reservations ['344a0a88-159f-4046-b446-9d7d0862f9f3', 'e8c34455-df85-4a60-a8a5-0aaeb33a2d7e', '957b419f-2980-45d3-a840-4341717c76a8', 'c4795afd-ca5f-468e-a675-6bfa79ea8827'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:35:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-e807b15f-ff33-4981-bae0-416c202abf4e tempest-VolumesCloneNegativeTest-162637333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:35:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-e807b15f-ff33-4981-bae0-416c202abf4e tempest-VolumesCloneNegativeTest-162637333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:35:41 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-e807b15f-ff33-4981-bae0-416c202abf4e tempest-VolumesCloneNegativeTest-162637333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:35:41 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-e807b15f-ff33-4981-bae0-416c202abf4e tempest-VolumesCloneNegativeTest-162637333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:35:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-e807b15f-ff33-4981-bae0-416c202abf4e tempest-VolumesCloneNegativeTest-162637333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:35:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-e807b15f-ff33-4981-bae0-416c202abf4e tempest-VolumesCloneNegativeTest-162637333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:35:42 devstack sudo[109009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:35:42 devstack sudo[109009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:35:42 devstack sudo[109009]: pam_unix(sudo:session): session closed for user root Apr 29 15:35:42 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-e807b15f-ff33-4981-bae0-416c202abf4e tempest-VolumesCloneNegativeTest-162637333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.580s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:35:42 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-e807b15f-ff33-4981-bae0-416c202abf4e tempest-VolumesCloneNegativeTest-162637333 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:35:42 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-e807b15f-ff33-4981-bae0-416c202abf4e tempest-VolumesCloneNegativeTest-162637333 None] Deleted volume successfully. Apr 29 15:35:42 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-e807b15f-ff33-4981-bae0-416c202abf4e tempest-VolumesCloneNegativeTest-162637333 None] Lock "cinder-7fbfdd26-3e5d-4612-8983-43b35e05023a-delete_volume" released by "delete_volume" :: held 2.064s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:35:45 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-995e786e-9d88-44fa-bd78-849599de9c24 tempest-VolumesNegativeTest-1771173530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:35:45 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-995e786e-9d88-44fa-bd78-849599de9c24 tempest-VolumesNegativeTest-1771173530 None] Flow 'volume_create_manager' (0b469d89-bc27-42d2-9de4-daf6aea09815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:35:45 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-995e786e-9d88-44fa-bd78-849599de9c24 tempest-VolumesNegativeTest-1771173530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ce4c9ae-9231-497d-b864-539a315ca050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:35:45 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-995e786e-9d88-44fa-bd78-849599de9c24 tempest-VolumesNegativeTest-1771173530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ce4c9ae-9231-497d-b864-539a315ca050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:35:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1948386242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b8ef4de-7a73-4314-a9a1-4f0dd6d2841f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='009565eb9dde401f96294648b3a92aeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:35:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:35:45Z,use_quota=True,user_id='2b9566cbeaa74423996656284817b52e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:35:45 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-995e786e-9d88-44fa-bd78-849599de9c24 tempest-VolumesNegativeTest-1771173530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e584ff20-0818-41d2-91d6-1055c2d83fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:35:45 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-995e786e-9d88-44fa-bd78-849599de9c24 tempest-VolumesNegativeTest-1771173530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e584ff20-0818-41d2-91d6-1055c2d83fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:35:45 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-995e786e-9d88-44fa-bd78-849599de9c24 tempest-VolumesNegativeTest-1771173530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a6c701e-e3bd-4375-b8c5-97d6ef6138b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:35:45 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-995e786e-9d88-44fa-bd78-849599de9c24 tempest-VolumesNegativeTest-1771173530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a6c701e-e3bd-4375-b8c5-97d6ef6138b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b8ef4de-7a73-4314-a9a1-4f0dd6d2841f', 'volume_name': 'volume-1b8ef4de-7a73-4314-a9a1-4f0dd6d2841f', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:35:45 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-995e786e-9d88-44fa-bd78-849599de9c24 tempest-VolumesNegativeTest-1771173530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (156fed66-30cb-4ab9-b5e4-32362a999595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:35:45 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-995e786e-9d88-44fa-bd78-849599de9c24 tempest-VolumesNegativeTest-1771173530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (156fed66-30cb-4ab9-b5e4-32362a999595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:35:45 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-995e786e-9d88-44fa-bd78-849599de9c24 tempest-VolumesNegativeTest-1771173530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40529a40-d917-4ca7-aafe-1e90467e287e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:35:45 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-995e786e-9d88-44fa-bd78-849599de9c24 tempest-VolumesNegativeTest-1771173530 None] Volume 1b8ef4de-7a73-4314-a9a1-4f0dd6d2841f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b8ef4de-7a73-4314-a9a1-4f0dd6d2841f', 'volume_size': 1} Apr 29 15:35:45 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-995e786e-9d88-44fa-bd78-849599de9c24 tempest-VolumesNegativeTest-1771173530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:35:45 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-995e786e-9d88-44fa-bd78-849599de9c24 tempest-VolumesNegativeTest-1771173530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:35:45 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-995e786e-9d88-44fa-bd78-849599de9c24 tempest-VolumesNegativeTest-1771173530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:35:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1948386242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b8ef4de-7a73-4314-a9a1-4f0dd6d2841f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='009565eb9dde401f96294648b3a92aeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:35:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:35:45Z,use_quota=True,user_id='2b9566cbeaa74423996656284817b52e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:35:45 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-995e786e-9d88-44fa-bd78-849599de9c24 tempest-VolumesNegativeTest-1771173530 None] Creating volume 1b8ef4de-7a73-4314-a9a1-4f0dd6d2841f {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:35:45 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-995e786e-9d88-44fa-bd78-849599de9c24 tempest-VolumesNegativeTest-1771173530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:35:45 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-995e786e-9d88-44fa-bd78-849599de9c24 tempest-VolumesNegativeTest-1771173530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:35:45 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-995e786e-9d88-44fa-bd78-849599de9c24 tempest-VolumesNegativeTest-1771173530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:35:45 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-995e786e-9d88-44fa-bd78-849599de9c24 tempest-VolumesNegativeTest-1771173530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:35:45 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-995e786e-9d88-44fa-bd78-849599de9c24 tempest-VolumesNegativeTest-1771173530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:35:45 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-995e786e-9d88-44fa-bd78-849599de9c24 tempest-VolumesNegativeTest-1771173530 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:35:45 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-995e786e-9d88-44fa-bd78-849599de9c24 tempest-VolumesNegativeTest-1771173530 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:35:45 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-995e786e-9d88-44fa-bd78-849599de9c24 tempest-VolumesNegativeTest-1771173530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1b8ef4de-7a73-4314-a9a1-4f0dd6d2841f 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:35:45 devstack sudo[109015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1b8ef4de-7a73-4314-a9a1-4f0dd6d2841f 1073741824 Apr 29 15:35:45 devstack sudo[109015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:35:45 devstack sudo[109015]: pam_unix(sudo:session): session closed for user root Apr 29 15:35:45 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-995e786e-9d88-44fa-bd78-849599de9c24 tempest-VolumesNegativeTest-1771173530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1b8ef4de-7a73-4314-a9a1-4f0dd6d2841f 1073741824" returned: 0 in 0.746s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:35:45 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-995e786e-9d88-44fa-bd78-849599de9c24 tempest-VolumesNegativeTest-1771173530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1b8ef4de-7a73-4314-a9a1-4f0dd6d2841f {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:35:45 devstack sudo[109020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1b8ef4de-7a73-4314-a9a1-4f0dd6d2841f Apr 29 15:35:45 devstack sudo[109020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:35:46 devstack sudo[109020]: pam_unix(sudo:session): session closed for user root Apr 29 15:35:46 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-995e786e-9d88-44fa-bd78-849599de9c24 tempest-VolumesNegativeTest-1771173530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1b8ef4de-7a73-4314-a9a1-4f0dd6d2841f" returned: 0 in 0.577s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:35:46 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-995e786e-9d88-44fa-bd78-849599de9c24 tempest-VolumesNegativeTest-1771173530 None] <== create_volume: return (1360ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:35:46 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-995e786e-9d88-44fa-bd78-849599de9c24 tempest-VolumesNegativeTest-1771173530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.362s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:35:46 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-995e786e-9d88-44fa-bd78-849599de9c24 tempest-VolumesNegativeTest-1771173530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40529a40-d917-4ca7-aafe-1e90467e287e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b8ef4de-7a73-4314-a9a1-4f0dd6d2841f', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:35:46 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-995e786e-9d88-44fa-bd78-849599de9c24 tempest-VolumesNegativeTest-1771173530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85fc5dda-2272-4e65-9f3d-4ea55516291f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:35:46 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-995e786e-9d88-44fa-bd78-849599de9c24 tempest-VolumesNegativeTest-1771173530 None] Volume volume-1b8ef4de-7a73-4314-a9a1-4f0dd6d2841f (1b8ef4de-7a73-4314-a9a1-4f0dd6d2841f): created successfully Apr 29 15:35:46 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-995e786e-9d88-44fa-bd78-849599de9c24 tempest-VolumesNegativeTest-1771173530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85fc5dda-2272-4e65-9f3d-4ea55516291f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:35:46 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-995e786e-9d88-44fa-bd78-849599de9c24 tempest-VolumesNegativeTest-1771173530 None] Flow 'volume_create_manager' (0b469d89-bc27-42d2-9de4-daf6aea09815) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:35:46 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-995e786e-9d88-44fa-bd78-849599de9c24 tempest-VolumesNegativeTest-1771173530 None] Created volume successfully. Apr 29 15:35:56 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:DELETE=3,cinder:SELECT=32,cinder:INSERT=10,cinder:UPDATE=48 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:35:56 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:UPDATE=55,cinder:SELECT=33,cinder:INSERT=15,cinder:DELETE=8 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:36:14 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-1a34e8e3-28b8-4f77-8f53-b9368a914507 tempest-VolumesNegativeTest-1771173530 None] Acquiring lock "cinder-1b8ef4de-7a73-4314-a9a1-4f0dd6d2841f-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:36:14 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-1a34e8e3-28b8-4f77-8f53-b9368a914507 tempest-VolumesNegativeTest-1771173530 None] Lock "cinder-1b8ef4de-7a73-4314-a9a1-4f0dd6d2841f-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:36:14 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-1a34e8e3-28b8-4f77-8f53-b9368a914507 tempest-VolumesNegativeTest-1771173530 None] Acquiring lock "cinder-quobyte-1b8ef4de-7a73-4314-a9a1-4f0dd6d2841f" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:36:14 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-1a34e8e3-28b8-4f77-8f53-b9368a914507 tempest-VolumesNegativeTest-1771173530 None] Lock "cinder-quobyte-1b8ef4de-7a73-4314-a9a1-4f0dd6d2841f" acquired by "delete_volume" :: waited 0.013s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:36:14 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[5184ea4c-065b-47b9-bd4e-b705d4a58f81]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:36:14 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1a34e8e3-28b8-4f77-8f53-b9368a914507 tempest-VolumesNegativeTest-1771173530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1b8ef4de-7a73-4314-a9a1-4f0dd6d2841f {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:36:14 devstack sudo[109157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1b8ef4de-7a73-4314-a9a1-4f0dd6d2841f Apr 29 15:36:14 devstack sudo[109157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:36:14 devstack sudo[109157]: pam_unix(sudo:session): session closed for user root Apr 29 15:36:14 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1a34e8e3-28b8-4f77-8f53-b9368a914507 tempest-VolumesNegativeTest-1771173530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1b8ef4de-7a73-4314-a9a1-4f0dd6d2841f" returned: 0 in 0.694s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:36:14 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1a34e8e3-28b8-4f77-8f53-b9368a914507 tempest-VolumesNegativeTest-1771173530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1b8ef4de-7a73-4314-a9a1-4f0dd6d2841f {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:36:14 devstack sudo[109162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1b8ef4de-7a73-4314-a9a1-4f0dd6d2841f Apr 29 15:36:14 devstack sudo[109162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:36:15 devstack sudo[109162]: pam_unix(sudo:session): session closed for user root Apr 29 15:36:15 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1a34e8e3-28b8-4f77-8f53-b9368a914507 tempest-VolumesNegativeTest-1771173530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-1b8ef4de-7a73-4314-a9a1-4f0dd6d2841f" returned: 0 in 0.573s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:36:15 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-1a34e8e3-28b8-4f77-8f53-b9368a914507 tempest-VolumesNegativeTest-1771173530 None] Lock "cinder-quobyte-1b8ef4de-7a73-4314-a9a1-4f0dd6d2841f" released by "delete_volume" :: held 1.311s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:36:15 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-1a34e8e3-28b8-4f77-8f53-b9368a914507 tempest-VolumesNegativeTest-1771173530 None] Created reservations ['8fc95ded-43f2-4fb5-a233-395941e0ec68', '02100eab-5eff-46e9-9222-d9f80b809cff', '06f70da3-475a-43fe-b4a4-3a5764316cb6', '4cbfdc36-999e-4762-8495-7b45d3d2d632'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:36:15 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-1a34e8e3-28b8-4f77-8f53-b9368a914507 tempest-VolumesNegativeTest-1771173530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:36:15 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-1a34e8e3-28b8-4f77-8f53-b9368a914507 tempest-VolumesNegativeTest-1771173530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:36:15 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-1a34e8e3-28b8-4f77-8f53-b9368a914507 tempest-VolumesNegativeTest-1771173530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:36:15 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-1a34e8e3-28b8-4f77-8f53-b9368a914507 tempest-VolumesNegativeTest-1771173530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:36:15 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-1a34e8e3-28b8-4f77-8f53-b9368a914507 tempest-VolumesNegativeTest-1771173530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:36:15 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1a34e8e3-28b8-4f77-8f53-b9368a914507 tempest-VolumesNegativeTest-1771173530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:36:15 devstack sudo[109165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:36:15 devstack sudo[109165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:36:16 devstack sudo[109165]: pam_unix(sudo:session): session closed for user root Apr 29 15:36:16 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1a34e8e3-28b8-4f77-8f53-b9368a914507 tempest-VolumesNegativeTest-1771173530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.567s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:36:16 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-1a34e8e3-28b8-4f77-8f53-b9368a914507 tempest-VolumesNegativeTest-1771173530 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:36:16 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-1a34e8e3-28b8-4f77-8f53-b9368a914507 tempest-VolumesNegativeTest-1771173530 None] Deleted volume successfully. Apr 29 15:36:16 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-1a34e8e3-28b8-4f77-8f53-b9368a914507 tempest-VolumesNegativeTest-1771173530 None] Lock "cinder-1b8ef4de-7a73-4314-a9a1-4f0dd6d2841f-delete_volume" released by "delete_volume" :: held 2.054s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:36:25 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:SELECT=3,cinder:INSERT=2,cinder:UPDATE=8 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:36:26 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:SELECT=7,cinder:UPDATE=8,cinder:INSERT=2,cinder:DELETE=1 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:36:30 devstack cinder-volume[84448]: DEBUG oslo_service.periodic_task [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84448) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 15:36:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:36:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:36:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:36:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:36:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:36:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:36:30 devstack sudo[109170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:36:30 devstack sudo[109170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:36:31 devstack sudo[109170]: pam_unix(sudo:session): session closed for user root Apr 29 15:36:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.627s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:36:31 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:36:54 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-5560461c-30a3-4a6c-ae51-078c81c04ff6 tempest-TestMinimumBasicScenario-311749420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:36:54 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-5560461c-30a3-4a6c-ae51-078c81c04ff6 tempest-TestMinimumBasicScenario-311749420 None] Flow 'volume_create_manager' (3b311bcf-81f4-407f-9946-74427068b08d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:36:54 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-5560461c-30a3-4a6c-ae51-078c81c04ff6 tempest-TestMinimumBasicScenario-311749420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84b9df99-26fd-433e-8df8-c43ad1a3d74f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:36:54 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-5560461c-30a3-4a6c-ae51-078c81c04ff6 tempest-TestMinimumBasicScenario-311749420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84b9df99-26fd-433e-8df8-c43ad1a3d74f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:36:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1187924985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04b6cf25-cdf8-40eb-bc5f-9203e74b6f75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b4b8d6b1519434b8e8899f7867fc943',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:36:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:36:54Z,use_quota=True,user_id='553344b0ab0e4590bc117fd6c653cead',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:36:54 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-5560461c-30a3-4a6c-ae51-078c81c04ff6 tempest-TestMinimumBasicScenario-311749420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0940684-52ea-42e2-8c92-ee607f2ae81a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:36:54 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-5560461c-30a3-4a6c-ae51-078c81c04ff6 tempest-TestMinimumBasicScenario-311749420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0940684-52ea-42e2-8c92-ee607f2ae81a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:36:54 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-5560461c-30a3-4a6c-ae51-078c81c04ff6 tempest-TestMinimumBasicScenario-311749420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f9182d8-1621-440f-85bf-3e9259f4a896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:36:54 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-5560461c-30a3-4a6c-ae51-078c81c04ff6 tempest-TestMinimumBasicScenario-311749420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f9182d8-1621-440f-85bf-3e9259f4a896) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04b6cf25-cdf8-40eb-bc5f-9203e74b6f75', 'volume_name': 'volume-04b6cf25-cdf8-40eb-bc5f-9203e74b6f75', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:36:54 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-5560461c-30a3-4a6c-ae51-078c81c04ff6 tempest-TestMinimumBasicScenario-311749420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25f3bf61-5dac-4306-a670-974a0c4d0fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:36:54 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-5560461c-30a3-4a6c-ae51-078c81c04ff6 tempest-TestMinimumBasicScenario-311749420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25f3bf61-5dac-4306-a670-974a0c4d0fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:36:54 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-5560461c-30a3-4a6c-ae51-078c81c04ff6 tempest-TestMinimumBasicScenario-311749420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71640e3a-741f-4582-94c5-bb0f8b679600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:36:54 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-5560461c-30a3-4a6c-ae51-078c81c04ff6 tempest-TestMinimumBasicScenario-311749420 None] Volume 04b6cf25-cdf8-40eb-bc5f-9203e74b6f75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04b6cf25-cdf8-40eb-bc5f-9203e74b6f75', 'volume_size': 1} Apr 29 15:36:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-5560461c-30a3-4a6c-ae51-078c81c04ff6 tempest-TestMinimumBasicScenario-311749420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:36:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-5560461c-30a3-4a6c-ae51-078c81c04ff6 tempest-TestMinimumBasicScenario-311749420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:36:54 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-5560461c-30a3-4a6c-ae51-078c81c04ff6 tempest-TestMinimumBasicScenario-311749420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:36:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1187924985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04b6cf25-cdf8-40eb-bc5f-9203e74b6f75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b4b8d6b1519434b8e8899f7867fc943',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:36:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:36:54Z,use_quota=True,user_id='553344b0ab0e4590bc117fd6c653cead',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:36:54 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-5560461c-30a3-4a6c-ae51-078c81c04ff6 tempest-TestMinimumBasicScenario-311749420 None] Creating volume 04b6cf25-cdf8-40eb-bc5f-9203e74b6f75 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:36:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-5560461c-30a3-4a6c-ae51-078c81c04ff6 tempest-TestMinimumBasicScenario-311749420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:36:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-5560461c-30a3-4a6c-ae51-078c81c04ff6 tempest-TestMinimumBasicScenario-311749420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:36:54 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-5560461c-30a3-4a6c-ae51-078c81c04ff6 tempest-TestMinimumBasicScenario-311749420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:36:54 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-5560461c-30a3-4a6c-ae51-078c81c04ff6 tempest-TestMinimumBasicScenario-311749420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:36:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-5560461c-30a3-4a6c-ae51-078c81c04ff6 tempest-TestMinimumBasicScenario-311749420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:36:54 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-5560461c-30a3-4a6c-ae51-078c81c04ff6 tempest-TestMinimumBasicScenario-311749420 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:36:54 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-5560461c-30a3-4a6c-ae51-078c81c04ff6 tempest-TestMinimumBasicScenario-311749420 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:36:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-5560461c-30a3-4a6c-ae51-078c81c04ff6 tempest-TestMinimumBasicScenario-311749420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-04b6cf25-cdf8-40eb-bc5f-9203e74b6f75 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:36:54 devstack sudo[109322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-04b6cf25-cdf8-40eb-bc5f-9203e74b6f75 1073741824 Apr 29 15:36:54 devstack sudo[109322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:36:55 devstack sudo[109322]: pam_unix(sudo:session): session closed for user root Apr 29 15:36:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-5560461c-30a3-4a6c-ae51-078c81c04ff6 tempest-TestMinimumBasicScenario-311749420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-04b6cf25-cdf8-40eb-bc5f-9203e74b6f75 1073741824" returned: 0 in 0.866s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:36:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-5560461c-30a3-4a6c-ae51-078c81c04ff6 tempest-TestMinimumBasicScenario-311749420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-04b6cf25-cdf8-40eb-bc5f-9203e74b6f75 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:36:55 devstack sudo[109331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-04b6cf25-cdf8-40eb-bc5f-9203e74b6f75 Apr 29 15:36:55 devstack sudo[109331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:36:56 devstack sudo[109331]: pam_unix(sudo:session): session closed for user root Apr 29 15:36:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-5560461c-30a3-4a6c-ae51-078c81c04ff6 tempest-TestMinimumBasicScenario-311749420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-04b6cf25-cdf8-40eb-bc5f-9203e74b6f75" returned: 0 in 0.630s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:36:56 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-5560461c-30a3-4a6c-ae51-078c81c04ff6 tempest-TestMinimumBasicScenario-311749420 None] <== create_volume: return (1561ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:36:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-5560461c-30a3-4a6c-ae51-078c81c04ff6 tempest-TestMinimumBasicScenario-311749420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.563s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:36:56 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-5560461c-30a3-4a6c-ae51-078c81c04ff6 tempest-TestMinimumBasicScenario-311749420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71640e3a-741f-4582-94c5-bb0f8b679600) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04b6cf25-cdf8-40eb-bc5f-9203e74b6f75', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:36:56 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-5560461c-30a3-4a6c-ae51-078c81c04ff6 tempest-TestMinimumBasicScenario-311749420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00f2362a-0bab-431e-bdbe-6ef4f9a42771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:36:56 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-5560461c-30a3-4a6c-ae51-078c81c04ff6 tempest-TestMinimumBasicScenario-311749420 None] Volume volume-04b6cf25-cdf8-40eb-bc5f-9203e74b6f75 (04b6cf25-cdf8-40eb-bc5f-9203e74b6f75): created successfully Apr 29 15:36:56 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-5560461c-30a3-4a6c-ae51-078c81c04ff6 tempest-TestMinimumBasicScenario-311749420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00f2362a-0bab-431e-bdbe-6ef4f9a42771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:36:56 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-5560461c-30a3-4a6c-ae51-078c81c04ff6 tempest-TestMinimumBasicScenario-311749420 None] Flow 'volume_create_manager' (3b311bcf-81f4-407f-9946-74427068b08d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:36:56 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-5560461c-30a3-4a6c-ae51-078c81c04ff6 tempest-TestMinimumBasicScenario-311749420 None] Created volume successfully. Apr 29 15:36:59 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-1704235d-0eab-470f-8e55-02cdf6877ad7 req-365d4766-d036-4d83-9377-3b0396444398 tempest-TestMinimumBasicScenario-311749420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:36:59 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-1704235d-0eab-470f-8e55-02cdf6877ad7 req-365d4766-d036-4d83-9377-3b0396444398 tempest-TestMinimumBasicScenario-311749420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:36:59 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[a89685a3-6f3f-42a5-b7bb-8419ee237333]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:36:59 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-1704235d-0eab-470f-8e55-02cdf6877ad7 req-365d4766-d036-4d83-9377-3b0396444398 tempest-TestMinimumBasicScenario-311749420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-04b6cf25-cdf8-40eb-bc5f-9203e74b6f75 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:36:59 devstack sudo[109346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-04b6cf25-cdf8-40eb-bc5f-9203e74b6f75 Apr 29 15:36:59 devstack sudo[109346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:37:00 devstack sudo[109346]: pam_unix(sudo:session): session closed for user root Apr 29 15:37:00 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-1704235d-0eab-470f-8e55-02cdf6877ad7 req-365d4766-d036-4d83-9377-3b0396444398 tempest-TestMinimumBasicScenario-311749420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-04b6cf25-cdf8-40eb-bc5f-9203e74b6f75" returned: 0 in 0.778s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:37:00 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-1704235d-0eab-470f-8e55-02cdf6877ad7 req-365d4766-d036-4d83-9377-3b0396444398 tempest-TestMinimumBasicScenario-311749420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.798s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:37:00 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-1704235d-0eab-470f-8e55-02cdf6877ad7 req-365d4766-d036-4d83-9377-3b0396444398 tempest-TestMinimumBasicScenario-311749420 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a', 'name': 'volume-04b6cf25-cdf8-40eb-bc5f-9203e74b6f75', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a6109687-92cc-4ed2-8157-89d4c15a9e88', 'enforce_multipath': True} {{(pid=84448) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 15:37:00 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-1704235d-0eab-470f-8e55-02cdf6877ad7 req-365d4766-d036-4d83-9377-3b0396444398 tempest-TestMinimumBasicScenario-311749420 None] attachment_update completed successfully. Apr 29 15:37:10 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:SELECT=7,cinder:INSERT=1,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:37:10 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:UPDATE=7,cinder:SELECT=8 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:37:30 devstack cinder-volume[84448]: DEBUG oslo_service.periodic_task [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84448) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 15:37:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:37:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:37:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:37:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:37:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:37:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:37:30 devstack sudo[109890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:37:30 devstack sudo[109890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:37:30 devstack sudo[109890]: pam_unix(sudo:session): session closed for user root Apr 29 15:37:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.576s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:37:30 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:37:32 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:SELECT=1 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:37:32 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:UPDATE=1 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:37:49 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-c5c72fc5-0834-4881-9731-7411ef5f6895 req-a7188f84-21b1-4b2e-9b70-1b7c1ba58c3a tempest-TestMinimumBasicScenario-311749420 None] Terminate volume connection completed successfully. Apr 29 15:37:49 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-c5c72fc5-0834-4881-9731-7411ef5f6895 req-a7188f84-21b1-4b2e-9b70-1b7c1ba58c3a tempest-TestMinimumBasicScenario-311749420 None] Deleting attachment a6109687-92cc-4ed2-8157-89d4c15a9e88. {{(pid=84448) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 15:37:51 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-bbd29841-79ca-4228-a38b-0f438dc31a42 tempest-TestMinimumBasicScenario-311749420 None] Acquiring lock "cinder-04b6cf25-cdf8-40eb-bc5f-9203e74b6f75-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:37:51 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-bbd29841-79ca-4228-a38b-0f438dc31a42 tempest-TestMinimumBasicScenario-311749420 None] Lock "cinder-04b6cf25-cdf8-40eb-bc5f-9203e74b6f75-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:37:51 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-bbd29841-79ca-4228-a38b-0f438dc31a42 tempest-TestMinimumBasicScenario-311749420 None] Acquiring lock "cinder-quobyte-04b6cf25-cdf8-40eb-bc5f-9203e74b6f75" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:37:51 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-bbd29841-79ca-4228-a38b-0f438dc31a42 tempest-TestMinimumBasicScenario-311749420 None] Lock "cinder-quobyte-04b6cf25-cdf8-40eb-bc5f-9203e74b6f75" acquired by "delete_volume" :: waited 0.015s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:37:51 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[4efbdae9-ec4e-4f73-af00-5143fce82eac]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:37:51 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-bbd29841-79ca-4228-a38b-0f438dc31a42 tempest-TestMinimumBasicScenario-311749420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-04b6cf25-cdf8-40eb-bc5f-9203e74b6f75 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:37:51 devstack sudo[109956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-04b6cf25-cdf8-40eb-bc5f-9203e74b6f75 Apr 29 15:37:51 devstack sudo[109956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:37:52 devstack sudo[109956]: pam_unix(sudo:session): session closed for user root Apr 29 15:37:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-bbd29841-79ca-4228-a38b-0f438dc31a42 tempest-TestMinimumBasicScenario-311749420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-04b6cf25-cdf8-40eb-bc5f-9203e74b6f75" returned: 0 in 0.710s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:37:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-bbd29841-79ca-4228-a38b-0f438dc31a42 tempest-TestMinimumBasicScenario-311749420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-04b6cf25-cdf8-40eb-bc5f-9203e74b6f75 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:37:52 devstack sudo[109961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-04b6cf25-cdf8-40eb-bc5f-9203e74b6f75 Apr 29 15:37:52 devstack sudo[109961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:37:52 devstack sudo[109961]: pam_unix(sudo:session): session closed for user root Apr 29 15:37:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-bbd29841-79ca-4228-a38b-0f438dc31a42 tempest-TestMinimumBasicScenario-311749420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-04b6cf25-cdf8-40eb-bc5f-9203e74b6f75" returned: 0 in 0.580s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:37:52 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-bbd29841-79ca-4228-a38b-0f438dc31a42 tempest-TestMinimumBasicScenario-311749420 None] Lock "cinder-quobyte-04b6cf25-cdf8-40eb-bc5f-9203e74b6f75" released by "delete_volume" :: held 1.327s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:37:53 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-bbd29841-79ca-4228-a38b-0f438dc31a42 tempest-TestMinimumBasicScenario-311749420 None] Created reservations ['734dcc12-c67f-4f1c-a15c-c014ac3ee18e', '74257ce5-8b85-4e53-bdb5-1ca3cc87c263', 'f9219c5e-8957-412c-b185-b1c30ccd1249', 'e1c3d17a-89f1-401c-9377-c421ad7cc456'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:37:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-bbd29841-79ca-4228-a38b-0f438dc31a42 tempest-TestMinimumBasicScenario-311749420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:37:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-bbd29841-79ca-4228-a38b-0f438dc31a42 tempest-TestMinimumBasicScenario-311749420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:37:53 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-bbd29841-79ca-4228-a38b-0f438dc31a42 tempest-TestMinimumBasicScenario-311749420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:37:53 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-bbd29841-79ca-4228-a38b-0f438dc31a42 tempest-TestMinimumBasicScenario-311749420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:37:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-bbd29841-79ca-4228-a38b-0f438dc31a42 tempest-TestMinimumBasicScenario-311749420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:37:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-bbd29841-79ca-4228-a38b-0f438dc31a42 tempest-TestMinimumBasicScenario-311749420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:37:53 devstack sudo[109964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:37:53 devstack sudo[109964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:37:53 devstack sudo[109964]: pam_unix(sudo:session): session closed for user root Apr 29 15:37:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-bbd29841-79ca-4228-a38b-0f438dc31a42 tempest-TestMinimumBasicScenario-311749420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.574s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:37:53 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-bbd29841-79ca-4228-a38b-0f438dc31a42 tempest-TestMinimumBasicScenario-311749420 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:37:53 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-bbd29841-79ca-4228-a38b-0f438dc31a42 tempest-TestMinimumBasicScenario-311749420 None] Deleted volume successfully. Apr 29 15:37:53 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-bbd29841-79ca-4228-a38b-0f438dc31a42 tempest-TestMinimumBasicScenario-311749420 None] Lock "cinder-04b6cf25-cdf8-40eb-bc5f-9203e74b6f75-delete_volume" released by "delete_volume" :: held 2.086s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:38:03 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=8 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:38:03 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:SELECT=6,cinder:UPDATE=8,cinder:INSERT=2,cinder:DELETE=1 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:38:30 devstack cinder-volume[84448]: DEBUG oslo_service.periodic_task [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84448) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 15:38:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:38:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:38:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:38:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:38:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:38:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:38:30 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-f322a0ec-16be-4d2c-a3ab-ebd62b72932c tempest-TestShelveInstance-1465458414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:38:30 devstack sudo[110022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:38:30 devstack sudo[110022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:38:30 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-f322a0ec-16be-4d2c-a3ab-ebd62b72932c tempest-TestShelveInstance-1465458414 None] Flow 'volume_create_manager' (758e8a35-9817-4b15-b173-a7100e66f671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:38:30 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-f322a0ec-16be-4d2c-a3ab-ebd62b72932c tempest-TestShelveInstance-1465458414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a75f540c-ac80-4f88-9342-2626612e1a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:38:30 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-f322a0ec-16be-4d2c-a3ab-ebd62b72932c tempest-TestShelveInstance-1465458414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a75f540c-ac80-4f88-9342-2626612e1a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:38:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-466296954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5011dbe7-d2b5-48bd-879c-aa2c46dfc4df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='304a5abbc8114b2abaaed432e6696581',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:38:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:38:30Z,use_quota=True,user_id='f72df4bc9af548ca814bcee20c48046c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:38:30 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-f322a0ec-16be-4d2c-a3ab-ebd62b72932c tempest-TestShelveInstance-1465458414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f022f9e5-eec9-4079-8a13-3269ce3e67d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:38:30 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-f322a0ec-16be-4d2c-a3ab-ebd62b72932c tempest-TestShelveInstance-1465458414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f022f9e5-eec9-4079-8a13-3269ce3e67d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:38:30 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-f322a0ec-16be-4d2c-a3ab-ebd62b72932c tempest-TestShelveInstance-1465458414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68c5bfd0-0c91-451c-863e-ee23efd68cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:38:30 devstack cinder-volume[84448]: DEBUG cinder.image.glance [None req-f322a0ec-16be-4d2c-a3ab-ebd62b72932c tempest-TestShelveInstance-1465458414 None] Creating Keystone auth plugin from conf {{(pid=84448) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 29 15:38:30 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-f322a0ec-16be-4d2c-a3ab-ebd62b72932c tempest-TestShelveInstance-1465458414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68c5bfd0-0c91-451c-863e-ee23efd68cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5011dbe7-d2b5-48bd-879c-aa2c46dfc4df', 'volume_name': 'volume-5011dbe7-d2b5-48bd-879c-aa2c46dfc4df', 'volume_size': 1, 'image_id': 'ad86f424-7d2a-4f3b-9577-890075e7dc72', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ad86f424-7d2a-4f3b-9577-890075e7dc72', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '33db0ca5091747b1a3438d70bf53390c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ad86f424-7d2a-4f3b-9577-890075e7dc72', 'created_at': datetime.datetime(2026, 4, 29, 13, 0, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 13, 0, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ad86f424-7d2a-4f3b-9577-890075e7dc72/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:38:30 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-f322a0ec-16be-4d2c-a3ab-ebd62b72932c tempest-TestShelveInstance-1465458414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7de23f5-e625-4405-8794-5fb2a768f7d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:38:30 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-f322a0ec-16be-4d2c-a3ab-ebd62b72932c tempest-TestShelveInstance-1465458414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7de23f5-e625-4405-8794-5fb2a768f7d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:38:30 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-f322a0ec-16be-4d2c-a3ab-ebd62b72932c tempest-TestShelveInstance-1465458414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e61e096-c151-4cec-b561-bbe7bb83bc42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:38:30 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-f322a0ec-16be-4d2c-a3ab-ebd62b72932c tempest-TestShelveInstance-1465458414 None] Volume 5011dbe7-d2b5-48bd-879c-aa2c46dfc4df: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5011dbe7-d2b5-48bd-879c-aa2c46dfc4df', 'volume_size': 1, 'image_id': 'ad86f424-7d2a-4f3b-9577-890075e7dc72', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ad86f424-7d2a-4f3b-9577-890075e7dc72', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '33db0ca5091747b1a3438d70bf53390c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ad86f424-7d2a-4f3b-9577-890075e7dc72', 'created_at': datetime.datetime(2026, 4, 29, 13, 0, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 13, 0, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ad86f424-7d2a-4f3b-9577-890075e7dc72/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 29 15:38:30 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-f322a0ec-16be-4d2c-a3ab-ebd62b72932c tempest-TestShelveInstance-1465458414 None] Trying to clone 5011dbe7-d2b5-48bd-879c-aa2c46dfc4df from image ad86f424-7d2a-4f3b-9577-890075e7dc72 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ad86f424-7d2a-4f3b-9577-890075e7dc72', 'metadata': {}}]). {{(pid=84448) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 29 15:38:31 devstack sudo[110022]: pam_unix(sudo:session): session closed for user root Apr 29 15:38:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.587s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:38:31 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:38:31 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [None req-f322a0ec-16be-4d2c-a3ab-ebd62b72932c tempest-TestShelveInstance-1465458414 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_d63vx2midevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84448) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 29 15:38:31 devstack cinder-volume[84448]: INFO cinder.image.image_utils [None req-f322a0ec-16be-4d2c-a3ab-ebd62b72932c tempest-TestShelveInstance-1465458414 None] Image download 20.69 MB at 20.69 MB/s Apr 29 15:38:31 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[63654f5a-e724-4987-a4d0-ec41ccfd1eed]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:38:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f322a0ec-16be-4d2c-a3ab-ebd62b72932c tempest-TestShelveInstance-1465458414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_d63vx2midevstack@QuobyteHD {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:38:31 devstack sudo[110026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_d63vx2midevstack@QuobyteHD Apr 29 15:38:31 devstack sudo[110026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:38:31 devstack sudo[110026]: pam_unix(sudo:session): session closed for user root Apr 29 15:38:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f322a0ec-16be-4d2c-a3ab-ebd62b72932c tempest-TestShelveInstance-1465458414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_d63vx2midevstack@QuobyteHD" returned: 0 in 0.666s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:38:31 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [None req-f322a0ec-16be-4d2c-a3ab-ebd62b72932c tempest-TestShelveInstance-1465458414 None] Temporary image ad86f424-7d2a-4f3b-9577-890075e7dc72 is fetched for user f72df4bc9af548ca814bcee20c48046c. {{(pid=84448) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 29 15:38:32 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[540517b7-011b-4b3a-99a7-17d2c2a4c0f7]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:38:32 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f322a0ec-16be-4d2c-a3ab-ebd62b72932c tempest-TestShelveInstance-1465458414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_d63vx2midevstack@QuobyteHD {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:38:32 devstack sudo[110031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_d63vx2midevstack@QuobyteHD Apr 29 15:38:32 devstack sudo[110031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:38:32 devstack sudo[110031]: pam_unix(sudo:session): session closed for user root Apr 29 15:38:32 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f322a0ec-16be-4d2c-a3ab-ebd62b72932c tempest-TestShelveInstance-1465458414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_d63vx2midevstack@QuobyteHD" returned: 0 in 0.686s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:38:32 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-f322a0ec-16be-4d2c-a3ab-ebd62b72932c tempest-TestShelveInstance-1465458414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:38:32 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-f322a0ec-16be-4d2c-a3ab-ebd62b72932c tempest-TestShelveInstance-1465458414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:38:32 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-f322a0ec-16be-4d2c-a3ab-ebd62b72932c tempest-TestShelveInstance-1465458414 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:38:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-466296954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5011dbe7-d2b5-48bd-879c-aa2c46dfc4df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='304a5abbc8114b2abaaed432e6696581',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:38:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:38:30Z,use_quota=True,user_id='f72df4bc9af548ca814bcee20c48046c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:38:32 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-f322a0ec-16be-4d2c-a3ab-ebd62b72932c tempest-TestShelveInstance-1465458414 None] Creating volume 5011dbe7-d2b5-48bd-879c-aa2c46dfc4df {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:38:32 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-f322a0ec-16be-4d2c-a3ab-ebd62b72932c tempest-TestShelveInstance-1465458414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:38:32 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-f322a0ec-16be-4d2c-a3ab-ebd62b72932c tempest-TestShelveInstance-1465458414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:38:32 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-f322a0ec-16be-4d2c-a3ab-ebd62b72932c tempest-TestShelveInstance-1465458414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:38:32 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-f322a0ec-16be-4d2c-a3ab-ebd62b72932c tempest-TestShelveInstance-1465458414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:38:32 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-f322a0ec-16be-4d2c-a3ab-ebd62b72932c tempest-TestShelveInstance-1465458414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:38:32 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-f322a0ec-16be-4d2c-a3ab-ebd62b72932c tempest-TestShelveInstance-1465458414 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:38:32 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-f322a0ec-16be-4d2c-a3ab-ebd62b72932c tempest-TestShelveInstance-1465458414 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:38:32 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f322a0ec-16be-4d2c-a3ab-ebd62b72932c tempest-TestShelveInstance-1465458414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5011dbe7-d2b5-48bd-879c-aa2c46dfc4df 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:38:32 devstack sudo[110042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5011dbe7-d2b5-48bd-879c-aa2c46dfc4df 1073741824 Apr 29 15:38:32 devstack sudo[110042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:38:33 devstack sudo[110042]: pam_unix(sudo:session): session closed for user root Apr 29 15:38:33 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f322a0ec-16be-4d2c-a3ab-ebd62b72932c tempest-TestShelveInstance-1465458414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5011dbe7-d2b5-48bd-879c-aa2c46dfc4df 1073741824" returned: 0 in 0.775s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:38:33 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f322a0ec-16be-4d2c-a3ab-ebd62b72932c tempest-TestShelveInstance-1465458414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5011dbe7-d2b5-48bd-879c-aa2c46dfc4df {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:38:33 devstack sudo[110048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5011dbe7-d2b5-48bd-879c-aa2c46dfc4df Apr 29 15:38:33 devstack sudo[110048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:38:34 devstack sudo[110048]: pam_unix(sudo:session): session closed for user root Apr 29 15:38:34 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f322a0ec-16be-4d2c-a3ab-ebd62b72932c tempest-TestShelveInstance-1465458414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5011dbe7-d2b5-48bd-879c-aa2c46dfc4df" returned: 0 in 0.566s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:38:34 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-f322a0ec-16be-4d2c-a3ab-ebd62b72932c tempest-TestShelveInstance-1465458414 None] <== create_volume: return (1390ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:38:34 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-f322a0ec-16be-4d2c-a3ab-ebd62b72932c tempest-TestShelveInstance-1465458414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.394s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:38:34 devstack cinder-volume[84448]: DEBUG cinder.volume.volume_utils [None req-f322a0ec-16be-4d2c-a3ab-ebd62b72932c tempest-TestShelveInstance-1465458414 None] Attempting download of ad86f424-7d2a-4f3b-9577-890075e7dc72 ((None, [{'url': 'file:///opt/stack/data/glance/images/ad86f424-7d2a-4f3b-9577-890075e7dc72', 'metadata': {}}])) to volume 5011dbe7-d2b5-48bd-879c-aa2c46dfc4df. {{(pid=84448) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 29 15:38:34 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e3b83f-e8a1-49c5-947c-2f9f92cff9ca]: (4, 'raw') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:38:34 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f322a0ec-16be-4d2c-a3ab-ebd62b72932c tempest-TestShelveInstance-1465458414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ad86f424-7d2a-4f3b-9577-890075e7dc72_ne6jb5in {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:38:34 devstack sudo[110051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ad86f424-7d2a-4f3b-9577-890075e7dc72_ne6jb5in Apr 29 15:38:34 devstack sudo[110051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:38:34 devstack sudo[110051]: pam_unix(sudo:session): session closed for user root Apr 29 15:38:34 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f322a0ec-16be-4d2c-a3ab-ebd62b72932c tempest-TestShelveInstance-1465458414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ad86f424-7d2a-4f3b-9577-890075e7dc72_ne6jb5in" returned: 0 in 0.659s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:38:34 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f322a0ec-16be-4d2c-a3ab-ebd62b72932c tempest-TestShelveInstance-1465458414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ad86f424-7d2a-4f3b-9577-890075e7dc72_ne6jb5in {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:38:34 devstack sudo[110055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ad86f424-7d2a-4f3b-9577-890075e7dc72_ne6jb5in Apr 29 15:38:34 devstack sudo[110055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:38:35 devstack sudo[110055]: pam_unix(sudo:session): session closed for user root Apr 29 15:38:35 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f322a0ec-16be-4d2c-a3ab-ebd62b72932c tempest-TestShelveInstance-1465458414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ad86f424-7d2a-4f3b-9577-890075e7dc72_ne6jb5in" returned: 1 in 0.662s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:38:35 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f322a0ec-16be-4d2c-a3ab-ebd62b72932c tempest-TestShelveInstance-1465458414 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ad86f424-7d2a-4f3b-9577-890075e7dc72_ne6jb5in' failed. Not Retrying. {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 15:38:35 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac0cb97a-f569-4e38-b030-d46471ec032d]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:38:35 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f322a0ec-16be-4d2c-a3ab-ebd62b72932c tempest-TestShelveInstance-1465458414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_d63vx2midevstack@QuobyteHD {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:38:35 devstack sudo[110059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_d63vx2midevstack@QuobyteHD Apr 29 15:38:35 devstack sudo[110059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:38:36 devstack sudo[110059]: pam_unix(sudo:session): session closed for user root Apr 29 15:38:36 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f322a0ec-16be-4d2c-a3ab-ebd62b72932c tempest-TestShelveInstance-1465458414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_d63vx2midevstack@QuobyteHD" returned: 0 in 0.658s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:38:36 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [None req-f322a0ec-16be-4d2c-a3ab-ebd62b72932c tempest-TestShelveInstance-1465458414 None] ad86f424-7d2a-4f3b-9577-890075e7dc72 was qcow2, converting to raw {{(pid=84448) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 29 15:38:36 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f322a0ec-16be-4d2c-a3ab-ebd62b72932c tempest-TestShelveInstance-1465458414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_d63vx2midevstack@QuobyteHD /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5011dbe7-d2b5-48bd-879c-aa2c46dfc4df {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:38:36 devstack sudo[110065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_d63vx2midevstack@QuobyteHD /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5011dbe7-d2b5-48bd-879c-aa2c46dfc4df Apr 29 15:38:36 devstack sudo[110065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:38:37 devstack sudo[110065]: pam_unix(sudo:session): session closed for user root Apr 29 15:38:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f322a0ec-16be-4d2c-a3ab-ebd62b72932c tempest-TestShelveInstance-1465458414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_d63vx2midevstack@QuobyteHD /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5011dbe7-d2b5-48bd-879c-aa2c46dfc4df" returned: 0 in 1.741s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:38:37 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [None req-f322a0ec-16be-4d2c-a3ab-ebd62b72932c tempest-TestShelveInstance-1465458414 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ad86f424-7d2a-4f3b-9577-890075e7dc72_d63vx2midevstack@QuobyteHD, size 112.00 MB, duration 1.74 sec, destination /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5011dbe7-d2b5-48bd-879c-aa2c46dfc4df {{(pid=84448) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 15:38:37 devstack cinder-volume[84448]: INFO cinder.image.image_utils [None req-f322a0ec-16be-4d2c-a3ab-ebd62b72932c tempest-TestShelveInstance-1465458414 None] Converted 112.00 MB image at 64.27 MB/s Apr 29 15:38:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f322a0ec-16be-4d2c-a3ab-ebd62b72932c tempest-TestShelveInstance-1465458414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5011dbe7-d2b5-48bd-879c-aa2c46dfc4df 1G {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:38:37 devstack sudo[110112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5011dbe7-d2b5-48bd-879c-aa2c46dfc4df 1G Apr 29 15:38:37 devstack sudo[110112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:38:38 devstack sudo[110112]: pam_unix(sudo:session): session closed for user root Apr 29 15:38:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f322a0ec-16be-4d2c-a3ab-ebd62b72932c tempest-TestShelveInstance-1465458414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5011dbe7-d2b5-48bd-879c-aa2c46dfc4df 1G" returned: 0 in 0.654s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:38:38 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[260865a7-ca95-4de3-84fa-ea05bc3f09c1]: (4, 'raw') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:38:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f322a0ec-16be-4d2c-a3ab-ebd62b72932c tempest-TestShelveInstance-1465458414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5011dbe7-d2b5-48bd-879c-aa2c46dfc4df {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:38:38 devstack sudo[110119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5011dbe7-d2b5-48bd-879c-aa2c46dfc4df Apr 29 15:38:38 devstack sudo[110119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:38:39 devstack sudo[110119]: pam_unix(sudo:session): session closed for user root Apr 29 15:38:39 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f322a0ec-16be-4d2c-a3ab-ebd62b72932c tempest-TestShelveInstance-1465458414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5011dbe7-d2b5-48bd-879c-aa2c46dfc4df" returned: 0 in 0.685s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:38:39 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f322a0ec-16be-4d2c-a3ab-ebd62b72932c tempest-TestShelveInstance-1465458414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5011dbe7-d2b5-48bd-879c-aa2c46dfc4df {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:38:39 devstack sudo[110123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5011dbe7-d2b5-48bd-879c-aa2c46dfc4df Apr 29 15:38:39 devstack sudo[110123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:38:39 devstack sudo[110123]: pam_unix(sudo:session): session closed for user root Apr 29 15:38:39 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f322a0ec-16be-4d2c-a3ab-ebd62b72932c tempest-TestShelveInstance-1465458414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5011dbe7-d2b5-48bd-879c-aa2c46dfc4df" returned: 1 in 0.671s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:38:39 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f322a0ec-16be-4d2c-a3ab-ebd62b72932c tempest-TestShelveInstance-1465458414 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5011dbe7-d2b5-48bd-879c-aa2c46dfc4df' failed. Not Retrying. {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 15:38:39 devstack cinder-volume[84448]: DEBUG cinder.volume.volume_utils [None req-f322a0ec-16be-4d2c-a3ab-ebd62b72932c tempest-TestShelveInstance-1465458414 None] Downloaded image ad86f424-7d2a-4f3b-9577-890075e7dc72 ((None, [{'url': 'file:///opt/stack/data/glance/images/ad86f424-7d2a-4f3b-9577-890075e7dc72', 'metadata': {}}])) to volume 5011dbe7-d2b5-48bd-879c-aa2c46dfc4df successfully. {{(pid=84448) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 29 15:38:39 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [None req-f322a0ec-16be-4d2c-a3ab-ebd62b72932c tempest-TestShelveInstance-1465458414 None] Temporary image ad86f424-7d2a-4f3b-9577-890075e7dc72 for user f72df4bc9af548ca814bcee20c48046c is deleted. {{(pid=84448) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 29 15:38:39 devstack cinder-volume[84448]: DEBUG cinder.volume.volume_utils [None req-f322a0ec-16be-4d2c-a3ab-ebd62b72932c tempest-TestShelveInstance-1465458414 None] Marking volume 5011dbe7-d2b5-48bd-879c-aa2c46dfc4df as bootable. {{(pid=84448) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 29 15:38:40 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-f322a0ec-16be-4d2c-a3ab-ebd62b72932c tempest-TestShelveInstance-1465458414 None] Copying metadata from image ad86f424-7d2a-4f3b-9577-890075e7dc72 to 5011dbe7-d2b5-48bd-879c-aa2c46dfc4df. {{(pid=84448) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 29 15:38:40 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-f322a0ec-16be-4d2c-a3ab-ebd62b72932c tempest-TestShelveInstance-1465458414 None] Creating volume glance metadata for volume 5011dbe7-d2b5-48bd-879c-aa2c46dfc4df backed by image ad86f424-7d2a-4f3b-9577-890075e7dc72 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'ad86f424-7d2a-4f3b-9577-890075e7dc72', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84448) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 29 15:38:40 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-f322a0ec-16be-4d2c-a3ab-ebd62b72932c tempest-TestShelveInstance-1465458414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e61e096-c151-4cec-b561-bbe7bb83bc42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5011dbe7-d2b5-48bd-879c-aa2c46dfc4df', 'volume_size': 1, 'image_id': 'ad86f424-7d2a-4f3b-9577-890075e7dc72', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ad86f424-7d2a-4f3b-9577-890075e7dc72', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '33db0ca5091747b1a3438d70bf53390c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ad86f424-7d2a-4f3b-9577-890075e7dc72', 'created_at': datetime.datetime(2026, 4, 29, 13, 0, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 13, 0, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ad86f424-7d2a-4f3b-9577-890075e7dc72/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:38:40 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-f322a0ec-16be-4d2c-a3ab-ebd62b72932c tempest-TestShelveInstance-1465458414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90b8a3c9-4261-403f-9b86-26b5fde2add2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:38:40 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-f322a0ec-16be-4d2c-a3ab-ebd62b72932c tempest-TestShelveInstance-1465458414 None] Volume volume-5011dbe7-d2b5-48bd-879c-aa2c46dfc4df (5011dbe7-d2b5-48bd-879c-aa2c46dfc4df): created successfully Apr 29 15:38:40 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-f322a0ec-16be-4d2c-a3ab-ebd62b72932c tempest-TestShelveInstance-1465458414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90b8a3c9-4261-403f-9b86-26b5fde2add2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:38:40 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-f322a0ec-16be-4d2c-a3ab-ebd62b72932c tempest-TestShelveInstance-1465458414 None] Flow 'volume_create_manager' (758e8a35-9817-4b15-b173-a7100e66f671) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:38:40 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-f322a0ec-16be-4d2c-a3ab-ebd62b72932c tempest-TestShelveInstance-1465458414 None] Created volume successfully. Apr 29 15:38:48 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-bfa0f5c3-d4fd-47e6-be12-6a9988e96684 req-47cd63d3-443b-46cc-bbe0-43ab58695e3a tempest-TestShelveInstance-1465458414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:38:48 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-bfa0f5c3-d4fd-47e6-be12-6a9988e96684 req-47cd63d3-443b-46cc-bbe0-43ab58695e3a tempest-TestShelveInstance-1465458414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:38:48 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[5714eaeb-11da-4317-ab3e-66020dd4d4f6]: (4, 'raw') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:38:48 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-bfa0f5c3-d4fd-47e6-be12-6a9988e96684 req-47cd63d3-443b-46cc-bbe0-43ab58695e3a tempest-TestShelveInstance-1465458414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5011dbe7-d2b5-48bd-879c-aa2c46dfc4df {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:38:48 devstack sudo[110144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5011dbe7-d2b5-48bd-879c-aa2c46dfc4df Apr 29 15:38:48 devstack sudo[110144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:38:48 devstack sudo[110144]: pam_unix(sudo:session): session closed for user root Apr 29 15:38:48 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-bfa0f5c3-d4fd-47e6-be12-6a9988e96684 req-47cd63d3-443b-46cc-bbe0-43ab58695e3a tempest-TestShelveInstance-1465458414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5011dbe7-d2b5-48bd-879c-aa2c46dfc4df" returned: 0 in 0.733s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:38:48 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-bfa0f5c3-d4fd-47e6-be12-6a9988e96684 req-47cd63d3-443b-46cc-bbe0-43ab58695e3a tempest-TestShelveInstance-1465458414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5011dbe7-d2b5-48bd-879c-aa2c46dfc4df {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:38:48 devstack sudo[110148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5011dbe7-d2b5-48bd-879c-aa2c46dfc4df Apr 29 15:38:48 devstack sudo[110148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:38:49 devstack sudo[110148]: pam_unix(sudo:session): session closed for user root Apr 29 15:38:49 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-bfa0f5c3-d4fd-47e6-be12-6a9988e96684 req-47cd63d3-443b-46cc-bbe0-43ab58695e3a tempest-TestShelveInstance-1465458414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5011dbe7-d2b5-48bd-879c-aa2c46dfc4df" returned: 1 in 0.712s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:38:49 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-bfa0f5c3-d4fd-47e6-be12-6a9988e96684 req-47cd63d3-443b-46cc-bbe0-43ab58695e3a tempest-TestShelveInstance-1465458414 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5011dbe7-d2b5-48bd-879c-aa2c46dfc4df' failed. Not Retrying. {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 15:38:49 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-bfa0f5c3-d4fd-47e6-be12-6a9988e96684 req-47cd63d3-443b-46cc-bbe0-43ab58695e3a tempest-TestShelveInstance-1465458414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.510s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:38:49 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-bfa0f5c3-d4fd-47e6-be12-6a9988e96684 req-47cd63d3-443b-46cc-bbe0-43ab58695e3a tempest-TestShelveInstance-1465458414 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a', 'name': 'volume-5011dbe7-d2b5-48bd-879c-aa2c46dfc4df', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '79f04c55-99ae-47e4-86ee-5d42194abbd7', 'enforce_multipath': True} {{(pid=84448) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 15:38:49 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-bfa0f5c3-d4fd-47e6-be12-6a9988e96684 req-47cd63d3-443b-46cc-bbe0-43ab58695e3a tempest-TestShelveInstance-1465458414 None] attachment_update completed successfully. Apr 29 15:38:59 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:SELECT=14,cinder:UPDATE=8,cinder:INSERT=5,cinder:DELETE=1 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:38:59 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:SELECT=16,cinder:UPDATE=4,cinder:INSERT=9 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:39:26 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-abd39422-959e-49bd-9b9f-a23dbf0fab42 req-6c401742-be86-40fd-8724-914cbaa9ba39 tempest-TestShelveInstance-1465458414 None] Terminate volume connection completed successfully. Apr 29 15:39:26 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-abd39422-959e-49bd-9b9f-a23dbf0fab42 req-6c401742-be86-40fd-8724-914cbaa9ba39 tempest-TestShelveInstance-1465458414 None] Deleting attachment 79f04c55-99ae-47e4-86ee-5d42194abbd7. {{(pid=84448) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 15:39:30 devstack cinder-volume[84448]: DEBUG oslo_service.periodic_task [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84448) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 15:39:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:39:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:39:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:39:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:39:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:39:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:39:30 devstack sudo[110763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:39:30 devstack sudo[110763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:39:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-02db8729-8058-4356-b794-1a229ced51db req-1336d87f-32ac-43d4-ac9f-206dde6286bd tempest-TestShelveInstance-1465458414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:39:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-02db8729-8058-4356-b794-1a229ced51db req-1336d87f-32ac-43d4-ac9f-206dde6286bd tempest-TestShelveInstance-1465458414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:39:30 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5de3ba-d326-48d2-9cd7-d4fd9f7dfc69]: (4, 'raw') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:39:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-02db8729-8058-4356-b794-1a229ced51db req-1336d87f-32ac-43d4-ac9f-206dde6286bd tempest-TestShelveInstance-1465458414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5011dbe7-d2b5-48bd-879c-aa2c46dfc4df {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:39:30 devstack sudo[110763]: pam_unix(sudo:session): session closed for user root Apr 29 15:39:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.585s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:39:31 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:39:31 devstack sudo[110774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5011dbe7-d2b5-48bd-879c-aa2c46dfc4df Apr 29 15:39:31 devstack sudo[110774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:39:31 devstack sudo[110774]: pam_unix(sudo:session): session closed for user root Apr 29 15:39:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-02db8729-8058-4356-b794-1a229ced51db req-1336d87f-32ac-43d4-ac9f-206dde6286bd tempest-TestShelveInstance-1465458414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5011dbe7-d2b5-48bd-879c-aa2c46dfc4df" returned: 0 in 0.725s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:39:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-02db8729-8058-4356-b794-1a229ced51db req-1336d87f-32ac-43d4-ac9f-206dde6286bd tempest-TestShelveInstance-1465458414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5011dbe7-d2b5-48bd-879c-aa2c46dfc4df {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:39:31 devstack sudo[110778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5011dbe7-d2b5-48bd-879c-aa2c46dfc4df Apr 29 15:39:31 devstack sudo[110778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:39:32 devstack sudo[110778]: pam_unix(sudo:session): session closed for user root Apr 29 15:39:32 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-02db8729-8058-4356-b794-1a229ced51db req-1336d87f-32ac-43d4-ac9f-206dde6286bd tempest-TestShelveInstance-1465458414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5011dbe7-d2b5-48bd-879c-aa2c46dfc4df" returned: 1 in 0.706s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:39:32 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-02db8729-8058-4356-b794-1a229ced51db req-1336d87f-32ac-43d4-ac9f-206dde6286bd tempest-TestShelveInstance-1465458414 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5011dbe7-d2b5-48bd-879c-aa2c46dfc4df' failed. Not Retrying. {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 15:39:32 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-02db8729-8058-4356-b794-1a229ced51db req-1336d87f-32ac-43d4-ac9f-206dde6286bd tempest-TestShelveInstance-1465458414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.487s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:39:32 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-02db8729-8058-4356-b794-1a229ced51db req-1336d87f-32ac-43d4-ac9f-206dde6286bd tempest-TestShelveInstance-1465458414 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a', 'name': 'volume-5011dbe7-d2b5-48bd-879c-aa2c46dfc4df', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ae55df3b-dce0-4c21-a5fb-ed3d0013827a', 'enforce_multipath': True} {{(pid=84448) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 15:39:32 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-02db8729-8058-4356-b794-1a229ced51db req-1336d87f-32ac-43d4-ac9f-206dde6286bd tempest-TestShelveInstance-1465458414 None] attachment_update completed successfully. Apr 29 15:39:42 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:UPDATE=2,cinder:SELECT=5 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:39:42 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:40:25 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-b5c2030f-3265-40ea-a250-c1de8fbd765e req-579921ae-040b-4724-8f40-d1a0b5142cae tempest-TestShelveInstance-1465458414 None] Terminate volume connection completed successfully. Apr 29 15:40:25 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [req-b5c2030f-3265-40ea-a250-c1de8fbd765e req-579921ae-040b-4724-8f40-d1a0b5142cae tempest-TestShelveInstance-1465458414 None] Deleting attachment ae55df3b-dce0-4c21-a5fb-ed3d0013827a. {{(pid=84448) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 15:40:26 devstack cinder-volume[84448]: DEBUG cinder.coordination [req-b5c2030f-3265-40ea-a250-c1de8fbd765e req-dabf748e-b24c-4c88-b95f-cdbfa6888c63 tempest-TestShelveInstance-1465458414 None] Acquiring lock "cinder-5011dbe7-d2b5-48bd-879c-aa2c46dfc4df-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:40:26 devstack cinder-volume[84448]: DEBUG cinder.coordination [req-b5c2030f-3265-40ea-a250-c1de8fbd765e req-dabf748e-b24c-4c88-b95f-cdbfa6888c63 tempest-TestShelveInstance-1465458414 None] Lock "cinder-5011dbe7-d2b5-48bd-879c-aa2c46dfc4df-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:40:26 devstack cinder-volume[84448]: DEBUG cinder.coordination [req-b5c2030f-3265-40ea-a250-c1de8fbd765e req-dabf748e-b24c-4c88-b95f-cdbfa6888c63 tempest-TestShelveInstance-1465458414 None] Acquiring lock "cinder-quobyte-5011dbe7-d2b5-48bd-879c-aa2c46dfc4df" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:40:26 devstack cinder-volume[84448]: DEBUG cinder.coordination [req-b5c2030f-3265-40ea-a250-c1de8fbd765e req-dabf748e-b24c-4c88-b95f-cdbfa6888c63 tempest-TestShelveInstance-1465458414 None] Lock "cinder-quobyte-5011dbe7-d2b5-48bd-879c-aa2c46dfc4df" acquired by "delete_volume" :: waited 0.018s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:40:26 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac7a5775-752b-4f13-aca7-1704084c655c]: (4, 'raw') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:40:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-b5c2030f-3265-40ea-a250-c1de8fbd765e req-dabf748e-b24c-4c88-b95f-cdbfa6888c63 tempest-TestShelveInstance-1465458414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5011dbe7-d2b5-48bd-879c-aa2c46dfc4df {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:40:26 devstack sudo[111368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5011dbe7-d2b5-48bd-879c-aa2c46dfc4df Apr 29 15:40:26 devstack sudo[111368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:40:26 devstack sudo[111368]: pam_unix(sudo:session): session closed for user root Apr 29 15:40:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-b5c2030f-3265-40ea-a250-c1de8fbd765e req-dabf748e-b24c-4c88-b95f-cdbfa6888c63 tempest-TestShelveInstance-1465458414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5011dbe7-d2b5-48bd-879c-aa2c46dfc4df" returned: 0 in 0.725s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:40:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-b5c2030f-3265-40ea-a250-c1de8fbd765e req-dabf748e-b24c-4c88-b95f-cdbfa6888c63 tempest-TestShelveInstance-1465458414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5011dbe7-d2b5-48bd-879c-aa2c46dfc4df {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:40:27 devstack sudo[111373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5011dbe7-d2b5-48bd-879c-aa2c46dfc4df Apr 29 15:40:27 devstack sudo[111373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:40:27 devstack sudo[111373]: pam_unix(sudo:session): session closed for user root Apr 29 15:40:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-b5c2030f-3265-40ea-a250-c1de8fbd765e req-dabf748e-b24c-4c88-b95f-cdbfa6888c63 tempest-TestShelveInstance-1465458414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5011dbe7-d2b5-48bd-879c-aa2c46dfc4df" returned: 1 in 0.674s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:40:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-b5c2030f-3265-40ea-a250-c1de8fbd765e req-dabf748e-b24c-4c88-b95f-cdbfa6888c63 tempest-TestShelveInstance-1465458414 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5011dbe7-d2b5-48bd-879c-aa2c46dfc4df' failed. Not Retrying. {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 15:40:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-b5c2030f-3265-40ea-a250-c1de8fbd765e req-dabf748e-b24c-4c88-b95f-cdbfa6888c63 tempest-TestShelveInstance-1465458414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5011dbe7-d2b5-48bd-879c-aa2c46dfc4df {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:40:27 devstack sudo[111378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5011dbe7-d2b5-48bd-879c-aa2c46dfc4df Apr 29 15:40:27 devstack sudo[111378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:40:28 devstack sudo[111378]: pam_unix(sudo:session): session closed for user root Apr 29 15:40:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-b5c2030f-3265-40ea-a250-c1de8fbd765e req-dabf748e-b24c-4c88-b95f-cdbfa6888c63 tempest-TestShelveInstance-1465458414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5011dbe7-d2b5-48bd-879c-aa2c46dfc4df" returned: 0 in 0.576s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:40:28 devstack cinder-volume[84448]: DEBUG cinder.coordination [req-b5c2030f-3265-40ea-a250-c1de8fbd765e req-dabf748e-b24c-4c88-b95f-cdbfa6888c63 tempest-TestShelveInstance-1465458414 None] Lock "cinder-quobyte-5011dbe7-d2b5-48bd-879c-aa2c46dfc4df" released by "delete_volume" :: held 2.039s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:40:28 devstack cinder-volume[84448]: DEBUG cinder.quota [req-b5c2030f-3265-40ea-a250-c1de8fbd765e req-dabf748e-b24c-4c88-b95f-cdbfa6888c63 tempest-TestShelveInstance-1465458414 None] Created reservations ['7e7d138e-32da-4754-9c13-fa5d3494f433', 'bea71ae3-c1ce-49f6-b40e-cb6f4bb9b87f', 'b9eaa3f8-f3ad-43ef-9d4e-d58eb808a91c', '9309caed-0e40-46bd-b40e-b3c4fc9791b1'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:40:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-b5c2030f-3265-40ea-a250-c1de8fbd765e req-dabf748e-b24c-4c88-b95f-cdbfa6888c63 tempest-TestShelveInstance-1465458414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:40:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-b5c2030f-3265-40ea-a250-c1de8fbd765e req-dabf748e-b24c-4c88-b95f-cdbfa6888c63 tempest-TestShelveInstance-1465458414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:40:28 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [req-b5c2030f-3265-40ea-a250-c1de8fbd765e req-dabf748e-b24c-4c88-b95f-cdbfa6888c63 tempest-TestShelveInstance-1465458414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:40:28 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [req-b5c2030f-3265-40ea-a250-c1de8fbd765e req-dabf748e-b24c-4c88-b95f-cdbfa6888c63 tempest-TestShelveInstance-1465458414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:40:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [req-b5c2030f-3265-40ea-a250-c1de8fbd765e req-dabf748e-b24c-4c88-b95f-cdbfa6888c63 tempest-TestShelveInstance-1465458414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:40:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-b5c2030f-3265-40ea-a250-c1de8fbd765e req-dabf748e-b24c-4c88-b95f-cdbfa6888c63 tempest-TestShelveInstance-1465458414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:40:28 devstack sudo[111381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:40:28 devstack sudo[111381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:40:28 devstack sudo[111381]: pam_unix(sudo:session): session closed for user root Apr 29 15:40:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [req-b5c2030f-3265-40ea-a250-c1de8fbd765e req-dabf748e-b24c-4c88-b95f-cdbfa6888c63 tempest-TestShelveInstance-1465458414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.601s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:40:28 devstack cinder-volume[84448]: DEBUG cinder.manager [req-b5c2030f-3265-40ea-a250-c1de8fbd765e req-dabf748e-b24c-4c88-b95f-cdbfa6888c63 tempest-TestShelveInstance-1465458414 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:40:28 devstack cinder-volume[84448]: INFO cinder.volume.manager [req-b5c2030f-3265-40ea-a250-c1de8fbd765e req-dabf748e-b24c-4c88-b95f-cdbfa6888c63 tempest-TestShelveInstance-1465458414 None] Deleted volume successfully. Apr 29 15:40:28 devstack cinder-volume[84448]: DEBUG cinder.coordination [req-b5c2030f-3265-40ea-a250-c1de8fbd765e req-dabf748e-b24c-4c88-b95f-cdbfa6888c63 tempest-TestShelveInstance-1465458414 None] Lock "cinder-5011dbe7-d2b5-48bd-879c-aa2c46dfc4df-delete_volume" released by "delete_volume" :: held 2.825s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:40:30 devstack cinder-volume[84448]: DEBUG oslo_service.periodic_task [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84448) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 15:40:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:40:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:40:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:40:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:40:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:40:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:40:30 devstack sudo[111384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:40:30 devstack sudo[111384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:40:31 devstack sudo[111384]: pam_unix(sudo:session): session closed for user root Apr 29 15:40:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.647s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:40:31 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:40:38 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:SELECT=7,cinder:UPDATE=9,cinder:INSERT=2 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:40:38 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-eafc1189-462a-4018-87db-eb3c4f766a8f tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:40:38 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-eafc1189-462a-4018-87db-eb3c4f766a8f tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Flow 'volume_create_manager' (cb366cd2-da80-417b-af98-e98ea2f31cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:40:38 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-eafc1189-462a-4018-87db-eb3c4f766a8f tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed5b54f2-fd82-41f9-963e-8b63c9d3edfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:40:38 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-eafc1189-462a-4018-87db-eb3c4f766a8f tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed5b54f2-fd82-41f9-963e-8b63c9d3edfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:40:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2036850808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61db0a81-141b-4282-b9b6-5242707562c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efeba28e7e534fd791df5b8424662333',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:40:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:40:38Z,use_quota=True,user_id='45ed4d2736d14d2788c956eb5c0659a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:40:38 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-eafc1189-462a-4018-87db-eb3c4f766a8f tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a372e64-9bd8-487c-ae7c-454061f101bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:40:38 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-eafc1189-462a-4018-87db-eb3c4f766a8f tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a372e64-9bd8-487c-ae7c-454061f101bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:40:38 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-eafc1189-462a-4018-87db-eb3c4f766a8f tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8edc67de-941a-4add-9092-32ce54ebf360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:40:38 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-eafc1189-462a-4018-87db-eb3c4f766a8f tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8edc67de-941a-4add-9092-32ce54ebf360) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61db0a81-141b-4282-b9b6-5242707562c3', 'volume_name': 'volume-61db0a81-141b-4282-b9b6-5242707562c3', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:40:38 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-eafc1189-462a-4018-87db-eb3c4f766a8f tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bc1fd0e-3535-4df4-9845-0f42d3d6d583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:40:38 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-eafc1189-462a-4018-87db-eb3c4f766a8f tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bc1fd0e-3535-4df4-9845-0f42d3d6d583) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:40:38 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-eafc1189-462a-4018-87db-eb3c4f766a8f tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb415d9b-164a-4df2-97b0-16b190625a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:40:38 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-eafc1189-462a-4018-87db-eb3c4f766a8f tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Volume 61db0a81-141b-4282-b9b6-5242707562c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61db0a81-141b-4282-b9b6-5242707562c3', 'volume_size': 1} Apr 29 15:40:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-eafc1189-462a-4018-87db-eb3c4f766a8f tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:40:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-eafc1189-462a-4018-87db-eb3c4f766a8f tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:40:38 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-eafc1189-462a-4018-87db-eb3c4f766a8f tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:40:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2036850808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61db0a81-141b-4282-b9b6-5242707562c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efeba28e7e534fd791df5b8424662333',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:40:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:40:38Z,use_quota=True,user_id='45ed4d2736d14d2788c956eb5c0659a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:40:38 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-eafc1189-462a-4018-87db-eb3c4f766a8f tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Creating volume 61db0a81-141b-4282-b9b6-5242707562c3 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:40:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-eafc1189-462a-4018-87db-eb3c4f766a8f tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:40:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-eafc1189-462a-4018-87db-eb3c4f766a8f tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:40:38 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-eafc1189-462a-4018-87db-eb3c4f766a8f tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:40:38 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-eafc1189-462a-4018-87db-eb3c4f766a8f tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:40:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-eafc1189-462a-4018-87db-eb3c4f766a8f tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:40:38 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-eafc1189-462a-4018-87db-eb3c4f766a8f tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:40:38 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-eafc1189-462a-4018-87db-eb3c4f766a8f tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:40:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-eafc1189-462a-4018-87db-eb3c4f766a8f tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-61db0a81-141b-4282-b9b6-5242707562c3 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:40:38 devstack sudo[111432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-61db0a81-141b-4282-b9b6-5242707562c3 1073741824 Apr 29 15:40:38 devstack sudo[111432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:40:39 devstack sudo[111432]: pam_unix(sudo:session): session closed for user root Apr 29 15:40:39 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-eafc1189-462a-4018-87db-eb3c4f766a8f tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-61db0a81-141b-4282-b9b6-5242707562c3 1073741824" returned: 0 in 0.791s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:40:39 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-eafc1189-462a-4018-87db-eb3c4f766a8f tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-61db0a81-141b-4282-b9b6-5242707562c3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:40:39 devstack sudo[111440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-61db0a81-141b-4282-b9b6-5242707562c3 Apr 29 15:40:39 devstack sudo[111440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:40:39 devstack sudo[111440]: pam_unix(sudo:session): session closed for user root Apr 29 15:40:39 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-eafc1189-462a-4018-87db-eb3c4f766a8f tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-61db0a81-141b-4282-b9b6-5242707562c3" returned: 0 in 0.584s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:40:39 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-eafc1189-462a-4018-87db-eb3c4f766a8f tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] <== create_volume: return (1413ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:40:39 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-eafc1189-462a-4018-87db-eb3c4f766a8f tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.415s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:40:40 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-eafc1189-462a-4018-87db-eb3c4f766a8f tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb415d9b-164a-4df2-97b0-16b190625a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61db0a81-141b-4282-b9b6-5242707562c3', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:40:40 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-eafc1189-462a-4018-87db-eb3c4f766a8f tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7bbdd1b-6eff-42f4-bd2e-932b5424e63e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:40:40 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-eafc1189-462a-4018-87db-eb3c4f766a8f tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Volume volume-61db0a81-141b-4282-b9b6-5242707562c3 (61db0a81-141b-4282-b9b6-5242707562c3): created successfully Apr 29 15:40:40 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-eafc1189-462a-4018-87db-eb3c4f766a8f tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7bbdd1b-6eff-42f4-bd2e-932b5424e63e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:40:40 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-eafc1189-462a-4018-87db-eb3c4f766a8f tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Flow 'volume_create_manager' (cb366cd2-da80-417b-af98-e98ea2f31cb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:40:40 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-eafc1189-462a-4018-87db-eb3c4f766a8f tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Created volume successfully. Apr 29 15:40:40 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-b89e4a8e-8c4f-442d-ba0b-6fdc58e7cb26 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:40:40 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b89e4a8e-8c4f-442d-ba0b-6fdc58e7cb26 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Flow 'volume_create_manager' (30673902-8d4a-4a7d-95cc-13ce47491daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:40:40 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b89e4a8e-8c4f-442d-ba0b-6fdc58e7cb26 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2e9293e-d56b-457b-bf18-27ff79054eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:40:40 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b89e4a8e-8c4f-442d-ba0b-6fdc58e7cb26 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2e9293e-d56b-457b-bf18-27ff79054eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:40:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1843130706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47e03f06-0778-4915-aee1-413ef3c935ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efeba28e7e534fd791df5b8424662333',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:40:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:40:41Z,use_quota=True,user_id='45ed4d2736d14d2788c956eb5c0659a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:40:40 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b89e4a8e-8c4f-442d-ba0b-6fdc58e7cb26 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a45e349f-de22-4597-b8d3-c5f152c6d87f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:40:40 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b89e4a8e-8c4f-442d-ba0b-6fdc58e7cb26 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a45e349f-de22-4597-b8d3-c5f152c6d87f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:40:40 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b89e4a8e-8c4f-442d-ba0b-6fdc58e7cb26 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (415671d4-717f-4328-8369-b4b81dafda0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:40:40 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b89e4a8e-8c4f-442d-ba0b-6fdc58e7cb26 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (415671d4-717f-4328-8369-b4b81dafda0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47e03f06-0778-4915-aee1-413ef3c935ea', 'volume_name': 'volume-47e03f06-0778-4915-aee1-413ef3c935ea', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:40:41 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b89e4a8e-8c4f-442d-ba0b-6fdc58e7cb26 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0676e430-6261-4efa-ac59-47f83b03a0b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:40:41 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b89e4a8e-8c4f-442d-ba0b-6fdc58e7cb26 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0676e430-6261-4efa-ac59-47f83b03a0b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:40:41 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b89e4a8e-8c4f-442d-ba0b-6fdc58e7cb26 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fd269de-b35b-4655-8b61-6f74fe602afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:40:41 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-b89e4a8e-8c4f-442d-ba0b-6fdc58e7cb26 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Volume 47e03f06-0778-4915-aee1-413ef3c935ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47e03f06-0778-4915-aee1-413ef3c935ea', 'volume_size': 1} Apr 29 15:40:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-b89e4a8e-8c4f-442d-ba0b-6fdc58e7cb26 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:40:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-b89e4a8e-8c4f-442d-ba0b-6fdc58e7cb26 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:40:41 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-b89e4a8e-8c4f-442d-ba0b-6fdc58e7cb26 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:40:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1843130706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47e03f06-0778-4915-aee1-413ef3c935ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efeba28e7e534fd791df5b8424662333',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:40:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:40:41Z,use_quota=True,user_id='45ed4d2736d14d2788c956eb5c0659a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:40:41 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-b89e4a8e-8c4f-442d-ba0b-6fdc58e7cb26 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Creating volume 47e03f06-0778-4915-aee1-413ef3c935ea {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:40:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-b89e4a8e-8c4f-442d-ba0b-6fdc58e7cb26 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:40:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-b89e4a8e-8c4f-442d-ba0b-6fdc58e7cb26 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:40:41 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-b89e4a8e-8c4f-442d-ba0b-6fdc58e7cb26 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:40:41 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-b89e4a8e-8c4f-442d-ba0b-6fdc58e7cb26 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:40:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-b89e4a8e-8c4f-442d-ba0b-6fdc58e7cb26 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:40:41 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-b89e4a8e-8c4f-442d-ba0b-6fdc58e7cb26 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:40:41 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-b89e4a8e-8c4f-442d-ba0b-6fdc58e7cb26 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:40:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-b89e4a8e-8c4f-442d-ba0b-6fdc58e7cb26 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-47e03f06-0778-4915-aee1-413ef3c935ea 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:40:41 devstack sudo[111443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-47e03f06-0778-4915-aee1-413ef3c935ea 1073741824 Apr 29 15:40:41 devstack sudo[111443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:40:41 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c616507-1663-4f7b-b66d-1bec857a032e tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:40:41 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-2c616507-1663-4f7b-b66d-1bec857a032e tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Flow 'volume_create_manager' (908edb72-04df-4260-a045-57de4618cb05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:40:41 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-2c616507-1663-4f7b-b66d-1bec857a032e tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (673b158e-a2c7-4d0d-bf5e-72d69adc0864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:40:41 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-2c616507-1663-4f7b-b66d-1bec857a032e tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (673b158e-a2c7-4d0d-bf5e-72d69adc0864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:40:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1430616791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65ccc52b-8bb6-4731-afda-9286660b4ef4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efeba28e7e534fd791df5b8424662333',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:40:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:40:41Z,use_quota=True,user_id='45ed4d2736d14d2788c956eb5c0659a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:40:41 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-2c616507-1663-4f7b-b66d-1bec857a032e tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6c2bfed-cd06-445a-84c8-fe7b24be756a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:40:41 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-2c616507-1663-4f7b-b66d-1bec857a032e tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6c2bfed-cd06-445a-84c8-fe7b24be756a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:40:41 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-2c616507-1663-4f7b-b66d-1bec857a032e tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da7cc5cf-4f83-4224-bbd4-3438f2d28cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:40:41 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-2c616507-1663-4f7b-b66d-1bec857a032e tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da7cc5cf-4f83-4224-bbd4-3438f2d28cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65ccc52b-8bb6-4731-afda-9286660b4ef4', 'volume_name': 'volume-65ccc52b-8bb6-4731-afda-9286660b4ef4', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:40:41 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-2c616507-1663-4f7b-b66d-1bec857a032e tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8fd2874-661b-4503-8477-38cf7e3a682d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:40:41 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-2c616507-1663-4f7b-b66d-1bec857a032e tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8fd2874-661b-4503-8477-38cf7e3a682d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:40:41 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-2c616507-1663-4f7b-b66d-1bec857a032e tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e856be53-2ba7-4f33-ab34-7a5e0ac0c7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:40:41 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-2c616507-1663-4f7b-b66d-1bec857a032e tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Volume 65ccc52b-8bb6-4731-afda-9286660b4ef4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65ccc52b-8bb6-4731-afda-9286660b4ef4', 'volume_size': 1} Apr 29 15:40:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-2c616507-1663-4f7b-b66d-1bec857a032e tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:40:41 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-c40d8850-f93a-4b9b-abe9-17ee46ccf229 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:40:41 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c40d8850-f93a-4b9b-abe9-17ee46ccf229 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Flow 'volume_create_manager' (52ce3161-a4c0-43d4-9893-a38f07c6d7e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:40:41 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c40d8850-f93a-4b9b-abe9-17ee46ccf229 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cb60171-98f1-47d3-a436-028a553acccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:40:41 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c40d8850-f93a-4b9b-abe9-17ee46ccf229 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cb60171-98f1-47d3-a436-028a553acccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:40:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1890270931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3e50579-6f5c-4280-a2dd-5f8782bb4417,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efeba28e7e534fd791df5b8424662333',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:40:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:40:42Z,use_quota=True,user_id='45ed4d2736d14d2788c956eb5c0659a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:40:41 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c40d8850-f93a-4b9b-abe9-17ee46ccf229 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84881959-2eaf-4763-b2b8-7b0355801f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:40:41 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c40d8850-f93a-4b9b-abe9-17ee46ccf229 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84881959-2eaf-4763-b2b8-7b0355801f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:40:41 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c40d8850-f93a-4b9b-abe9-17ee46ccf229 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (566e7c54-a555-4d4b-95ab-b4bd91fbd6b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:40:41 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c40d8850-f93a-4b9b-abe9-17ee46ccf229 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (566e7c54-a555-4d4b-95ab-b4bd91fbd6b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3e50579-6f5c-4280-a2dd-5f8782bb4417', 'volume_name': 'volume-f3e50579-6f5c-4280-a2dd-5f8782bb4417', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:40:41 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c40d8850-f93a-4b9b-abe9-17ee46ccf229 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7f8e09d-bb28-4dae-b196-ff0140bd228f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:40:41 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c40d8850-f93a-4b9b-abe9-17ee46ccf229 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7f8e09d-bb28-4dae-b196-ff0140bd228f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:40:41 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c40d8850-f93a-4b9b-abe9-17ee46ccf229 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (616f1a9b-e781-4ec2-bb2e-4c526398e100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:40:41 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-c40d8850-f93a-4b9b-abe9-17ee46ccf229 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Volume f3e50579-6f5c-4280-a2dd-5f8782bb4417: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3e50579-6f5c-4280-a2dd-5f8782bb4417', 'volume_size': 1} Apr 29 15:40:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-c40d8850-f93a-4b9b-abe9-17ee46ccf229 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:40:41 devstack sudo[111443]: pam_unix(sudo:session): session closed for user root Apr 29 15:40:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-b89e4a8e-8c4f-442d-ba0b-6fdc58e7cb26 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-47e03f06-0778-4915-aee1-413ef3c935ea 1073741824" returned: 0 in 0.841s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:40:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-b89e4a8e-8c4f-442d-ba0b-6fdc58e7cb26 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-47e03f06-0778-4915-aee1-413ef3c935ea {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:40:41 devstack sudo[111449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-47e03f06-0778-4915-aee1-413ef3c935ea Apr 29 15:40:41 devstack sudo[111449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:40:41 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-c187f2a4-cbd1-4ce0-b9ab-3c16444a00d0 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:40:41 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c187f2a4-cbd1-4ce0-b9ab-3c16444a00d0 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Flow 'volume_create_manager' (40fb1dcc-c15f-4751-a9e4-36b76dec994d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:40:41 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c187f2a4-cbd1-4ce0-b9ab-3c16444a00d0 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dc22263-5cc8-45d8-acc0-49f5eed34160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:40:42 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c187f2a4-cbd1-4ce0-b9ab-3c16444a00d0 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dc22263-5cc8-45d8-acc0-49f5eed34160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:40:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-13295317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f0b1eb7-d2b7-46ed-94e9-5bc502d3089a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efeba28e7e534fd791df5b8424662333',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:40:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:40:42Z,use_quota=True,user_id='45ed4d2736d14d2788c956eb5c0659a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:40:42 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c187f2a4-cbd1-4ce0-b9ab-3c16444a00d0 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fecca11-2a0c-4840-8916-ff586e8599e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:40:42 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c187f2a4-cbd1-4ce0-b9ab-3c16444a00d0 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fecca11-2a0c-4840-8916-ff586e8599e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:40:42 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c187f2a4-cbd1-4ce0-b9ab-3c16444a00d0 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (209b8c13-6af7-4049-841b-4dd144e5d2cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:40:42 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c187f2a4-cbd1-4ce0-b9ab-3c16444a00d0 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (209b8c13-6af7-4049-841b-4dd144e5d2cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f0b1eb7-d2b7-46ed-94e9-5bc502d3089a', 'volume_name': 'volume-2f0b1eb7-d2b7-46ed-94e9-5bc502d3089a', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:40:42 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c187f2a4-cbd1-4ce0-b9ab-3c16444a00d0 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23b8312a-be1a-4bdd-942b-b2acc787fc35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:40:42 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c187f2a4-cbd1-4ce0-b9ab-3c16444a00d0 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23b8312a-be1a-4bdd-942b-b2acc787fc35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:40:42 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c187f2a4-cbd1-4ce0-b9ab-3c16444a00d0 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86bd626b-6e57-46d5-a0b6-0f0cb74cd177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:40:42 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-c187f2a4-cbd1-4ce0-b9ab-3c16444a00d0 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Volume 2f0b1eb7-d2b7-46ed-94e9-5bc502d3089a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f0b1eb7-d2b7-46ed-94e9-5bc502d3089a', 'volume_size': 1} Apr 29 15:40:42 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-c187f2a4-cbd1-4ce0-b9ab-3c16444a00d0 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:40:42 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff806b9c-d409-445e-a881-e771851fc9a5 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:40:42 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-ff806b9c-d409-445e-a881-e771851fc9a5 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Flow 'volume_create_manager' (1797ef27-6c62-48ef-9473-1475e0bbee39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:40:42 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-ff806b9c-d409-445e-a881-e771851fc9a5 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (655bd3a0-deec-470c-b1d5-0917fc02807a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:40:42 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-ff806b9c-d409-445e-a881-e771851fc9a5 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (655bd3a0-deec-470c-b1d5-0917fc02807a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:40:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-183211345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3691df77-c1e0-414c-8264-152c88a02479,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efeba28e7e534fd791df5b8424662333',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:40:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:40:42Z,use_quota=True,user_id='45ed4d2736d14d2788c956eb5c0659a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:40:42 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-ff806b9c-d409-445e-a881-e771851fc9a5 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcc1ccc4-c162-409f-ae95-efb2c574ccb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:40:42 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-ff806b9c-d409-445e-a881-e771851fc9a5 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcc1ccc4-c162-409f-ae95-efb2c574ccb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:40:42 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-ff806b9c-d409-445e-a881-e771851fc9a5 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f743214f-d8e9-46f3-b4c5-450f77bf37a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:40:42 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-ff806b9c-d409-445e-a881-e771851fc9a5 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f743214f-d8e9-46f3-b4c5-450f77bf37a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3691df77-c1e0-414c-8264-152c88a02479', 'volume_name': 'volume-3691df77-c1e0-414c-8264-152c88a02479', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:40:42 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-ff806b9c-d409-445e-a881-e771851fc9a5 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcec078a-4f9a-40d2-aa94-4e9cec7d33e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:40:42 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-ff806b9c-d409-445e-a881-e771851fc9a5 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcec078a-4f9a-40d2-aa94-4e9cec7d33e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:40:42 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-ff806b9c-d409-445e-a881-e771851fc9a5 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6df3aed-1f2b-415c-8305-e0cfcf6da28d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:40:42 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-ff806b9c-d409-445e-a881-e771851fc9a5 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Volume 3691df77-c1e0-414c-8264-152c88a02479: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3691df77-c1e0-414c-8264-152c88a02479', 'volume_size': 1} Apr 29 15:40:42 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-ff806b9c-d409-445e-a881-e771851fc9a5 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:40:42 devstack sudo[111449]: pam_unix(sudo:session): session closed for user root Apr 29 15:40:42 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-b89e4a8e-8c4f-442d-ba0b-6fdc58e7cb26 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-47e03f06-0778-4915-aee1-413ef3c935ea" returned: 0 in 0.617s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:40:42 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-b89e4a8e-8c4f-442d-ba0b-6fdc58e7cb26 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] <== create_volume: return (1505ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:40:42 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-b89e4a8e-8c4f-442d-ba0b-6fdc58e7cb26 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.507s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:40:42 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-2c616507-1663-4f7b-b66d-1bec857a032e tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.202s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:40:42 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-2c616507-1663-4f7b-b66d-1bec857a032e tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:40:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1430616791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65ccc52b-8bb6-4731-afda-9286660b4ef4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efeba28e7e534fd791df5b8424662333',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:40:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:40:41Z,use_quota=True,user_id='45ed4d2736d14d2788c956eb5c0659a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:40:42 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-2c616507-1663-4f7b-b66d-1bec857a032e tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Creating volume 65ccc52b-8bb6-4731-afda-9286660b4ef4 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:40:42 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-2c616507-1663-4f7b-b66d-1bec857a032e tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:40:42 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-2c616507-1663-4f7b-b66d-1bec857a032e tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:40:42 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-2c616507-1663-4f7b-b66d-1bec857a032e tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:40:42 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-2c616507-1663-4f7b-b66d-1bec857a032e tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:40:42 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-2c616507-1663-4f7b-b66d-1bec857a032e tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:40:42 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-2c616507-1663-4f7b-b66d-1bec857a032e tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:40:42 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-2c616507-1663-4f7b-b66d-1bec857a032e tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:40:42 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-2c616507-1663-4f7b-b66d-1bec857a032e tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-65ccc52b-8bb6-4731-afda-9286660b4ef4 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:40:42 devstack sudo[111454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-65ccc52b-8bb6-4731-afda-9286660b4ef4 1073741824 Apr 29 15:40:42 devstack sudo[111454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:40:42 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b89e4a8e-8c4f-442d-ba0b-6fdc58e7cb26 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fd269de-b35b-4655-8b61-6f74fe602afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47e03f06-0778-4915-aee1-413ef3c935ea', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:40:42 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b89e4a8e-8c4f-442d-ba0b-6fdc58e7cb26 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5360e20e-dfb2-4f7d-bdf3-abfcdf5beff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:40:42 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-b89e4a8e-8c4f-442d-ba0b-6fdc58e7cb26 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Volume volume-47e03f06-0778-4915-aee1-413ef3c935ea (47e03f06-0778-4915-aee1-413ef3c935ea): created successfully Apr 29 15:40:42 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b89e4a8e-8c4f-442d-ba0b-6fdc58e7cb26 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5360e20e-dfb2-4f7d-bdf3-abfcdf5beff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:40:42 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-b89e4a8e-8c4f-442d-ba0b-6fdc58e7cb26 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Flow 'volume_create_manager' (30673902-8d4a-4a7d-95cc-13ce47491daf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:40:42 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-b89e4a8e-8c4f-442d-ba0b-6fdc58e7cb26 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Created volume successfully. Apr 29 15:40:43 devstack sudo[111454]: pam_unix(sudo:session): session closed for user root Apr 29 15:40:43 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-2c616507-1663-4f7b-b66d-1bec857a032e tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-65ccc52b-8bb6-4731-afda-9286660b4ef4 1073741824" returned: 0 in 0.787s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:40:43 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-2c616507-1663-4f7b-b66d-1bec857a032e tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-65ccc52b-8bb6-4731-afda-9286660b4ef4 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:40:43 devstack sudo[111460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-65ccc52b-8bb6-4731-afda-9286660b4ef4 Apr 29 15:40:43 devstack sudo[111460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:40:43 devstack sudo[111460]: pam_unix(sudo:session): session closed for user root Apr 29 15:40:43 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-2c616507-1663-4f7b-b66d-1bec857a032e tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-65ccc52b-8bb6-4731-afda-9286660b4ef4" returned: 0 in 0.600s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:40:43 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-2c616507-1663-4f7b-b66d-1bec857a032e tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] <== create_volume: return (1433ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:40:43 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-2c616507-1663-4f7b-b66d-1bec857a032e tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.436s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:40:43 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-c40d8850-f93a-4b9b-abe9-17ee46ccf229 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.266s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:40:43 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-c40d8850-f93a-4b9b-abe9-17ee46ccf229 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:40:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1890270931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3e50579-6f5c-4280-a2dd-5f8782bb4417,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efeba28e7e534fd791df5b8424662333',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:40:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:40:42Z,use_quota=True,user_id='45ed4d2736d14d2788c956eb5c0659a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:40:43 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-c40d8850-f93a-4b9b-abe9-17ee46ccf229 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Creating volume f3e50579-6f5c-4280-a2dd-5f8782bb4417 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:40:43 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-c40d8850-f93a-4b9b-abe9-17ee46ccf229 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:40:43 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-c40d8850-f93a-4b9b-abe9-17ee46ccf229 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:40:43 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-c40d8850-f93a-4b9b-abe9-17ee46ccf229 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:40:43 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-c40d8850-f93a-4b9b-abe9-17ee46ccf229 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:40:43 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-c40d8850-f93a-4b9b-abe9-17ee46ccf229 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:40:43 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-c40d8850-f93a-4b9b-abe9-17ee46ccf229 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:40:43 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-c40d8850-f93a-4b9b-abe9-17ee46ccf229 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:40:43 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c40d8850-f93a-4b9b-abe9-17ee46ccf229 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f3e50579-6f5c-4280-a2dd-5f8782bb4417 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:40:43 devstack sudo[111464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f3e50579-6f5c-4280-a2dd-5f8782bb4417 1073741824 Apr 29 15:40:44 devstack sudo[111464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:40:44 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-2c616507-1663-4f7b-b66d-1bec857a032e tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e856be53-2ba7-4f33-ab34-7a5e0ac0c7d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65ccc52b-8bb6-4731-afda-9286660b4ef4', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:40:44 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-2c616507-1663-4f7b-b66d-1bec857a032e tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2f08d5d-042e-45b2-9dbf-6cae3f0ab14e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:40:44 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-2c616507-1663-4f7b-b66d-1bec857a032e tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Volume volume-65ccc52b-8bb6-4731-afda-9286660b4ef4 (65ccc52b-8bb6-4731-afda-9286660b4ef4): created successfully Apr 29 15:40:44 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-2c616507-1663-4f7b-b66d-1bec857a032e tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2f08d5d-042e-45b2-9dbf-6cae3f0ab14e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:40:44 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-2c616507-1663-4f7b-b66d-1bec857a032e tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Flow 'volume_create_manager' (908edb72-04df-4260-a045-57de4618cb05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:40:44 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-2c616507-1663-4f7b-b66d-1bec857a032e tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Created volume successfully. Apr 29 15:40:44 devstack sudo[111464]: pam_unix(sudo:session): session closed for user root Apr 29 15:40:44 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c40d8850-f93a-4b9b-abe9-17ee46ccf229 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f3e50579-6f5c-4280-a2dd-5f8782bb4417 1073741824" returned: 0 in 0.769s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:40:44 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c40d8850-f93a-4b9b-abe9-17ee46ccf229 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f3e50579-6f5c-4280-a2dd-5f8782bb4417 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:40:44 devstack sudo[111470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f3e50579-6f5c-4280-a2dd-5f8782bb4417 Apr 29 15:40:44 devstack sudo[111470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:40:45 devstack sudo[111470]: pam_unix(sudo:session): session closed for user root Apr 29 15:40:45 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c40d8850-f93a-4b9b-abe9-17ee46ccf229 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f3e50579-6f5c-4280-a2dd-5f8782bb4417" returned: 0 in 0.568s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:40:45 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-c40d8850-f93a-4b9b-abe9-17ee46ccf229 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] <== create_volume: return (1373ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:40:45 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-c40d8850-f93a-4b9b-abe9-17ee46ccf229 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.376s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:40:45 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-c187f2a4-cbd1-4ce0-b9ab-3c16444a00d0 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.273s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:40:45 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-c187f2a4-cbd1-4ce0-b9ab-3c16444a00d0 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:40:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-13295317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f0b1eb7-d2b7-46ed-94e9-5bc502d3089a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efeba28e7e534fd791df5b8424662333',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:40:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:40:42Z,use_quota=True,user_id='45ed4d2736d14d2788c956eb5c0659a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:40:45 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-c187f2a4-cbd1-4ce0-b9ab-3c16444a00d0 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Creating volume 2f0b1eb7-d2b7-46ed-94e9-5bc502d3089a {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:40:45 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-c187f2a4-cbd1-4ce0-b9ab-3c16444a00d0 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:40:45 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-c187f2a4-cbd1-4ce0-b9ab-3c16444a00d0 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:40:45 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-c187f2a4-cbd1-4ce0-b9ab-3c16444a00d0 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:40:45 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-c187f2a4-cbd1-4ce0-b9ab-3c16444a00d0 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:40:45 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-c187f2a4-cbd1-4ce0-b9ab-3c16444a00d0 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:40:45 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-c187f2a4-cbd1-4ce0-b9ab-3c16444a00d0 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:40:45 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-c187f2a4-cbd1-4ce0-b9ab-3c16444a00d0 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:40:45 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c187f2a4-cbd1-4ce0-b9ab-3c16444a00d0 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2f0b1eb7-d2b7-46ed-94e9-5bc502d3089a 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:40:45 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c40d8850-f93a-4b9b-abe9-17ee46ccf229 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (616f1a9b-e781-4ec2-bb2e-4c526398e100) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3e50579-6f5c-4280-a2dd-5f8782bb4417', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:40:45 devstack sudo[111473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2f0b1eb7-d2b7-46ed-94e9-5bc502d3089a 1073741824 Apr 29 15:40:45 devstack sudo[111473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:40:45 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c40d8850-f93a-4b9b-abe9-17ee46ccf229 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adda5f30-3a3a-4293-891f-91e2c2849fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:40:45 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-c40d8850-f93a-4b9b-abe9-17ee46ccf229 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Volume volume-f3e50579-6f5c-4280-a2dd-5f8782bb4417 (f3e50579-6f5c-4280-a2dd-5f8782bb4417): created successfully Apr 29 15:40:45 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c40d8850-f93a-4b9b-abe9-17ee46ccf229 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adda5f30-3a3a-4293-891f-91e2c2849fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:40:45 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c40d8850-f93a-4b9b-abe9-17ee46ccf229 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Flow 'volume_create_manager' (52ce3161-a4c0-43d4-9893-a38f07c6d7e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:40:45 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-c40d8850-f93a-4b9b-abe9-17ee46ccf229 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Created volume successfully. Apr 29 15:40:46 devstack sudo[111473]: pam_unix(sudo:session): session closed for user root Apr 29 15:40:46 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c187f2a4-cbd1-4ce0-b9ab-3c16444a00d0 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2f0b1eb7-d2b7-46ed-94e9-5bc502d3089a 1073741824" returned: 0 in 0.745s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:40:46 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c187f2a4-cbd1-4ce0-b9ab-3c16444a00d0 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2f0b1eb7-d2b7-46ed-94e9-5bc502d3089a {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:40:46 devstack sudo[111478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2f0b1eb7-d2b7-46ed-94e9-5bc502d3089a Apr 29 15:40:46 devstack sudo[111478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:40:46 devstack sudo[111478]: pam_unix(sudo:session): session closed for user root Apr 29 15:40:46 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c187f2a4-cbd1-4ce0-b9ab-3c16444a00d0 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2f0b1eb7-d2b7-46ed-94e9-5bc502d3089a" returned: 0 in 0.596s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:40:46 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-c187f2a4-cbd1-4ce0-b9ab-3c16444a00d0 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] <== create_volume: return (1380ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:40:46 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-c187f2a4-cbd1-4ce0-b9ab-3c16444a00d0 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.384s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:40:46 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-ff806b9c-d409-445e-a881-e771851fc9a5 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.369s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:40:46 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-ff806b9c-d409-445e-a881-e771851fc9a5 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:40:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-183211345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3691df77-c1e0-414c-8264-152c88a02479,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efeba28e7e534fd791df5b8424662333',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:40:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:40:42Z,use_quota=True,user_id='45ed4d2736d14d2788c956eb5c0659a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:40:46 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-ff806b9c-d409-445e-a881-e771851fc9a5 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Creating volume 3691df77-c1e0-414c-8264-152c88a02479 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:40:46 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-ff806b9c-d409-445e-a881-e771851fc9a5 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:40:46 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-ff806b9c-d409-445e-a881-e771851fc9a5 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:40:46 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-ff806b9c-d409-445e-a881-e771851fc9a5 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:40:46 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-ff806b9c-d409-445e-a881-e771851fc9a5 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:40:46 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-ff806b9c-d409-445e-a881-e771851fc9a5 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:40:46 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-ff806b9c-d409-445e-a881-e771851fc9a5 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:40:46 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-ff806b9c-d409-445e-a881-e771851fc9a5 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:40:46 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ff806b9c-d409-445e-a881-e771851fc9a5 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3691df77-c1e0-414c-8264-152c88a02479 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:40:46 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c187f2a4-cbd1-4ce0-b9ab-3c16444a00d0 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86bd626b-6e57-46d5-a0b6-0f0cb74cd177) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f0b1eb7-d2b7-46ed-94e9-5bc502d3089a', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:40:46 devstack sudo[111482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3691df77-c1e0-414c-8264-152c88a02479 1073741824 Apr 29 15:40:46 devstack sudo[111482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:40:46 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c187f2a4-cbd1-4ce0-b9ab-3c16444a00d0 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e0611f5-e7b8-4c26-a093-ef32465ac94a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:40:46 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-c187f2a4-cbd1-4ce0-b9ab-3c16444a00d0 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Volume volume-2f0b1eb7-d2b7-46ed-94e9-5bc502d3089a (2f0b1eb7-d2b7-46ed-94e9-5bc502d3089a): created successfully Apr 29 15:40:46 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c187f2a4-cbd1-4ce0-b9ab-3c16444a00d0 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e0611f5-e7b8-4c26-a093-ef32465ac94a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:40:46 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-c187f2a4-cbd1-4ce0-b9ab-3c16444a00d0 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Flow 'volume_create_manager' (40fb1dcc-c15f-4751-a9e4-36b76dec994d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:40:46 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-c187f2a4-cbd1-4ce0-b9ab-3c16444a00d0 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Created volume successfully. Apr 29 15:40:47 devstack sudo[111482]: pam_unix(sudo:session): session closed for user root Apr 29 15:40:47 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ff806b9c-d409-445e-a881-e771851fc9a5 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3691df77-c1e0-414c-8264-152c88a02479 1073741824" returned: 0 in 0.786s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:40:47 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ff806b9c-d409-445e-a881-e771851fc9a5 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3691df77-c1e0-414c-8264-152c88a02479 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:40:47 devstack sudo[111487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3691df77-c1e0-414c-8264-152c88a02479 Apr 29 15:40:47 devstack sudo[111487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:40:48 devstack sudo[111487]: pam_unix(sudo:session): session closed for user root Apr 29 15:40:48 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ff806b9c-d409-445e-a881-e771851fc9a5 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3691df77-c1e0-414c-8264-152c88a02479" returned: 0 in 0.605s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:40:48 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-ff806b9c-d409-445e-a881-e771851fc9a5 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] <== create_volume: return (1430ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:40:48 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-ff806b9c-d409-445e-a881-e771851fc9a5 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.432s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:40:48 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-ff806b9c-d409-445e-a881-e771851fc9a5 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6df3aed-1f2b-415c-8305-e0cfcf6da28d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3691df77-c1e0-414c-8264-152c88a02479', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:40:48 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-ff806b9c-d409-445e-a881-e771851fc9a5 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3239e52d-b315-4a41-bf95-c706edde1cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:40:48 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-ff806b9c-d409-445e-a881-e771851fc9a5 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Volume volume-3691df77-c1e0-414c-8264-152c88a02479 (3691df77-c1e0-414c-8264-152c88a02479): created successfully Apr 29 15:40:48 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-ff806b9c-d409-445e-a881-e771851fc9a5 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3239e52d-b315-4a41-bf95-c706edde1cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:40:48 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-ff806b9c-d409-445e-a881-e771851fc9a5 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Flow 'volume_create_manager' (1797ef27-6c62-48ef-9473-1475e0bbee39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:40:48 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-ff806b9c-d409-445e-a881-e771851fc9a5 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Created volume successfully. Apr 29 15:40:48 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-f156e924-88be-489e-8f49-cf3ba44d9eee tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Acquiring lock "cinder-3691df77-c1e0-414c-8264-152c88a02479-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:40:48 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-f156e924-88be-489e-8f49-cf3ba44d9eee tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Lock "cinder-3691df77-c1e0-414c-8264-152c88a02479-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:40:48 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-f156e924-88be-489e-8f49-cf3ba44d9eee tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Acquiring lock "cinder-quobyte-3691df77-c1e0-414c-8264-152c88a02479" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:40:48 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-f156e924-88be-489e-8f49-cf3ba44d9eee tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Lock "cinder-quobyte-3691df77-c1e0-414c-8264-152c88a02479" acquired by "delete_volume" :: waited 0.013s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:40:48 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dcdd9c2-f926-4b32-8bf9-971afd10dbd1]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:40:48 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f156e924-88be-489e-8f49-cf3ba44d9eee tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3691df77-c1e0-414c-8264-152c88a02479 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:40:49 devstack sudo[111490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3691df77-c1e0-414c-8264-152c88a02479 Apr 29 15:40:49 devstack sudo[111490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:40:49 devstack sudo[111490]: pam_unix(sudo:session): session closed for user root Apr 29 15:40:49 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f156e924-88be-489e-8f49-cf3ba44d9eee tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3691df77-c1e0-414c-8264-152c88a02479" returned: 0 in 0.696s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:40:49 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f156e924-88be-489e-8f49-cf3ba44d9eee tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3691df77-c1e0-414c-8264-152c88a02479 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:40:49 devstack sudo[111495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3691df77-c1e0-414c-8264-152c88a02479 Apr 29 15:40:49 devstack sudo[111495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:40:50 devstack sudo[111495]: pam_unix(sudo:session): session closed for user root Apr 29 15:40:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f156e924-88be-489e-8f49-cf3ba44d9eee tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3691df77-c1e0-414c-8264-152c88a02479" returned: 0 in 0.599s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:40:50 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-f156e924-88be-489e-8f49-cf3ba44d9eee tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Lock "cinder-quobyte-3691df77-c1e0-414c-8264-152c88a02479" released by "delete_volume" :: held 1.332s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:40:50 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-f156e924-88be-489e-8f49-cf3ba44d9eee tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Created reservations ['1b9568db-077f-47d5-9813-fdc6ae4b8b00', '9e4615b6-dd70-48ed-9f99-920f897ddcd9', '34580a53-ee51-4934-801b-b2d82d555bc3', '28a76df1-c27c-4187-9a24-df97f5379cd8'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:40:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-f156e924-88be-489e-8f49-cf3ba44d9eee tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:40:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-f156e924-88be-489e-8f49-cf3ba44d9eee tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:40:50 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-f156e924-88be-489e-8f49-cf3ba44d9eee tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:40:50 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-f156e924-88be-489e-8f49-cf3ba44d9eee tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:40:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-f156e924-88be-489e-8f49-cf3ba44d9eee tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:40:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f156e924-88be-489e-8f49-cf3ba44d9eee tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:40:50 devstack sudo[111498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:40:50 devstack sudo[111498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:40:50 devstack sudo[111498]: pam_unix(sudo:session): session closed for user root Apr 29 15:40:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f156e924-88be-489e-8f49-cf3ba44d9eee tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.582s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:40:50 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-f156e924-88be-489e-8f49-cf3ba44d9eee tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:40:50 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-f156e924-88be-489e-8f49-cf3ba44d9eee tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Deleted volume successfully. Apr 29 15:40:50 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-f156e924-88be-489e-8f49-cf3ba44d9eee tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Lock "cinder-3691df77-c1e0-414c-8264-152c88a02479-delete_volume" released by "delete_volume" :: held 2.089s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:40:51 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-6b35b009-5f4f-4beb-ad4a-7eec9f35d031 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Acquiring lock "cinder-2f0b1eb7-d2b7-46ed-94e9-5bc502d3089a-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:40:51 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-6b35b009-5f4f-4beb-ad4a-7eec9f35d031 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Lock "cinder-2f0b1eb7-d2b7-46ed-94e9-5bc502d3089a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:40:51 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-6b35b009-5f4f-4beb-ad4a-7eec9f35d031 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Acquiring lock "cinder-quobyte-2f0b1eb7-d2b7-46ed-94e9-5bc502d3089a" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:40:51 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-6b35b009-5f4f-4beb-ad4a-7eec9f35d031 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Lock "cinder-quobyte-2f0b1eb7-d2b7-46ed-94e9-5bc502d3089a" acquired by "delete_volume" :: waited 0.014s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:40:51 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aca07a5-437a-4fb4-a906-464b18b24825]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:40:51 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6b35b009-5f4f-4beb-ad4a-7eec9f35d031 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2f0b1eb7-d2b7-46ed-94e9-5bc502d3089a {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:40:51 devstack sudo[111501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2f0b1eb7-d2b7-46ed-94e9-5bc502d3089a Apr 29 15:40:51 devstack sudo[111501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:40:51 devstack sudo[111501]: pam_unix(sudo:session): session closed for user root Apr 29 15:40:51 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6b35b009-5f4f-4beb-ad4a-7eec9f35d031 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2f0b1eb7-d2b7-46ed-94e9-5bc502d3089a" returned: 0 in 0.701s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:40:51 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6b35b009-5f4f-4beb-ad4a-7eec9f35d031 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2f0b1eb7-d2b7-46ed-94e9-5bc502d3089a {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:40:51 devstack sudo[111506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2f0b1eb7-d2b7-46ed-94e9-5bc502d3089a Apr 29 15:40:51 devstack sudo[111506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:40:52 devstack sudo[111506]: pam_unix(sudo:session): session closed for user root Apr 29 15:40:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6b35b009-5f4f-4beb-ad4a-7eec9f35d031 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2f0b1eb7-d2b7-46ed-94e9-5bc502d3089a" returned: 0 in 0.593s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:40:52 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-6b35b009-5f4f-4beb-ad4a-7eec9f35d031 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Lock "cinder-quobyte-2f0b1eb7-d2b7-46ed-94e9-5bc502d3089a" released by "delete_volume" :: held 1.347s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:40:52 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-6b35b009-5f4f-4beb-ad4a-7eec9f35d031 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Created reservations ['35676759-2dd0-4fab-8f0f-60973e9d1cb9', '33d404dd-7eae-4d83-9223-42284507b8d2', 'a39b4155-aeb2-4be1-851a-993294222201', '65b2bba8-7e2c-4115-948f-66f3c2af975b'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:40:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-6b35b009-5f4f-4beb-ad4a-7eec9f35d031 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:40:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-6b35b009-5f4f-4beb-ad4a-7eec9f35d031 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:40:52 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-6b35b009-5f4f-4beb-ad4a-7eec9f35d031 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:40:52 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-6b35b009-5f4f-4beb-ad4a-7eec9f35d031 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:40:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-6b35b009-5f4f-4beb-ad4a-7eec9f35d031 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:40:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6b35b009-5f4f-4beb-ad4a-7eec9f35d031 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:40:52 devstack sudo[111509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:40:52 devstack sudo[111509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:40:53 devstack sudo[111509]: pam_unix(sudo:session): session closed for user root Apr 29 15:40:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6b35b009-5f4f-4beb-ad4a-7eec9f35d031 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.594s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:40:53 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-6b35b009-5f4f-4beb-ad4a-7eec9f35d031 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:40:53 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-6b35b009-5f4f-4beb-ad4a-7eec9f35d031 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Deleted volume successfully. Apr 29 15:40:53 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-6b35b009-5f4f-4beb-ad4a-7eec9f35d031 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Lock "cinder-2f0b1eb7-d2b7-46ed-94e9-5bc502d3089a-delete_volume" released by "delete_volume" :: held 2.125s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:40:53 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-d8254cd0-4b1e-4a67-afca-1e4adcef3868 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Acquiring lock "cinder-f3e50579-6f5c-4280-a2dd-5f8782bb4417-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:40:53 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-d8254cd0-4b1e-4a67-afca-1e4adcef3868 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Lock "cinder-f3e50579-6f5c-4280-a2dd-5f8782bb4417-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:40:53 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-d8254cd0-4b1e-4a67-afca-1e4adcef3868 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Acquiring lock "cinder-quobyte-f3e50579-6f5c-4280-a2dd-5f8782bb4417" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:40:53 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-d8254cd0-4b1e-4a67-afca-1e4adcef3868 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Lock "cinder-quobyte-f3e50579-6f5c-4280-a2dd-5f8782bb4417" acquired by "delete_volume" :: waited 0.014s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:40:53 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[d08dc27b-faab-47f0-ba37-a40099ea49c7]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:40:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-d8254cd0-4b1e-4a67-afca-1e4adcef3868 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f3e50579-6f5c-4280-a2dd-5f8782bb4417 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:40:53 devstack sudo[111512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f3e50579-6f5c-4280-a2dd-5f8782bb4417 Apr 29 15:40:53 devstack sudo[111512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:40:54 devstack sudo[111512]: pam_unix(sudo:session): session closed for user root Apr 29 15:40:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-d8254cd0-4b1e-4a67-afca-1e4adcef3868 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f3e50579-6f5c-4280-a2dd-5f8782bb4417" returned: 0 in 0.698s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:40:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-d8254cd0-4b1e-4a67-afca-1e4adcef3868 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f3e50579-6f5c-4280-a2dd-5f8782bb4417 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:40:54 devstack sudo[111517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f3e50579-6f5c-4280-a2dd-5f8782bb4417 Apr 29 15:40:54 devstack sudo[111517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:40:54 devstack sudo[111517]: pam_unix(sudo:session): session closed for user root Apr 29 15:40:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-d8254cd0-4b1e-4a67-afca-1e4adcef3868 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-f3e50579-6f5c-4280-a2dd-5f8782bb4417" returned: 0 in 0.583s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:40:54 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-d8254cd0-4b1e-4a67-afca-1e4adcef3868 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Lock "cinder-quobyte-f3e50579-6f5c-4280-a2dd-5f8782bb4417" released by "delete_volume" :: held 1.327s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:40:54 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-d8254cd0-4b1e-4a67-afca-1e4adcef3868 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Created reservations ['dc10d6ab-15e0-409d-8d47-a00ba1e1e0f6', '292e53fe-87ec-43e2-b078-3097b21b49ec', '7676b01e-f922-4eef-a5c5-5f2a468c3a20', 'beda2343-0721-4342-a98e-6686c112fbe4'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:40:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-d8254cd0-4b1e-4a67-afca-1e4adcef3868 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:40:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-d8254cd0-4b1e-4a67-afca-1e4adcef3868 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:40:54 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-d8254cd0-4b1e-4a67-afca-1e4adcef3868 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:40:54 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-d8254cd0-4b1e-4a67-afca-1e4adcef3868 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:40:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-d8254cd0-4b1e-4a67-afca-1e4adcef3868 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:40:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-d8254cd0-4b1e-4a67-afca-1e4adcef3868 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:40:54 devstack sudo[111520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:40:54 devstack sudo[111520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:40:55 devstack sudo[111520]: pam_unix(sudo:session): session closed for user root Apr 29 15:40:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-d8254cd0-4b1e-4a67-afca-1e4adcef3868 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.574s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:40:55 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-d8254cd0-4b1e-4a67-afca-1e4adcef3868 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:40:55 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-d8254cd0-4b1e-4a67-afca-1e4adcef3868 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Deleted volume successfully. Apr 29 15:40:55 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-d8254cd0-4b1e-4a67-afca-1e4adcef3868 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Lock "cinder-f3e50579-6f5c-4280-a2dd-5f8782bb4417-delete_volume" released by "delete_volume" :: held 2.085s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:40:55 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-21282944-2d08-4406-9add-d6ca1a8739f4 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Acquiring lock "cinder-65ccc52b-8bb6-4731-afda-9286660b4ef4-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:40:55 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-21282944-2d08-4406-9add-d6ca1a8739f4 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Lock "cinder-65ccc52b-8bb6-4731-afda-9286660b4ef4-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:40:55 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-21282944-2d08-4406-9add-d6ca1a8739f4 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Acquiring lock "cinder-quobyte-65ccc52b-8bb6-4731-afda-9286660b4ef4" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:40:55 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-21282944-2d08-4406-9add-d6ca1a8739f4 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Lock "cinder-quobyte-65ccc52b-8bb6-4731-afda-9286660b4ef4" acquired by "delete_volume" :: waited 0.017s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:40:55 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[0420e50e-cb47-4282-bead-c179edaf6a85]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:40:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-21282944-2d08-4406-9add-d6ca1a8739f4 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-65ccc52b-8bb6-4731-afda-9286660b4ef4 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:40:55 devstack sudo[111523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-65ccc52b-8bb6-4731-afda-9286660b4ef4 Apr 29 15:40:55 devstack sudo[111523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:40:56 devstack sudo[111523]: pam_unix(sudo:session): session closed for user root Apr 29 15:40:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-21282944-2d08-4406-9add-d6ca1a8739f4 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-65ccc52b-8bb6-4731-afda-9286660b4ef4" returned: 0 in 0.695s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:40:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-21282944-2d08-4406-9add-d6ca1a8739f4 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-65ccc52b-8bb6-4731-afda-9286660b4ef4 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:40:56 devstack sudo[111529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-65ccc52b-8bb6-4731-afda-9286660b4ef4 Apr 29 15:40:56 devstack sudo[111529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:40:56 devstack sudo[111529]: pam_unix(sudo:session): session closed for user root Apr 29 15:40:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-21282944-2d08-4406-9add-d6ca1a8739f4 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-65ccc52b-8bb6-4731-afda-9286660b4ef4" returned: 0 in 0.591s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:40:56 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-21282944-2d08-4406-9add-d6ca1a8739f4 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Lock "cinder-quobyte-65ccc52b-8bb6-4731-afda-9286660b4ef4" released by "delete_volume" :: held 1.324s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:40:56 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-21282944-2d08-4406-9add-d6ca1a8739f4 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Created reservations ['4de1476f-c92d-4859-a71e-483c93754aec', 'eb91b929-0ffe-4315-8898-2f8a9c354eed', '3b22c601-7ed3-4a5b-88a2-9f8c57210026', '3557a9ae-ae08-4821-9fe3-1db1456107da'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:40:57 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-21282944-2d08-4406-9add-d6ca1a8739f4 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:40:57 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-21282944-2d08-4406-9add-d6ca1a8739f4 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:40:57 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-21282944-2d08-4406-9add-d6ca1a8739f4 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:40:57 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-21282944-2d08-4406-9add-d6ca1a8739f4 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:40:57 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-21282944-2d08-4406-9add-d6ca1a8739f4 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:40:57 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-21282944-2d08-4406-9add-d6ca1a8739f4 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:40:57 devstack sudo[111532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:40:57 devstack sudo[111532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:40:57 devstack sudo[111532]: pam_unix(sudo:session): session closed for user root Apr 29 15:40:57 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-21282944-2d08-4406-9add-d6ca1a8739f4 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.574s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:40:57 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-21282944-2d08-4406-9add-d6ca1a8739f4 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:40:57 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-21282944-2d08-4406-9add-d6ca1a8739f4 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Deleted volume successfully. Apr 29 15:40:57 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-21282944-2d08-4406-9add-d6ca1a8739f4 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Lock "cinder-65ccc52b-8bb6-4731-afda-9286660b4ef4-delete_volume" released by "delete_volume" :: held 2.091s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:40:57 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-28040bce-f17c-446a-b64b-5b8b60628704 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Acquiring lock "cinder-47e03f06-0778-4915-aee1-413ef3c935ea-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:40:57 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-28040bce-f17c-446a-b64b-5b8b60628704 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Lock "cinder-47e03f06-0778-4915-aee1-413ef3c935ea-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:40:57 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-28040bce-f17c-446a-b64b-5b8b60628704 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Acquiring lock "cinder-quobyte-47e03f06-0778-4915-aee1-413ef3c935ea" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:40:57 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-28040bce-f17c-446a-b64b-5b8b60628704 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Lock "cinder-quobyte-47e03f06-0778-4915-aee1-413ef3c935ea" acquired by "delete_volume" :: waited 0.015s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:40:57 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed5c4171-1d32-45fe-bc2e-47867f2a6697]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:40:57 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-28040bce-f17c-446a-b64b-5b8b60628704 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-47e03f06-0778-4915-aee1-413ef3c935ea {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:40:57 devstack sudo[111535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-47e03f06-0778-4915-aee1-413ef3c935ea Apr 29 15:40:57 devstack sudo[111535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:40:58 devstack sudo[111535]: pam_unix(sudo:session): session closed for user root Apr 29 15:40:58 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-28040bce-f17c-446a-b64b-5b8b60628704 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-47e03f06-0778-4915-aee1-413ef3c935ea" returned: 0 in 0.722s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:40:58 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-28040bce-f17c-446a-b64b-5b8b60628704 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-47e03f06-0778-4915-aee1-413ef3c935ea {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:40:58 devstack sudo[111541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-47e03f06-0778-4915-aee1-413ef3c935ea Apr 29 15:40:58 devstack sudo[111541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:40:59 devstack sudo[111541]: pam_unix(sudo:session): session closed for user root Apr 29 15:40:59 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-28040bce-f17c-446a-b64b-5b8b60628704 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-47e03f06-0778-4915-aee1-413ef3c935ea" returned: 0 in 0.608s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:40:59 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-28040bce-f17c-446a-b64b-5b8b60628704 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Lock "cinder-quobyte-47e03f06-0778-4915-aee1-413ef3c935ea" released by "delete_volume" :: held 1.370s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:40:59 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-28040bce-f17c-446a-b64b-5b8b60628704 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Created reservations ['997944a0-b82e-490f-ae97-de0e4f8e5854', '68244638-fabd-402f-9d5e-6d6b99569e7e', '1c64f85e-9606-42e8-a65e-61e1b20508ea', '95242971-a636-405e-949c-b145474be57e'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:40:59 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-28040bce-f17c-446a-b64b-5b8b60628704 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:40:59 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-28040bce-f17c-446a-b64b-5b8b60628704 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:40:59 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-28040bce-f17c-446a-b64b-5b8b60628704 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:40:59 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-28040bce-f17c-446a-b64b-5b8b60628704 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:40:59 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-28040bce-f17c-446a-b64b-5b8b60628704 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:40:59 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-28040bce-f17c-446a-b64b-5b8b60628704 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:40:59 devstack sudo[111545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:40:59 devstack sudo[111545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:40:59 devstack sudo[111545]: pam_unix(sudo:session): session closed for user root Apr 29 15:40:59 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-28040bce-f17c-446a-b64b-5b8b60628704 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.586s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:40:59 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-28040bce-f17c-446a-b64b-5b8b60628704 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:40:59 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-28040bce-f17c-446a-b64b-5b8b60628704 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Deleted volume successfully. Apr 29 15:40:59 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-28040bce-f17c-446a-b64b-5b8b60628704 tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Lock "cinder-47e03f06-0778-4915-aee1-413ef3c935ea-delete_volume" released by "delete_volume" :: held 2.148s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:40:59 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-42ce3a6d-3aa6-4b91-a364-b9e886644a5c tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Acquiring lock "cinder-61db0a81-141b-4282-b9b6-5242707562c3-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:40:59 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-42ce3a6d-3aa6-4b91-a364-b9e886644a5c tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Lock "cinder-61db0a81-141b-4282-b9b6-5242707562c3-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:41:00 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-42ce3a6d-3aa6-4b91-a364-b9e886644a5c tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Acquiring lock "cinder-quobyte-61db0a81-141b-4282-b9b6-5242707562c3" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:41:00 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-42ce3a6d-3aa6-4b91-a364-b9e886644a5c tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Lock "cinder-quobyte-61db0a81-141b-4282-b9b6-5242707562c3" acquired by "delete_volume" :: waited 0.015s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:41:00 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[f188d0ab-62dc-458a-81f4-c5eb3c99fc49]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:41:00 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-42ce3a6d-3aa6-4b91-a364-b9e886644a5c tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-61db0a81-141b-4282-b9b6-5242707562c3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:00 devstack sudo[111548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-61db0a81-141b-4282-b9b6-5242707562c3 Apr 29 15:41:00 devstack sudo[111548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:00 devstack sudo[111548]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:00 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-42ce3a6d-3aa6-4b91-a364-b9e886644a5c tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-61db0a81-141b-4282-b9b6-5242707562c3" returned: 0 in 0.709s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:00 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-42ce3a6d-3aa6-4b91-a364-b9e886644a5c tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-61db0a81-141b-4282-b9b6-5242707562c3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:00 devstack sudo[111553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-61db0a81-141b-4282-b9b6-5242707562c3 Apr 29 15:41:00 devstack sudo[111553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:01 devstack sudo[111553]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-42ce3a6d-3aa6-4b91-a364-b9e886644a5c tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-61db0a81-141b-4282-b9b6-5242707562c3" returned: 0 in 0.592s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:01 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-42ce3a6d-3aa6-4b91-a364-b9e886644a5c tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Lock "cinder-quobyte-61db0a81-141b-4282-b9b6-5242707562c3" released by "delete_volume" :: held 1.347s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:41:01 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-42ce3a6d-3aa6-4b91-a364-b9e886644a5c tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Created reservations ['5e30a7c3-ddae-4250-bcf6-d0ea6abb94e4', '1191b0b8-6b16-45ff-b054-b3960f61ec32', '9b0b764f-1fb3-4309-8618-6b376381ded6', 'bfd1ab59-3fd6-4892-9e1c-76bbe7da5004'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:41:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-42ce3a6d-3aa6-4b91-a364-b9e886644a5c tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:41:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-42ce3a6d-3aa6-4b91-a364-b9e886644a5c tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:41:01 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-42ce3a6d-3aa6-4b91-a364-b9e886644a5c tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:41:01 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-42ce3a6d-3aa6-4b91-a364-b9e886644a5c tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:41:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-42ce3a6d-3aa6-4b91-a364-b9e886644a5c tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:41:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-42ce3a6d-3aa6-4b91-a364-b9e886644a5c tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:01 devstack sudo[111556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:41:01 devstack sudo[111556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:02 devstack sudo[111556]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:02 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-42ce3a6d-3aa6-4b91-a364-b9e886644a5c tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.584s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:02 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-42ce3a6d-3aa6-4b91-a364-b9e886644a5c tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:41:02 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-42ce3a6d-3aa6-4b91-a364-b9e886644a5c tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Deleted volume successfully. Apr 29 15:41:02 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-42ce3a6d-3aa6-4b91-a364-b9e886644a5c tempest-CreateVolumesFromSourceVolumeTest-1731901601 None] Lock "cinder-61db0a81-141b-4282-b9b6-5242707562c3-delete_volume" released by "delete_volume" :: held 2.115s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:41:11 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:SELECT=48,cinder:INSERT=17,cinder:UPDATE=69,cinder:DELETE=4 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:41:12 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:UPDATE=70,cinder:SELECT=41,cinder:INSERT=15,cinder:DELETE=9 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:41:14 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-cca74337-5859-4dd6-91aa-9d4f38f61d29 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:41:14 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cca74337-5859-4dd6-91aa-9d4f38f61d29 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Flow 'volume_create_manager' (4cc3026b-9176-48a6-820a-b4d8234c6bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:41:14 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cca74337-5859-4dd6-91aa-9d4f38f61d29 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (229b7543-b33c-4402-b609-66fab2e39d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:14 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cca74337-5859-4dd6-91aa-9d4f38f61d29 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (229b7543-b33c-4402-b609-66fab2e39d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:41:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1417878106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19d55b30-8e91-4780-80f8-e391711ccbf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e6c1e909d4b4ca39ad93d5e4b6a34e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:41:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:41:14Z,use_quota=True,user_id='eee87ab7247540bab787424726812dc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:14 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cca74337-5859-4dd6-91aa-9d4f38f61d29 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9de319e-dbd5-48a0-9b5e-4a6a16d3b1e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:14 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cca74337-5859-4dd6-91aa-9d4f38f61d29 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9de319e-dbd5-48a0-9b5e-4a6a16d3b1e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:14 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cca74337-5859-4dd6-91aa-9d4f38f61d29 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f421a9b-ef04-404c-8252-10ad4193b404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:14 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cca74337-5859-4dd6-91aa-9d4f38f61d29 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f421a9b-ef04-404c-8252-10ad4193b404) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19d55b30-8e91-4780-80f8-e391711ccbf0', 'volume_name': 'volume-19d55b30-8e91-4780-80f8-e391711ccbf0', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:14 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cca74337-5859-4dd6-91aa-9d4f38f61d29 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae06be31-9c2a-41f3-b36e-e43bba1f167e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:14 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cca74337-5859-4dd6-91aa-9d4f38f61d29 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae06be31-9c2a-41f3-b36e-e43bba1f167e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:14 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cca74337-5859-4dd6-91aa-9d4f38f61d29 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4a77c7a-0828-443f-a7ef-f2efdd44f5a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:14 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-cca74337-5859-4dd6-91aa-9d4f38f61d29 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Volume 19d55b30-8e91-4780-80f8-e391711ccbf0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19d55b30-8e91-4780-80f8-e391711ccbf0', 'volume_size': 1} Apr 29 15:41:14 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-cca74337-5859-4dd6-91aa-9d4f38f61d29 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:41:14 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-cca74337-5859-4dd6-91aa-9d4f38f61d29 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:41:14 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-cca74337-5859-4dd6-91aa-9d4f38f61d29 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:41:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1417878106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19d55b30-8e91-4780-80f8-e391711ccbf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e6c1e909d4b4ca39ad93d5e4b6a34e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:41:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:41:14Z,use_quota=True,user_id='eee87ab7247540bab787424726812dc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:41:14 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-cca74337-5859-4dd6-91aa-9d4f38f61d29 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Creating volume 19d55b30-8e91-4780-80f8-e391711ccbf0 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:41:14 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-cca74337-5859-4dd6-91aa-9d4f38f61d29 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:41:14 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-cca74337-5859-4dd6-91aa-9d4f38f61d29 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:41:14 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-cca74337-5859-4dd6-91aa-9d4f38f61d29 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:41:14 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-cca74337-5859-4dd6-91aa-9d4f38f61d29 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:41:14 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-cca74337-5859-4dd6-91aa-9d4f38f61d29 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:41:14 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-cca74337-5859-4dd6-91aa-9d4f38f61d29 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:41:14 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-cca74337-5859-4dd6-91aa-9d4f38f61d29 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:41:14 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cca74337-5859-4dd6-91aa-9d4f38f61d29 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-19d55b30-8e91-4780-80f8-e391711ccbf0 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:14 devstack sudo[111598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-19d55b30-8e91-4780-80f8-e391711ccbf0 1073741824 Apr 29 15:41:14 devstack sudo[111598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:14 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c6fb51d-7531-4ca5-8a03-8cad46c1c1b0 tempest-CreateVolumesFromImageTest-79148926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:41:14 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4c6fb51d-7531-4ca5-8a03-8cad46c1c1b0 tempest-CreateVolumesFromImageTest-79148926 None] Flow 'volume_create_manager' (1fbacb56-a3dd-40bf-a11e-91ac3abe50b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:41:14 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4c6fb51d-7531-4ca5-8a03-8cad46c1c1b0 tempest-CreateVolumesFromImageTest-79148926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7401fe08-a790-40d6-a6d3-8b637733cba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:14 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4c6fb51d-7531-4ca5-8a03-8cad46c1c1b0 tempest-CreateVolumesFromImageTest-79148926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7401fe08-a790-40d6-a6d3-8b637733cba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:41:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-676727387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b71aeaf-7bc3-4710-a36b-5c72145660a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b202cc22c5e43109541afb133c26682',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:41:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:41:15Z,use_quota=True,user_id='154e1811faf34ef487e547afeebbf63d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:14 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4c6fb51d-7531-4ca5-8a03-8cad46c1c1b0 tempest-CreateVolumesFromImageTest-79148926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd86152c-e5fe-4c52-b2e4-35f9bdb68644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:14 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4c6fb51d-7531-4ca5-8a03-8cad46c1c1b0 tempest-CreateVolumesFromImageTest-79148926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd86152c-e5fe-4c52-b2e4-35f9bdb68644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:14 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4c6fb51d-7531-4ca5-8a03-8cad46c1c1b0 tempest-CreateVolumesFromImageTest-79148926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04c91122-5c4b-40ef-8227-6219274bf90a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:14 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4c6fb51d-7531-4ca5-8a03-8cad46c1c1b0 tempest-CreateVolumesFromImageTest-79148926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04c91122-5c4b-40ef-8227-6219274bf90a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b71aeaf-7bc3-4710-a36b-5c72145660a1', 'volume_name': 'volume-2b71aeaf-7bc3-4710-a36b-5c72145660a1', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:14 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4c6fb51d-7531-4ca5-8a03-8cad46c1c1b0 tempest-CreateVolumesFromImageTest-79148926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c8e3139-53df-4d24-a43c-7077afdf96f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:14 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4c6fb51d-7531-4ca5-8a03-8cad46c1c1b0 tempest-CreateVolumesFromImageTest-79148926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c8e3139-53df-4d24-a43c-7077afdf96f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:15 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4c6fb51d-7531-4ca5-8a03-8cad46c1c1b0 tempest-CreateVolumesFromImageTest-79148926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08c7e367-3abb-4d7c-9665-7f29968e9239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:15 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-4c6fb51d-7531-4ca5-8a03-8cad46c1c1b0 tempest-CreateVolumesFromImageTest-79148926 None] Volume 2b71aeaf-7bc3-4710-a36b-5c72145660a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b71aeaf-7bc3-4710-a36b-5c72145660a1', 'volume_size': 1} Apr 29 15:41:15 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-4c6fb51d-7531-4ca5-8a03-8cad46c1c1b0 tempest-CreateVolumesFromImageTest-79148926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:41:15 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-93be2287-c77c-402c-9e21-b801d35ab54f tempest-VolumeDependencyTests-347675874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:41:15 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-93be2287-c77c-402c-9e21-b801d35ab54f tempest-VolumeDependencyTests-347675874 None] Flow 'volume_create_manager' (8ec289d7-d6ea-45a2-9931-d4560a3bf304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:41:15 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-93be2287-c77c-402c-9e21-b801d35ab54f tempest-VolumeDependencyTests-347675874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ac9a936-115b-4196-993e-de4564bd8077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:15 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-93be2287-c77c-402c-9e21-b801d35ab54f tempest-VolumeDependencyTests-347675874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ac9a936-115b-4196-993e-de4564bd8077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:41:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-875684722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=125a8290-20d5-4d49-b9e0-6b57d70322f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aeb81c62ac284048b36f567290e59d0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:41:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:41:15Z,use_quota=True,user_id='5f2f077a45ee40b48b1d0833faeef45f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:15 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-93be2287-c77c-402c-9e21-b801d35ab54f tempest-VolumeDependencyTests-347675874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09f76efc-5564-4d9e-8236-c096bcc258a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:15 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-93be2287-c77c-402c-9e21-b801d35ab54f tempest-VolumeDependencyTests-347675874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09f76efc-5564-4d9e-8236-c096bcc258a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:15 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-93be2287-c77c-402c-9e21-b801d35ab54f tempest-VolumeDependencyTests-347675874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3ea004e-1d8f-422f-ab93-fac08a29a2a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:15 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-93be2287-c77c-402c-9e21-b801d35ab54f tempest-VolumeDependencyTests-347675874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3ea004e-1d8f-422f-ab93-fac08a29a2a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '125a8290-20d5-4d49-b9e0-6b57d70322f4', 'volume_name': 'volume-125a8290-20d5-4d49-b9e0-6b57d70322f4', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:15 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-93be2287-c77c-402c-9e21-b801d35ab54f tempest-VolumeDependencyTests-347675874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (986612f0-c078-4bbe-a400-3d2dfb789990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:15 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-93be2287-c77c-402c-9e21-b801d35ab54f tempest-VolumeDependencyTests-347675874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (986612f0-c078-4bbe-a400-3d2dfb789990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:15 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-93be2287-c77c-402c-9e21-b801d35ab54f tempest-VolumeDependencyTests-347675874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2d9cb93-49d6-472c-8070-e24e1abfe067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:15 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-93be2287-c77c-402c-9e21-b801d35ab54f tempest-VolumeDependencyTests-347675874 None] Volume 125a8290-20d5-4d49-b9e0-6b57d70322f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-125a8290-20d5-4d49-b9e0-6b57d70322f4', 'volume_size': 1} Apr 29 15:41:15 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-93be2287-c77c-402c-9e21-b801d35ab54f tempest-VolumeDependencyTests-347675874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:41:15 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-134cc282-5353-474e-8b6d-788dd78afc2f tempest-CreateVolumesFromImageTest-79148926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:41:15 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-134cc282-5353-474e-8b6d-788dd78afc2f tempest-CreateVolumesFromImageTest-79148926 None] Flow 'volume_create_manager' (e0b4f69b-dc23-4c50-9f02-af43a281c70f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:41:15 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-134cc282-5353-474e-8b6d-788dd78afc2f tempest-CreateVolumesFromImageTest-79148926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58e40198-aecf-409b-a1c5-7e9a2e2123dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:15 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-134cc282-5353-474e-8b6d-788dd78afc2f tempest-CreateVolumesFromImageTest-79148926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58e40198-aecf-409b-a1c5-7e9a2e2123dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:41:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1337520649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fbe3557-c97f-4d19-84de-051acd42c362,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b202cc22c5e43109541afb133c26682',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:41:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:41:15Z,use_quota=True,user_id='154e1811faf34ef487e547afeebbf63d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:15 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-134cc282-5353-474e-8b6d-788dd78afc2f tempest-CreateVolumesFromImageTest-79148926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e900edc3-824e-438d-8064-db16eb3d1ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:15 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-134cc282-5353-474e-8b6d-788dd78afc2f tempest-CreateVolumesFromImageTest-79148926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e900edc3-824e-438d-8064-db16eb3d1ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:15 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-134cc282-5353-474e-8b6d-788dd78afc2f tempest-CreateVolumesFromImageTest-79148926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d34c9edd-1792-4ec8-8f81-4993971c15f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:15 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-134cc282-5353-474e-8b6d-788dd78afc2f tempest-CreateVolumesFromImageTest-79148926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d34c9edd-1792-4ec8-8f81-4993971c15f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fbe3557-c97f-4d19-84de-051acd42c362', 'volume_name': 'volume-7fbe3557-c97f-4d19-84de-051acd42c362', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:15 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-134cc282-5353-474e-8b6d-788dd78afc2f tempest-CreateVolumesFromImageTest-79148926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (009cb517-bfb0-48da-87f1-d422c7b1ff2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:15 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-134cc282-5353-474e-8b6d-788dd78afc2f tempest-CreateVolumesFromImageTest-79148926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (009cb517-bfb0-48da-87f1-d422c7b1ff2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:15 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-134cc282-5353-474e-8b6d-788dd78afc2f tempest-CreateVolumesFromImageTest-79148926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d971c9c-788c-471e-9bd8-9f3b37b7c043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:15 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-134cc282-5353-474e-8b6d-788dd78afc2f tempest-CreateVolumesFromImageTest-79148926 None] Volume 7fbe3557-c97f-4d19-84de-051acd42c362: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fbe3557-c97f-4d19-84de-051acd42c362', 'volume_size': 1} Apr 29 15:41:15 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-134cc282-5353-474e-8b6d-788dd78afc2f tempest-CreateVolumesFromImageTest-79148926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:41:15 devstack sudo[111598]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:15 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cca74337-5859-4dd6-91aa-9d4f38f61d29 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-19d55b30-8e91-4780-80f8-e391711ccbf0 1073741824" returned: 0 in 1.178s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:15 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0ccb093-27ee-455d-a3c6-506a11bc2953 tempest-CreateVolumesFromImageTest-79148926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:41:15 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-d0ccb093-27ee-455d-a3c6-506a11bc2953 tempest-CreateVolumesFromImageTest-79148926 None] Flow 'volume_create_manager' (797e6465-e546-48a0-8f7f-0791e01799e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:41:15 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-d0ccb093-27ee-455d-a3c6-506a11bc2953 tempest-CreateVolumesFromImageTest-79148926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (498a8172-2fc4-4deb-b3d9-23bd4f296e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:15 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cca74337-5859-4dd6-91aa-9d4f38f61d29 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-19d55b30-8e91-4780-80f8-e391711ccbf0 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:15 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-d0ccb093-27ee-455d-a3c6-506a11bc2953 tempest-CreateVolumesFromImageTest-79148926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (498a8172-2fc4-4deb-b3d9-23bd4f296e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:41:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1235161756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96ab07c5-f175-4775-acad-a3720bac45fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b202cc22c5e43109541afb133c26682',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:41:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:41:16Z,use_quota=True,user_id='154e1811faf34ef487e547afeebbf63d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:15 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-d0ccb093-27ee-455d-a3c6-506a11bc2953 tempest-CreateVolumesFromImageTest-79148926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9704a3a6-a9e2-4c19-aae8-145d550d8456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:15 devstack sudo[111604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-19d55b30-8e91-4780-80f8-e391711ccbf0 Apr 29 15:41:15 devstack sudo[111604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:15 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-d0ccb093-27ee-455d-a3c6-506a11bc2953 tempest-CreateVolumesFromImageTest-79148926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9704a3a6-a9e2-4c19-aae8-145d550d8456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:15 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-d0ccb093-27ee-455d-a3c6-506a11bc2953 tempest-CreateVolumesFromImageTest-79148926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef0c722a-dcc3-4620-8820-b2aa18d36e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:15 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-d0ccb093-27ee-455d-a3c6-506a11bc2953 tempest-CreateVolumesFromImageTest-79148926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef0c722a-dcc3-4620-8820-b2aa18d36e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96ab07c5-f175-4775-acad-a3720bac45fe', 'volume_name': 'volume-96ab07c5-f175-4775-acad-a3720bac45fe', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:15 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-d0ccb093-27ee-455d-a3c6-506a11bc2953 tempest-CreateVolumesFromImageTest-79148926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8690cfcf-571e-4659-aa7d-6ddd80c7ed47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:15 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-d0ccb093-27ee-455d-a3c6-506a11bc2953 tempest-CreateVolumesFromImageTest-79148926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8690cfcf-571e-4659-aa7d-6ddd80c7ed47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:15 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-d0ccb093-27ee-455d-a3c6-506a11bc2953 tempest-CreateVolumesFromImageTest-79148926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bbbd68f-d5ea-4575-ab88-ed1b615d4a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:15 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-d0ccb093-27ee-455d-a3c6-506a11bc2953 tempest-CreateVolumesFromImageTest-79148926 None] Volume 96ab07c5-f175-4775-acad-a3720bac45fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96ab07c5-f175-4775-acad-a3720bac45fe', 'volume_size': 1} Apr 29 15:41:15 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-d0ccb093-27ee-455d-a3c6-506a11bc2953 tempest-CreateVolumesFromImageTest-79148926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:41:16 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-a015aa3a-85f8-4614-a8ac-e8470fbaf04a tempest-CreateVolumesFromImageTest-79148926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:41:16 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-a015aa3a-85f8-4614-a8ac-e8470fbaf04a tempest-CreateVolumesFromImageTest-79148926 None] Flow 'volume_create_manager' (7062d91a-6ac6-4dc9-a69d-d552e1105183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:41:16 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-a015aa3a-85f8-4614-a8ac-e8470fbaf04a tempest-CreateVolumesFromImageTest-79148926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c88ddde2-c900-4a6d-b61f-14a303e2d513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:16 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-a015aa3a-85f8-4614-a8ac-e8470fbaf04a tempest-CreateVolumesFromImageTest-79148926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c88ddde2-c900-4a6d-b61f-14a303e2d513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:41:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-188795477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6664503f-153f-4972-9945-d9958a0372c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b202cc22c5e43109541afb133c26682',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:41:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:41:16Z,use_quota=True,user_id='154e1811faf34ef487e547afeebbf63d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:16 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-a015aa3a-85f8-4614-a8ac-e8470fbaf04a tempest-CreateVolumesFromImageTest-79148926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78c4bb06-5317-4d5b-a741-0817c15522f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:16 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-a015aa3a-85f8-4614-a8ac-e8470fbaf04a tempest-CreateVolumesFromImageTest-79148926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78c4bb06-5317-4d5b-a741-0817c15522f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:16 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-a015aa3a-85f8-4614-a8ac-e8470fbaf04a tempest-CreateVolumesFromImageTest-79148926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a2789ec-e265-49c7-ac9a-ec05c2ddfa3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:16 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-a015aa3a-85f8-4614-a8ac-e8470fbaf04a tempest-CreateVolumesFromImageTest-79148926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a2789ec-e265-49c7-ac9a-ec05c2ddfa3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6664503f-153f-4972-9945-d9958a0372c7', 'volume_name': 'volume-6664503f-153f-4972-9945-d9958a0372c7', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:16 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-a015aa3a-85f8-4614-a8ac-e8470fbaf04a tempest-CreateVolumesFromImageTest-79148926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e01e44f-ec9b-4e1e-a51b-53e14d80543b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:16 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-a015aa3a-85f8-4614-a8ac-e8470fbaf04a tempest-CreateVolumesFromImageTest-79148926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e01e44f-ec9b-4e1e-a51b-53e14d80543b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:16 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-a015aa3a-85f8-4614-a8ac-e8470fbaf04a tempest-CreateVolumesFromImageTest-79148926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ca44a3b-5e80-4807-9793-c554a3b09a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:16 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-a015aa3a-85f8-4614-a8ac-e8470fbaf04a tempest-CreateVolumesFromImageTest-79148926 None] Volume 6664503f-153f-4972-9945-d9958a0372c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6664503f-153f-4972-9945-d9958a0372c7', 'volume_size': 1} Apr 29 15:41:16 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-a015aa3a-85f8-4614-a8ac-e8470fbaf04a tempest-CreateVolumesFromImageTest-79148926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:41:16 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-d89bf766-dd2f-4dbc-b75e-609e8f2ac47c tempest-CreateVolumesFromImageTest-79148926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:41:16 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-d89bf766-dd2f-4dbc-b75e-609e8f2ac47c tempest-CreateVolumesFromImageTest-79148926 None] Flow 'volume_create_manager' (c401dedf-d568-4428-ab3c-4bbbbc531acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:41:16 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-d89bf766-dd2f-4dbc-b75e-609e8f2ac47c tempest-CreateVolumesFromImageTest-79148926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f705a9e7-727f-4e79-9d80-91f4cfd9d8c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:16 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-d89bf766-dd2f-4dbc-b75e-609e8f2ac47c tempest-CreateVolumesFromImageTest-79148926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f705a9e7-727f-4e79-9d80-91f4cfd9d8c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:41:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-72742136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e24c189-dcf3-4100-8d0a-720caebb914c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b202cc22c5e43109541afb133c26682',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:41:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:41:17Z,use_quota=True,user_id='154e1811faf34ef487e547afeebbf63d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:16 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-d89bf766-dd2f-4dbc-b75e-609e8f2ac47c tempest-CreateVolumesFromImageTest-79148926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f90ed5f1-0ec0-442e-8efb-c2a5ded180b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:16 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-d89bf766-dd2f-4dbc-b75e-609e8f2ac47c tempest-CreateVolumesFromImageTest-79148926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f90ed5f1-0ec0-442e-8efb-c2a5ded180b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:16 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-d89bf766-dd2f-4dbc-b75e-609e8f2ac47c tempest-CreateVolumesFromImageTest-79148926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cf37a85-2b1d-42c8-b7c9-82b4cd4a24fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:16 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-d89bf766-dd2f-4dbc-b75e-609e8f2ac47c tempest-CreateVolumesFromImageTest-79148926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cf37a85-2b1d-42c8-b7c9-82b4cd4a24fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e24c189-dcf3-4100-8d0a-720caebb914c', 'volume_name': 'volume-8e24c189-dcf3-4100-8d0a-720caebb914c', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:16 devstack sudo[111604]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:16 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-d89bf766-dd2f-4dbc-b75e-609e8f2ac47c tempest-CreateVolumesFromImageTest-79148926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98c6d53c-bc9f-4245-8483-38eda9ae1182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:16 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-d89bf766-dd2f-4dbc-b75e-609e8f2ac47c tempest-CreateVolumesFromImageTest-79148926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98c6d53c-bc9f-4245-8483-38eda9ae1182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:16 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-d89bf766-dd2f-4dbc-b75e-609e8f2ac47c tempest-CreateVolumesFromImageTest-79148926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db92c919-f2c5-4afa-b0dc-4f0d5308c0fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:16 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-d89bf766-dd2f-4dbc-b75e-609e8f2ac47c tempest-CreateVolumesFromImageTest-79148926 None] Volume 8e24c189-dcf3-4100-8d0a-720caebb914c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e24c189-dcf3-4100-8d0a-720caebb914c', 'volume_size': 1} Apr 29 15:41:16 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-d89bf766-dd2f-4dbc-b75e-609e8f2ac47c tempest-CreateVolumesFromImageTest-79148926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:41:16 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cca74337-5859-4dd6-91aa-9d4f38f61d29 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-19d55b30-8e91-4780-80f8-e391711ccbf0" returned: 0 in 0.726s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:16 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-cca74337-5859-4dd6-91aa-9d4f38f61d29 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] <== create_volume: return (2045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:41:16 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-cca74337-5859-4dd6-91aa-9d4f38f61d29 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.048s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:41:16 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-4c6fb51d-7531-4ca5-8a03-8cad46c1c1b0 tempest-CreateVolumesFromImageTest-79148926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.659s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:41:16 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-4c6fb51d-7531-4ca5-8a03-8cad46c1c1b0 tempest-CreateVolumesFromImageTest-79148926 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:41:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-676727387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b71aeaf-7bc3-4710-a36b-5c72145660a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b202cc22c5e43109541afb133c26682',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:41:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:41:15Z,use_quota=True,user_id='154e1811faf34ef487e547afeebbf63d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:41:16 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-4c6fb51d-7531-4ca5-8a03-8cad46c1c1b0 tempest-CreateVolumesFromImageTest-79148926 None] Creating volume 2b71aeaf-7bc3-4710-a36b-5c72145660a1 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:41:16 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-4c6fb51d-7531-4ca5-8a03-8cad46c1c1b0 tempest-CreateVolumesFromImageTest-79148926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:41:16 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-4c6fb51d-7531-4ca5-8a03-8cad46c1c1b0 tempest-CreateVolumesFromImageTest-79148926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:41:16 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-4c6fb51d-7531-4ca5-8a03-8cad46c1c1b0 tempest-CreateVolumesFromImageTest-79148926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:41:16 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-4c6fb51d-7531-4ca5-8a03-8cad46c1c1b0 tempest-CreateVolumesFromImageTest-79148926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:41:16 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-4c6fb51d-7531-4ca5-8a03-8cad46c1c1b0 tempest-CreateVolumesFromImageTest-79148926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:41:16 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-4c6fb51d-7531-4ca5-8a03-8cad46c1c1b0 tempest-CreateVolumesFromImageTest-79148926 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:41:16 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-4c6fb51d-7531-4ca5-8a03-8cad46c1c1b0 tempest-CreateVolumesFromImageTest-79148926 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:41:16 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-4c6fb51d-7531-4ca5-8a03-8cad46c1c1b0 tempest-CreateVolumesFromImageTest-79148926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2b71aeaf-7bc3-4710-a36b-5c72145660a1 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:16 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cca74337-5859-4dd6-91aa-9d4f38f61d29 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4a77c7a-0828-443f-a7ef-f2efdd44f5a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19d55b30-8e91-4780-80f8-e391711ccbf0', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:16 devstack sudo[111608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2b71aeaf-7bc3-4710-a36b-5c72145660a1 1073741824 Apr 29 15:41:16 devstack sudo[111608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:16 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cca74337-5859-4dd6-91aa-9d4f38f61d29 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e60cbcd8-c9a0-464e-b4f8-1db3f04415c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:16 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-cca74337-5859-4dd6-91aa-9d4f38f61d29 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Volume volume-19d55b30-8e91-4780-80f8-e391711ccbf0 (19d55b30-8e91-4780-80f8-e391711ccbf0): created successfully Apr 29 15:41:16 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cca74337-5859-4dd6-91aa-9d4f38f61d29 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e60cbcd8-c9a0-464e-b4f8-1db3f04415c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:16 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cca74337-5859-4dd6-91aa-9d4f38f61d29 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Flow 'volume_create_manager' (4cc3026b-9176-48a6-820a-b4d8234c6bb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:41:16 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-cca74337-5859-4dd6-91aa-9d4f38f61d29 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Created volume successfully. Apr 29 15:41:17 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b4f6a39-00c1-424e-9690-3e207530f60e tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:41:17 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-2b4f6a39-00c1-424e-9690-3e207530f60e tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Flow 'volume_create_manager' (95ce1889-a2d0-471d-9cbf-761317d1a961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:41:17 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-2b4f6a39-00c1-424e-9690-3e207530f60e tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (724b9961-9eba-4cc7-9ea1-4d1649f3ecb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:17 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-2b4f6a39-00c1-424e-9690-3e207530f60e tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (724b9961-9eba-4cc7-9ea1-4d1649f3ecb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:41:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-892311867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d237bd67-b183-42c1-9ab5-64b4e20eef4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e6c1e909d4b4ca39ad93d5e4b6a34e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:41:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:41:17Z,use_quota=True,user_id='eee87ab7247540bab787424726812dc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:17 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-2b4f6a39-00c1-424e-9690-3e207530f60e tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb5da211-6853-4d5b-9afd-202509f1908c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:17 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-2b4f6a39-00c1-424e-9690-3e207530f60e tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb5da211-6853-4d5b-9afd-202509f1908c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:17 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-2b4f6a39-00c1-424e-9690-3e207530f60e tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d0e28d9-0d18-4703-a768-eae9ebb142f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:17 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-2b4f6a39-00c1-424e-9690-3e207530f60e tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d0e28d9-0d18-4703-a768-eae9ebb142f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd237bd67-b183-42c1-9ab5-64b4e20eef4c', 'volume_name': 'volume-d237bd67-b183-42c1-9ab5-64b4e20eef4c', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:17 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-2b4f6a39-00c1-424e-9690-3e207530f60e tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9abba0bc-65ee-48cd-b7fc-873f727bfbdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:17 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-2b4f6a39-00c1-424e-9690-3e207530f60e tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9abba0bc-65ee-48cd-b7fc-873f727bfbdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:17 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-2b4f6a39-00c1-424e-9690-3e207530f60e tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cb3c463-3102-47f7-ab49-ef143bad2145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:17 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-2b4f6a39-00c1-424e-9690-3e207530f60e tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Volume d237bd67-b183-42c1-9ab5-64b4e20eef4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d237bd67-b183-42c1-9ab5-64b4e20eef4c', 'volume_size': 1} Apr 29 15:41:17 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-2b4f6a39-00c1-424e-9690-3e207530f60e tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:41:17 devstack sudo[111608]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:17 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-4c6fb51d-7531-4ca5-8a03-8cad46c1c1b0 tempest-CreateVolumesFromImageTest-79148926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2b71aeaf-7bc3-4710-a36b-5c72145660a1 1073741824" returned: 0 in 0.961s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:17 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-4c6fb51d-7531-4ca5-8a03-8cad46c1c1b0 tempest-CreateVolumesFromImageTest-79148926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2b71aeaf-7bc3-4710-a36b-5c72145660a1 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:17 devstack sudo[111614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2b71aeaf-7bc3-4710-a36b-5c72145660a1 Apr 29 15:41:17 devstack sudo[111614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:17 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-8151a652-ccd5-472f-9313-60ad2bc33829 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:41:17 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-8151a652-ccd5-472f-9313-60ad2bc33829 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Flow 'volume_create_manager' (48cc93ab-97c8-44ab-9fe8-694c536446b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:41:17 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-8151a652-ccd5-472f-9313-60ad2bc33829 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4031f14-0e2c-4c07-837e-46d3d7af387f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:17 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-8151a652-ccd5-472f-9313-60ad2bc33829 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4031f14-0e2c-4c07-837e-46d3d7af387f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:41:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1260975058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e992d98-714b-4a98-b707-dc3ebe9fbd1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e6c1e909d4b4ca39ad93d5e4b6a34e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:41:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:41:18Z,use_quota=True,user_id='eee87ab7247540bab787424726812dc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:17 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-8151a652-ccd5-472f-9313-60ad2bc33829 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93eb2308-b566-4322-9c7f-0f02482ae0a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:17 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-8151a652-ccd5-472f-9313-60ad2bc33829 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93eb2308-b566-4322-9c7f-0f02482ae0a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:17 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-8151a652-ccd5-472f-9313-60ad2bc33829 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4857cdeb-782b-439c-9def-08f990e1df3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:17 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-8151a652-ccd5-472f-9313-60ad2bc33829 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4857cdeb-782b-439c-9def-08f990e1df3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e992d98-714b-4a98-b707-dc3ebe9fbd1b', 'volume_name': 'volume-8e992d98-714b-4a98-b707-dc3ebe9fbd1b', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:17 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-8151a652-ccd5-472f-9313-60ad2bc33829 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf621427-ac65-4e96-b5aa-b119ce8f164e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:17 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-8151a652-ccd5-472f-9313-60ad2bc33829 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf621427-ac65-4e96-b5aa-b119ce8f164e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:17 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-8151a652-ccd5-472f-9313-60ad2bc33829 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7d7660d-6b9c-4cc3-80ca-e2d455a4e41e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:17 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-8151a652-ccd5-472f-9313-60ad2bc33829 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Volume 8e992d98-714b-4a98-b707-dc3ebe9fbd1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e992d98-714b-4a98-b707-dc3ebe9fbd1b', 'volume_size': 1} Apr 29 15:41:17 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-8151a652-ccd5-472f-9313-60ad2bc33829 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:41:18 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-06bf78ff-9110-431f-8c48-43d4789e46e2 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:41:18 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-06bf78ff-9110-431f-8c48-43d4789e46e2 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Flow 'volume_create_manager' (487c1058-04ac-4f59-b8fc-d03623f40cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:41:18 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-06bf78ff-9110-431f-8c48-43d4789e46e2 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1cabc65-6daa-4929-a3f9-aea6e572710e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:18 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-06bf78ff-9110-431f-8c48-43d4789e46e2 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1cabc65-6daa-4929-a3f9-aea6e572710e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:41:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2112110595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f63064e-35fd-4071-a770-949e073a17c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e6c1e909d4b4ca39ad93d5e4b6a34e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:41:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:41:18Z,use_quota=True,user_id='eee87ab7247540bab787424726812dc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:18 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-06bf78ff-9110-431f-8c48-43d4789e46e2 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da353ce6-7205-4341-99f1-8398139b4b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:18 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-06bf78ff-9110-431f-8c48-43d4789e46e2 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da353ce6-7205-4341-99f1-8398139b4b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:18 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-06bf78ff-9110-431f-8c48-43d4789e46e2 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b044e7d1-12d8-45d1-964b-898eca7f6705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:18 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-06bf78ff-9110-431f-8c48-43d4789e46e2 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b044e7d1-12d8-45d1-964b-898eca7f6705) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f63064e-35fd-4071-a770-949e073a17c4', 'volume_name': 'volume-6f63064e-35fd-4071-a770-949e073a17c4', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:18 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-06bf78ff-9110-431f-8c48-43d4789e46e2 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bce631c-3cf9-403e-920f-221bdf4b5093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:18 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-06bf78ff-9110-431f-8c48-43d4789e46e2 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bce631c-3cf9-403e-920f-221bdf4b5093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:18 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-06bf78ff-9110-431f-8c48-43d4789e46e2 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (565b6a82-1440-485d-9239-25feb09cf557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:18 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-06bf78ff-9110-431f-8c48-43d4789e46e2 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Volume 6f63064e-35fd-4071-a770-949e073a17c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f63064e-35fd-4071-a770-949e073a17c4', 'volume_size': 1} Apr 29 15:41:18 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-06bf78ff-9110-431f-8c48-43d4789e46e2 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:41:18 devstack sudo[111614]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:18 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-4c6fb51d-7531-4ca5-8a03-8cad46c1c1b0 tempest-CreateVolumesFromImageTest-79148926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2b71aeaf-7bc3-4710-a36b-5c72145660a1" returned: 0 in 0.792s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:18 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-4c6fb51d-7531-4ca5-8a03-8cad46c1c1b0 tempest-CreateVolumesFromImageTest-79148926 None] <== create_volume: return (1798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:41:18 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-4c6fb51d-7531-4ca5-8a03-8cad46c1c1b0 tempest-CreateVolumesFromImageTest-79148926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.803s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:41:18 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-93be2287-c77c-402c-9e21-b801d35ab54f tempest-VolumeDependencyTests-347675874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.055s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:41:18 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-93be2287-c77c-402c-9e21-b801d35ab54f tempest-VolumeDependencyTests-347675874 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:41:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-875684722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=125a8290-20d5-4d49-b9e0-6b57d70322f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aeb81c62ac284048b36f567290e59d0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:41:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:41:15Z,use_quota=True,user_id='5f2f077a45ee40b48b1d0833faeef45f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:41:18 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-93be2287-c77c-402c-9e21-b801d35ab54f tempest-VolumeDependencyTests-347675874 None] Creating volume 125a8290-20d5-4d49-b9e0-6b57d70322f4 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:41:18 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-93be2287-c77c-402c-9e21-b801d35ab54f tempest-VolumeDependencyTests-347675874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:41:18 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-93be2287-c77c-402c-9e21-b801d35ab54f tempest-VolumeDependencyTests-347675874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:41:18 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-93be2287-c77c-402c-9e21-b801d35ab54f tempest-VolumeDependencyTests-347675874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:41:18 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-93be2287-c77c-402c-9e21-b801d35ab54f tempest-VolumeDependencyTests-347675874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:41:18 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-93be2287-c77c-402c-9e21-b801d35ab54f tempest-VolumeDependencyTests-347675874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:41:18 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-93be2287-c77c-402c-9e21-b801d35ab54f tempest-VolumeDependencyTests-347675874 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:41:18 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-93be2287-c77c-402c-9e21-b801d35ab54f tempest-VolumeDependencyTests-347675874 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:41:18 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-93be2287-c77c-402c-9e21-b801d35ab54f tempest-VolumeDependencyTests-347675874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-125a8290-20d5-4d49-b9e0-6b57d70322f4 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:18 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4c6fb51d-7531-4ca5-8a03-8cad46c1c1b0 tempest-CreateVolumesFromImageTest-79148926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08c7e367-3abb-4d7c-9665-7f29968e9239) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b71aeaf-7bc3-4710-a36b-5c72145660a1', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:18 devstack sudo[111617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-125a8290-20d5-4d49-b9e0-6b57d70322f4 1073741824 Apr 29 15:41:18 devstack sudo[111617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:18 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4c6fb51d-7531-4ca5-8a03-8cad46c1c1b0 tempest-CreateVolumesFromImageTest-79148926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59726a8a-4791-47fb-a24a-f3ae081b6595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:18 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-4c6fb51d-7531-4ca5-8a03-8cad46c1c1b0 tempest-CreateVolumesFromImageTest-79148926 None] Volume volume-2b71aeaf-7bc3-4710-a36b-5c72145660a1 (2b71aeaf-7bc3-4710-a36b-5c72145660a1): created successfully Apr 29 15:41:18 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4c6fb51d-7531-4ca5-8a03-8cad46c1c1b0 tempest-CreateVolumesFromImageTest-79148926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59726a8a-4791-47fb-a24a-f3ae081b6595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:18 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4c6fb51d-7531-4ca5-8a03-8cad46c1c1b0 tempest-CreateVolumesFromImageTest-79148926 None] Flow 'volume_create_manager' (1fbacb56-a3dd-40bf-a11e-91ac3abe50b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:41:18 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-4c6fb51d-7531-4ca5-8a03-8cad46c1c1b0 tempest-CreateVolumesFromImageTest-79148926 None] Created volume successfully. Apr 29 15:41:18 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-71af3f03-49fb-4f7a-a9bd-55e79834190e tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:41:18 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-71af3f03-49fb-4f7a-a9bd-55e79834190e tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Flow 'volume_create_manager' (4907faa0-8e52-4fa5-b7eb-719bca66aec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:41:18 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-71af3f03-49fb-4f7a-a9bd-55e79834190e tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ede528cd-0c60-4a34-9502-aa4278127383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:18 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-71af3f03-49fb-4f7a-a9bd-55e79834190e tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ede528cd-0c60-4a34-9502-aa4278127383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:41:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-253172271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74729239-9924-4739-9924-ae4226ae8fa2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e6c1e909d4b4ca39ad93d5e4b6a34e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:41:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:41:19Z,use_quota=True,user_id='eee87ab7247540bab787424726812dc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:18 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-71af3f03-49fb-4f7a-a9bd-55e79834190e tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44b524e5-91ad-4a5d-82b3-0f118e6854d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:18 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-71af3f03-49fb-4f7a-a9bd-55e79834190e tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44b524e5-91ad-4a5d-82b3-0f118e6854d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:18 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-71af3f03-49fb-4f7a-a9bd-55e79834190e tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c31e032-2585-44e0-a211-3b70d80988ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:18 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-71af3f03-49fb-4f7a-a9bd-55e79834190e tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c31e032-2585-44e0-a211-3b70d80988ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74729239-9924-4739-9924-ae4226ae8fa2', 'volume_name': 'volume-74729239-9924-4739-9924-ae4226ae8fa2', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:18 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-71af3f03-49fb-4f7a-a9bd-55e79834190e tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e76eb6a4-74fb-4528-9959-ae7c8e8c0298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:18 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-71af3f03-49fb-4f7a-a9bd-55e79834190e tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e76eb6a4-74fb-4528-9959-ae7c8e8c0298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:18 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-71af3f03-49fb-4f7a-a9bd-55e79834190e tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e6bbc3b-19d8-4d1c-9800-c6ce820d7213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:18 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-71af3f03-49fb-4f7a-a9bd-55e79834190e tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Volume 74729239-9924-4739-9924-ae4226ae8fa2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74729239-9924-4739-9924-ae4226ae8fa2', 'volume_size': 1} Apr 29 15:41:18 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-71af3f03-49fb-4f7a-a9bd-55e79834190e tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:41:19 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d86d833-37db-4385-b20f-b02b0100263f tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:41:19 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6d86d833-37db-4385-b20f-b02b0100263f tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Flow 'volume_create_manager' (ee9d200c-802e-4c86-a646-e8aba1eb1746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:41:19 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6d86d833-37db-4385-b20f-b02b0100263f tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42789e38-8103-4eb2-9585-8909871c4c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:19 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-7edd15b4-0774-47af-a38d-ebd51dbf5cf2 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:41:19 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-7edd15b4-0774-47af-a38d-ebd51dbf5cf2 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] Flow 'volume_create_manager' (b584810a-becc-48dd-ac9c-8584322f856b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:41:19 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-7edd15b4-0774-47af-a38d-ebd51dbf5cf2 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa353c36-93b2-4983-bb1d-88558e8c456d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:19 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6d86d833-37db-4385-b20f-b02b0100263f tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42789e38-8103-4eb2-9585-8909871c4c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:41:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1203721398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5db738ae-fd78-4bcd-951a-54bab0f4c506,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e6c1e909d4b4ca39ad93d5e4b6a34e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:41:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:41:19Z,use_quota=True,user_id='eee87ab7247540bab787424726812dc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:19 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6d86d833-37db-4385-b20f-b02b0100263f tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dd73826-fcc5-4cc3-9b12-6108924f6677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:19 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6d86d833-37db-4385-b20f-b02b0100263f tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dd73826-fcc5-4cc3-9b12-6108924f6677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:19 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6d86d833-37db-4385-b20f-b02b0100263f tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66faefd4-97ad-4942-8874-42d8556dfb51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:19 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6d86d833-37db-4385-b20f-b02b0100263f tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66faefd4-97ad-4942-8874-42d8556dfb51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5db738ae-fd78-4bcd-951a-54bab0f4c506', 'volume_name': 'volume-5db738ae-fd78-4bcd-951a-54bab0f4c506', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:19 devstack sudo[111617]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:19 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6d86d833-37db-4385-b20f-b02b0100263f tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b376626-5f97-4976-a5c9-f15aa5f73970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:19 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6d86d833-37db-4385-b20f-b02b0100263f tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b376626-5f97-4976-a5c9-f15aa5f73970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:19 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6d86d833-37db-4385-b20f-b02b0100263f tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eeaeca8-7c9a-4b1a-94d9-d697a8bf5628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:19 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-6d86d833-37db-4385-b20f-b02b0100263f tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Volume 5db738ae-fd78-4bcd-951a-54bab0f4c506: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5db738ae-fd78-4bcd-951a-54bab0f4c506', 'volume_size': 1} Apr 29 15:41:19 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-6d86d833-37db-4385-b20f-b02b0100263f tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:41:19 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-93be2287-c77c-402c-9e21-b801d35ab54f tempest-VolumeDependencyTests-347675874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-125a8290-20d5-4d49-b9e0-6b57d70322f4 1073741824" returned: 0 in 1.001s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:19 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-7edd15b4-0774-47af-a38d-ebd51dbf5cf2 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa353c36-93b2-4983-bb1d-88558e8c456d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:41:19Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7abd3063-2349-469d-9c94-99a992748cf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e9d0ec4088a4196b7b5be876b87300a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:41:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:41:19Z,use_quota=True,user_id='bf89206f2e2a4851ae1e22d4cd0f3ee5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4692619c-8248-4eac-87ae-155ed93e3396),volume_type_id=4692619c-8248-4eac-87ae-155ed93e3396)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:19 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-7edd15b4-0774-47af-a38d-ebd51dbf5cf2 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df38ad36-7659-4737-b8d8-af876fbb5618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:19 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-7edd15b4-0774-47af-a38d-ebd51dbf5cf2 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df38ad36-7659-4737-b8d8-af876fbb5618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:19 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-7edd15b4-0774-47af-a38d-ebd51dbf5cf2 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd778621-1f30-4d48-9940-2ad102897125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:19 devstack cinder-volume[84448]: DEBUG cinder.image.glance [None req-7edd15b4-0774-47af-a38d-ebd51dbf5cf2 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] Creating Keystone auth plugin from conf {{(pid=84448) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 29 15:41:19 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-93be2287-c77c-402c-9e21-b801d35ab54f tempest-VolumeDependencyTests-347675874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-125a8290-20d5-4d49-b9e0-6b57d70322f4 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:19 devstack sudo[111626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-125a8290-20d5-4d49-b9e0-6b57d70322f4 Apr 29 15:41:19 devstack sudo[111626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:19 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-7edd15b4-0774-47af-a38d-ebd51dbf5cf2 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd778621-1f30-4d48-9940-2ad102897125) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7abd3063-2349-469d-9c94-99a992748cf3', 'volume_name': 'volume-7abd3063-2349-469d-9c94-99a992748cf3', 'volume_size': 1, 'image_id': '088bd261-61fd-428d-8444-2cf93043dc26', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/088bd261-61fd-428d-8444-2cf93043dc26', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '30db540f4e09025684182ec615e4a1f6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9e9d0ec4088a4196b7b5be876b87300a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '71a40f588345c81b94cc20ff4add260ad75544ddb6956af05aa25d4fbee9802f14dbb6fb06089a50818f0a395eddaf1c07c1e264f76f1187ea3df2d14e07b984', 'id': '088bd261-61fd-428d-8444-2cf93043dc26', 'created_at': datetime.datetime(2026, 4, 29, 13, 41, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 13, 41, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/088bd261-61fd-428d-8444-2cf93043dc26/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:19 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-7edd15b4-0774-47af-a38d-ebd51dbf5cf2 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dd114e7-eba4-4b1e-aa84-1e43e8ce4a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:19 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-7edd15b4-0774-47af-a38d-ebd51dbf5cf2 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dd114e7-eba4-4b1e-aa84-1e43e8ce4a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:19 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-7edd15b4-0774-47af-a38d-ebd51dbf5cf2 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03c63006-a030-47f7-90f3-f95525a1992b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:19 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-7edd15b4-0774-47af-a38d-ebd51dbf5cf2 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] Volume 7abd3063-2349-469d-9c94-99a992748cf3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7abd3063-2349-469d-9c94-99a992748cf3', 'volume_size': 1, 'image_id': '088bd261-61fd-428d-8444-2cf93043dc26', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/088bd261-61fd-428d-8444-2cf93043dc26', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '30db540f4e09025684182ec615e4a1f6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9e9d0ec4088a4196b7b5be876b87300a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '71a40f588345c81b94cc20ff4add260ad75544ddb6956af05aa25d4fbee9802f14dbb6fb06089a50818f0a395eddaf1c07c1e264f76f1187ea3df2d14e07b984', 'id': '088bd261-61fd-428d-8444-2cf93043dc26', 'created_at': datetime.datetime(2026, 4, 29, 13, 41, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 13, 41, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/088bd261-61fd-428d-8444-2cf93043dc26/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Apr 29 15:41:19 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-7edd15b4-0774-47af-a38d-ebd51dbf5cf2 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] Trying to clone 7abd3063-2349-469d-9c94-99a992748cf3 from image 088bd261-61fd-428d-8444-2cf93043dc26 at location (None, [{'url': 'file:///opt/stack/data/glance/images/088bd261-61fd-428d-8444-2cf93043dc26', 'metadata': {}}]). {{(pid=84448) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 29 15:41:19 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [None req-7edd15b4-0774-47af-a38d-ebd51dbf5cf2 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_088bd261-61fd-428d-8444-2cf93043dc26_7fytk1wsdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=84448) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 29 15:41:19 devstack cinder-volume[84448]: INFO cinder.image.image_utils [None req-7edd15b4-0774-47af-a38d-ebd51dbf5cf2 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] Image download 0.00 MB at 0.00 MB/s Apr 29 15:41:19 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[d45017df-0afd-4ac8-99b9-ec6281ba2a86]: (4, 'raw') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:41:19 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7edd15b4-0774-47af-a38d-ebd51dbf5cf2 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_088bd261-61fd-428d-8444-2cf93043dc26_7fytk1wsdevstack@QuobyteHD {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:19 devstack sudo[111628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_088bd261-61fd-428d-8444-2cf93043dc26_7fytk1wsdevstack@QuobyteHD Apr 29 15:41:19 devstack sudo[111628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:20 devstack sudo[111626]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:20 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-93be2287-c77c-402c-9e21-b801d35ab54f tempest-VolumeDependencyTests-347675874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-125a8290-20d5-4d49-b9e0-6b57d70322f4" returned: 0 in 0.609s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:20 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-93be2287-c77c-402c-9e21-b801d35ab54f tempest-VolumeDependencyTests-347675874 None] <== create_volume: return (1679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:41:20 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-93be2287-c77c-402c-9e21-b801d35ab54f tempest-VolumeDependencyTests-347675874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.682s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:41:20 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-134cc282-5353-474e-8b6d-788dd78afc2f tempest-CreateVolumesFromImageTest-79148926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.626s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:41:20 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-134cc282-5353-474e-8b6d-788dd78afc2f tempest-CreateVolumesFromImageTest-79148926 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:41:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1337520649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fbe3557-c97f-4d19-84de-051acd42c362,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b202cc22c5e43109541afb133c26682',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:41:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:41:15Z,use_quota=True,user_id='154e1811faf34ef487e547afeebbf63d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:41:20 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-134cc282-5353-474e-8b6d-788dd78afc2f tempest-CreateVolumesFromImageTest-79148926 None] Creating volume 7fbe3557-c97f-4d19-84de-051acd42c362 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:41:20 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-134cc282-5353-474e-8b6d-788dd78afc2f tempest-CreateVolumesFromImageTest-79148926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:41:20 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-134cc282-5353-474e-8b6d-788dd78afc2f tempest-CreateVolumesFromImageTest-79148926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:41:20 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-134cc282-5353-474e-8b6d-788dd78afc2f tempest-CreateVolumesFromImageTest-79148926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:41:20 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-134cc282-5353-474e-8b6d-788dd78afc2f tempest-CreateVolumesFromImageTest-79148926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:41:20 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-134cc282-5353-474e-8b6d-788dd78afc2f tempest-CreateVolumesFromImageTest-79148926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:41:20 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-134cc282-5353-474e-8b6d-788dd78afc2f tempest-CreateVolumesFromImageTest-79148926 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:41:20 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-134cc282-5353-474e-8b6d-788dd78afc2f tempest-CreateVolumesFromImageTest-79148926 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:41:20 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-134cc282-5353-474e-8b6d-788dd78afc2f tempest-CreateVolumesFromImageTest-79148926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7fbe3557-c97f-4d19-84de-051acd42c362 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:20 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-93be2287-c77c-402c-9e21-b801d35ab54f tempest-VolumeDependencyTests-347675874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2d9cb93-49d6-472c-8070-e24e1abfe067) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-125a8290-20d5-4d49-b9e0-6b57d70322f4', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:20 devstack sudo[111631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7fbe3557-c97f-4d19-84de-051acd42c362 1073741824 Apr 29 15:41:20 devstack sudo[111631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:20 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-93be2287-c77c-402c-9e21-b801d35ab54f tempest-VolumeDependencyTests-347675874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6a21dc1-96ef-49e1-ad45-445248fb0b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:20 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-93be2287-c77c-402c-9e21-b801d35ab54f tempest-VolumeDependencyTests-347675874 None] Volume volume-125a8290-20d5-4d49-b9e0-6b57d70322f4 (125a8290-20d5-4d49-b9e0-6b57d70322f4): created successfully Apr 29 15:41:20 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-93be2287-c77c-402c-9e21-b801d35ab54f tempest-VolumeDependencyTests-347675874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6a21dc1-96ef-49e1-ad45-445248fb0b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:20 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-93be2287-c77c-402c-9e21-b801d35ab54f tempest-VolumeDependencyTests-347675874 None] Flow 'volume_create_manager' (8ec289d7-d6ea-45a2-9931-d4560a3bf304) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:41:20 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-93be2287-c77c-402c-9e21-b801d35ab54f tempest-VolumeDependencyTests-347675874 None] Created volume successfully. Apr 29 15:41:20 devstack sudo[111628]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:20 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7edd15b4-0774-47af-a38d-ebd51dbf5cf2 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_088bd261-61fd-428d-8444-2cf93043dc26_7fytk1wsdevstack@QuobyteHD" returned: 0 in 0.724s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:20 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7edd15b4-0774-47af-a38d-ebd51dbf5cf2 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_088bd261-61fd-428d-8444-2cf93043dc26_7fytk1wsdevstack@QuobyteHD {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:20 devstack sudo[111635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_088bd261-61fd-428d-8444-2cf93043dc26_7fytk1wsdevstack@QuobyteHD Apr 29 15:41:20 devstack sudo[111635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:20 devstack sudo[111631]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:20 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-134cc282-5353-474e-8b6d-788dd78afc2f tempest-CreateVolumesFromImageTest-79148926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7fbe3557-c97f-4d19-84de-051acd42c362 1073741824" returned: 0 in 0.826s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:21 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-134cc282-5353-474e-8b6d-788dd78afc2f tempest-CreateVolumesFromImageTest-79148926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7fbe3557-c97f-4d19-84de-051acd42c362 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:21 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-35cf0739-0cbd-4e93-9857-9a84c5224f1c tempest-VolumeDependencyTests-347675874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:41:21 devstack sudo[111641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7fbe3557-c97f-4d19-84de-051acd42c362 Apr 29 15:41:21 devstack sudo[111641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:21 devstack sudo[111635]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:21 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7edd15b4-0774-47af-a38d-ebd51dbf5cf2 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_088bd261-61fd-428d-8444-2cf93043dc26_7fytk1wsdevstack@QuobyteHD" returned: 1 in 0.768s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:21 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7edd15b4-0774-47af-a38d-ebd51dbf5cf2 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_088bd261-61fd-428d-8444-2cf93043dc26_7fytk1wsdevstack@QuobyteHD' failed. Not Retrying. {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 15:41:21 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [None req-7edd15b4-0774-47af-a38d-ebd51dbf5cf2 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] Temporary image 088bd261-61fd-428d-8444-2cf93043dc26 is fetched for user bf89206f2e2a4851ae1e22d4cd0f3ee5. {{(pid=84448) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 29 15:41:21 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[721dcef6-4c99-4d79-800d-4020e57f910e]: (4, 'raw') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:41:21 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7edd15b4-0774-47af-a38d-ebd51dbf5cf2 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_088bd261-61fd-428d-8444-2cf93043dc26_7fytk1wsdevstack@QuobyteHD {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:21 devstack sudo[111646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_088bd261-61fd-428d-8444-2cf93043dc26_7fytk1wsdevstack@QuobyteHD Apr 29 15:41:21 devstack sudo[111646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:21 devstack sudo[111641]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:21 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-134cc282-5353-474e-8b6d-788dd78afc2f tempest-CreateVolumesFromImageTest-79148926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7fbe3557-c97f-4d19-84de-051acd42c362" returned: 0 in 0.581s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:21 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-134cc282-5353-474e-8b6d-788dd78afc2f tempest-CreateVolumesFromImageTest-79148926 None] <== create_volume: return (1478ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:41:21 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-134cc282-5353-474e-8b6d-788dd78afc2f tempest-CreateVolumesFromImageTest-79148926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.481s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:41:21 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-d0ccb093-27ee-455d-a3c6-506a11bc2953 tempest-CreateVolumesFromImageTest-79148926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.653s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:41:21 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-d0ccb093-27ee-455d-a3c6-506a11bc2953 tempest-CreateVolumesFromImageTest-79148926 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:41:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1235161756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96ab07c5-f175-4775-acad-a3720bac45fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b202cc22c5e43109541afb133c26682',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:41:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:41:16Z,use_quota=True,user_id='154e1811faf34ef487e547afeebbf63d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:41:21 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-d0ccb093-27ee-455d-a3c6-506a11bc2953 tempest-CreateVolumesFromImageTest-79148926 None] Creating volume 96ab07c5-f175-4775-acad-a3720bac45fe {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:41:21 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-d0ccb093-27ee-455d-a3c6-506a11bc2953 tempest-CreateVolumesFromImageTest-79148926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:41:21 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-d0ccb093-27ee-455d-a3c6-506a11bc2953 tempest-CreateVolumesFromImageTest-79148926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:41:21 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-d0ccb093-27ee-455d-a3c6-506a11bc2953 tempest-CreateVolumesFromImageTest-79148926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:41:21 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-d0ccb093-27ee-455d-a3c6-506a11bc2953 tempest-CreateVolumesFromImageTest-79148926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:41:21 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-d0ccb093-27ee-455d-a3c6-506a11bc2953 tempest-CreateVolumesFromImageTest-79148926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:41:21 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-d0ccb093-27ee-455d-a3c6-506a11bc2953 tempest-CreateVolumesFromImageTest-79148926 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:41:21 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-d0ccb093-27ee-455d-a3c6-506a11bc2953 tempest-CreateVolumesFromImageTest-79148926 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:41:21 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-d0ccb093-27ee-455d-a3c6-506a11bc2953 tempest-CreateVolumesFromImageTest-79148926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-96ab07c5-f175-4775-acad-a3720bac45fe 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:21 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-134cc282-5353-474e-8b6d-788dd78afc2f tempest-CreateVolumesFromImageTest-79148926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d971c9c-788c-471e-9bd8-9f3b37b7c043) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fbe3557-c97f-4d19-84de-051acd42c362', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:21 devstack sudo[111649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-96ab07c5-f175-4775-acad-a3720bac45fe 1073741824 Apr 29 15:41:21 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-134cc282-5353-474e-8b6d-788dd78afc2f tempest-CreateVolumesFromImageTest-79148926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f6575c4-5828-40b4-932f-44e1bcbbe896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:21 devstack sudo[111649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:21 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-134cc282-5353-474e-8b6d-788dd78afc2f tempest-CreateVolumesFromImageTest-79148926 None] Volume volume-7fbe3557-c97f-4d19-84de-051acd42c362 (7fbe3557-c97f-4d19-84de-051acd42c362): created successfully Apr 29 15:41:21 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-134cc282-5353-474e-8b6d-788dd78afc2f tempest-CreateVolumesFromImageTest-79148926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f6575c4-5828-40b4-932f-44e1bcbbe896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:21 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-134cc282-5353-474e-8b6d-788dd78afc2f tempest-CreateVolumesFromImageTest-79148926 None] Flow 'volume_create_manager' (e0b4f69b-dc23-4c50-9f02-af43a281c70f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:41:21 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-134cc282-5353-474e-8b6d-788dd78afc2f tempest-CreateVolumesFromImageTest-79148926 None] Created volume successfully. Apr 29 15:41:22 devstack sudo[111646]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:22 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7edd15b4-0774-47af-a38d-ebd51dbf5cf2 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_088bd261-61fd-428d-8444-2cf93043dc26_7fytk1wsdevstack@QuobyteHD" returned: 0 in 0.715s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:22 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7edd15b4-0774-47af-a38d-ebd51dbf5cf2 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_088bd261-61fd-428d-8444-2cf93043dc26_7fytk1wsdevstack@QuobyteHD {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:22 devstack sudo[111653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_088bd261-61fd-428d-8444-2cf93043dc26_7fytk1wsdevstack@QuobyteHD Apr 29 15:41:22 devstack sudo[111653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:22 devstack sudo[111649]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:22 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-d0ccb093-27ee-455d-a3c6-506a11bc2953 tempest-CreateVolumesFromImageTest-79148926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-96ab07c5-f175-4775-acad-a3720bac45fe 1073741824" returned: 0 in 0.816s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:22 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-d0ccb093-27ee-455d-a3c6-506a11bc2953 tempest-CreateVolumesFromImageTest-79148926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-96ab07c5-f175-4775-acad-a3720bac45fe {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:22 devstack sudo[111659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-96ab07c5-f175-4775-acad-a3720bac45fe Apr 29 15:41:22 devstack sudo[111659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:22 devstack sudo[111653]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:22 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7edd15b4-0774-47af-a38d-ebd51dbf5cf2 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_088bd261-61fd-428d-8444-2cf93043dc26_7fytk1wsdevstack@QuobyteHD" returned: 1 in 0.745s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:22 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7edd15b4-0774-47af-a38d-ebd51dbf5cf2 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_088bd261-61fd-428d-8444-2cf93043dc26_7fytk1wsdevstack@QuobyteHD' failed. Not Retrying. {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 15:41:22 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-7edd15b4-0774-47af-a38d-ebd51dbf5cf2 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:41:23 devstack sudo[111659]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:23 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-d0ccb093-27ee-455d-a3c6-506a11bc2953 tempest-CreateVolumesFromImageTest-79148926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-96ab07c5-f175-4775-acad-a3720bac45fe" returned: 0 in 0.622s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:23 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-d0ccb093-27ee-455d-a3c6-506a11bc2953 tempest-CreateVolumesFromImageTest-79148926 None] <== create_volume: return (1478ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:41:23 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-d0ccb093-27ee-455d-a3c6-506a11bc2953 tempest-CreateVolumesFromImageTest-79148926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.480s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:41:23 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-a015aa3a-85f8-4614-a8ac-e8470fbaf04a tempest-CreateVolumesFromImageTest-79148926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.780s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:41:23 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-a015aa3a-85f8-4614-a8ac-e8470fbaf04a tempest-CreateVolumesFromImageTest-79148926 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:41:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-188795477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6664503f-153f-4972-9945-d9958a0372c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b202cc22c5e43109541afb133c26682',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:41:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:41:16Z,use_quota=True,user_id='154e1811faf34ef487e547afeebbf63d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:41:23 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-a015aa3a-85f8-4614-a8ac-e8470fbaf04a tempest-CreateVolumesFromImageTest-79148926 None] Creating volume 6664503f-153f-4972-9945-d9958a0372c7 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:41:23 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-a015aa3a-85f8-4614-a8ac-e8470fbaf04a tempest-CreateVolumesFromImageTest-79148926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:41:23 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-a015aa3a-85f8-4614-a8ac-e8470fbaf04a tempest-CreateVolumesFromImageTest-79148926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:41:23 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-a015aa3a-85f8-4614-a8ac-e8470fbaf04a tempest-CreateVolumesFromImageTest-79148926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:41:23 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-a015aa3a-85f8-4614-a8ac-e8470fbaf04a tempest-CreateVolumesFromImageTest-79148926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:41:23 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-a015aa3a-85f8-4614-a8ac-e8470fbaf04a tempest-CreateVolumesFromImageTest-79148926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:41:23 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-a015aa3a-85f8-4614-a8ac-e8470fbaf04a tempest-CreateVolumesFromImageTest-79148926 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:41:23 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-a015aa3a-85f8-4614-a8ac-e8470fbaf04a tempest-CreateVolumesFromImageTest-79148926 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:41:23 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a015aa3a-85f8-4614-a8ac-e8470fbaf04a tempest-CreateVolumesFromImageTest-79148926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-6664503f-153f-4972-9945-d9958a0372c7 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:23 devstack sudo[111665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-6664503f-153f-4972-9945-d9958a0372c7 1073741824 Apr 29 15:41:23 devstack sudo[111665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:23 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-d0ccb093-27ee-455d-a3c6-506a11bc2953 tempest-CreateVolumesFromImageTest-79148926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bbbd68f-d5ea-4575-ab88-ed1b615d4a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96ab07c5-f175-4775-acad-a3720bac45fe', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:23 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-d0ccb093-27ee-455d-a3c6-506a11bc2953 tempest-CreateVolumesFromImageTest-79148926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0414d595-1894-411d-b290-8bb5b9a7fb35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:23 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-d0ccb093-27ee-455d-a3c6-506a11bc2953 tempest-CreateVolumesFromImageTest-79148926 None] Volume volume-96ab07c5-f175-4775-acad-a3720bac45fe (96ab07c5-f175-4775-acad-a3720bac45fe): created successfully Apr 29 15:41:23 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-d0ccb093-27ee-455d-a3c6-506a11bc2953 tempest-CreateVolumesFromImageTest-79148926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0414d595-1894-411d-b290-8bb5b9a7fb35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:23 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-d0ccb093-27ee-455d-a3c6-506a11bc2953 tempest-CreateVolumesFromImageTest-79148926 None] Flow 'volume_create_manager' (797e6465-e546-48a0-8f7f-0791e01799e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:41:23 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-d0ccb093-27ee-455d-a3c6-506a11bc2953 tempest-CreateVolumesFromImageTest-79148926 None] Created volume successfully. Apr 29 15:41:23 devstack sudo[111665]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:23 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a015aa3a-85f8-4614-a8ac-e8470fbaf04a tempest-CreateVolumesFromImageTest-79148926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-6664503f-153f-4972-9945-d9958a0372c7 1073741824" returned: 0 in 0.771s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:23 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a015aa3a-85f8-4614-a8ac-e8470fbaf04a tempest-CreateVolumesFromImageTest-79148926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-6664503f-153f-4972-9945-d9958a0372c7 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:23 devstack sudo[111670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-6664503f-153f-4972-9945-d9958a0372c7 Apr 29 15:41:23 devstack sudo[111670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:24 devstack sudo[111670]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:24 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a015aa3a-85f8-4614-a8ac-e8470fbaf04a tempest-CreateVolumesFromImageTest-79148926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-6664503f-153f-4972-9945-d9958a0372c7" returned: 0 in 0.613s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:24 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-a015aa3a-85f8-4614-a8ac-e8470fbaf04a tempest-CreateVolumesFromImageTest-79148926 None] <== create_volume: return (1422ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:41:24 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-a015aa3a-85f8-4614-a8ac-e8470fbaf04a tempest-CreateVolumesFromImageTest-79148926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.425s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:41:24 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-d89bf766-dd2f-4dbc-b75e-609e8f2ac47c tempest-CreateVolumesFromImageTest-79148926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.898s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:41:24 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-d89bf766-dd2f-4dbc-b75e-609e8f2ac47c tempest-CreateVolumesFromImageTest-79148926 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:41:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-72742136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e24c189-dcf3-4100-8d0a-720caebb914c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b202cc22c5e43109541afb133c26682',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:41:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:41:17Z,use_quota=True,user_id='154e1811faf34ef487e547afeebbf63d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:41:24 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-d89bf766-dd2f-4dbc-b75e-609e8f2ac47c tempest-CreateVolumesFromImageTest-79148926 None] Creating volume 8e24c189-dcf3-4100-8d0a-720caebb914c {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:41:24 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-d89bf766-dd2f-4dbc-b75e-609e8f2ac47c tempest-CreateVolumesFromImageTest-79148926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:41:24 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-d89bf766-dd2f-4dbc-b75e-609e8f2ac47c tempest-CreateVolumesFromImageTest-79148926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:41:24 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-d89bf766-dd2f-4dbc-b75e-609e8f2ac47c tempest-CreateVolumesFromImageTest-79148926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:41:24 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-d89bf766-dd2f-4dbc-b75e-609e8f2ac47c tempest-CreateVolumesFromImageTest-79148926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:41:24 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-d89bf766-dd2f-4dbc-b75e-609e8f2ac47c tempest-CreateVolumesFromImageTest-79148926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:41:24 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-d89bf766-dd2f-4dbc-b75e-609e8f2ac47c tempest-CreateVolumesFromImageTest-79148926 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:41:24 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-d89bf766-dd2f-4dbc-b75e-609e8f2ac47c tempest-CreateVolumesFromImageTest-79148926 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:41:24 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-d89bf766-dd2f-4dbc-b75e-609e8f2ac47c tempest-CreateVolumesFromImageTest-79148926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-8e24c189-dcf3-4100-8d0a-720caebb914c 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:24 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-a015aa3a-85f8-4614-a8ac-e8470fbaf04a tempest-CreateVolumesFromImageTest-79148926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ca44a3b-5e80-4807-9793-c554a3b09a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6664503f-153f-4972-9945-d9958a0372c7', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:24 devstack sudo[111673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-8e24c189-dcf3-4100-8d0a-720caebb914c 1073741824 Apr 29 15:41:24 devstack sudo[111673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:24 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-a015aa3a-85f8-4614-a8ac-e8470fbaf04a tempest-CreateVolumesFromImageTest-79148926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51fd3d93-67fd-4726-9420-ee5ec03088d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:24 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-a015aa3a-85f8-4614-a8ac-e8470fbaf04a tempest-CreateVolumesFromImageTest-79148926 None] Volume volume-6664503f-153f-4972-9945-d9958a0372c7 (6664503f-153f-4972-9945-d9958a0372c7): created successfully Apr 29 15:41:24 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-a015aa3a-85f8-4614-a8ac-e8470fbaf04a tempest-CreateVolumesFromImageTest-79148926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51fd3d93-67fd-4726-9420-ee5ec03088d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:24 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-a015aa3a-85f8-4614-a8ac-e8470fbaf04a tempest-CreateVolumesFromImageTest-79148926 None] Flow 'volume_create_manager' (7062d91a-6ac6-4dc9-a69d-d552e1105183) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:41:24 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-a015aa3a-85f8-4614-a8ac-e8470fbaf04a tempest-CreateVolumesFromImageTest-79148926 None] Created volume successfully. Apr 29 15:41:25 devstack sudo[111673]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-d89bf766-dd2f-4dbc-b75e-609e8f2ac47c tempest-CreateVolumesFromImageTest-79148926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-8e24c189-dcf3-4100-8d0a-720caebb914c 1073741824" returned: 0 in 0.799s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-d89bf766-dd2f-4dbc-b75e-609e8f2ac47c tempest-CreateVolumesFromImageTest-79148926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-8e24c189-dcf3-4100-8d0a-720caebb914c {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:25 devstack sudo[111679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-8e24c189-dcf3-4100-8d0a-720caebb914c Apr 29 15:41:25 devstack sudo[111679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:26 devstack sudo[111679]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-d89bf766-dd2f-4dbc-b75e-609e8f2ac47c tempest-CreateVolumesFromImageTest-79148926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-8e24c189-dcf3-4100-8d0a-720caebb914c" returned: 0 in 0.614s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:26 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-d89bf766-dd2f-4dbc-b75e-609e8f2ac47c tempest-CreateVolumesFromImageTest-79148926 None] <== create_volume: return (1454ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:41:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-d89bf766-dd2f-4dbc-b75e-609e8f2ac47c tempest-CreateVolumesFromImageTest-79148926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.458s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:41:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-2b4f6a39-00c1-424e-9690-3e207530f60e tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.438s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:41:26 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-2b4f6a39-00c1-424e-9690-3e207530f60e tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:41:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-892311867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d237bd67-b183-42c1-9ab5-64b4e20eef4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e6c1e909d4b4ca39ad93d5e4b6a34e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:41:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:41:17Z,use_quota=True,user_id='eee87ab7247540bab787424726812dc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:41:26 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-2b4f6a39-00c1-424e-9690-3e207530f60e tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Creating volume d237bd67-b183-42c1-9ab5-64b4e20eef4c {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:41:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-2b4f6a39-00c1-424e-9690-3e207530f60e tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:41:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-2b4f6a39-00c1-424e-9690-3e207530f60e tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:41:26 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-2b4f6a39-00c1-424e-9690-3e207530f60e tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:41:26 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-2b4f6a39-00c1-424e-9690-3e207530f60e tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:41:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-2b4f6a39-00c1-424e-9690-3e207530f60e tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:41:26 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-2b4f6a39-00c1-424e-9690-3e207530f60e tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:41:26 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-2b4f6a39-00c1-424e-9690-3e207530f60e tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:41:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-2b4f6a39-00c1-424e-9690-3e207530f60e tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d237bd67-b183-42c1-9ab5-64b4e20eef4c 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:26 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-d89bf766-dd2f-4dbc-b75e-609e8f2ac47c tempest-CreateVolumesFromImageTest-79148926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db92c919-f2c5-4afa-b0dc-4f0d5308c0fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e24c189-dcf3-4100-8d0a-720caebb914c', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:26 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-d89bf766-dd2f-4dbc-b75e-609e8f2ac47c tempest-CreateVolumesFromImageTest-79148926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9997d26-43c7-4465-80cc-736cb2d4532b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:26 devstack sudo[111682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d237bd67-b183-42c1-9ab5-64b4e20eef4c 1073741824 Apr 29 15:41:26 devstack sudo[111682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:26 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-d89bf766-dd2f-4dbc-b75e-609e8f2ac47c tempest-CreateVolumesFromImageTest-79148926 None] Volume volume-8e24c189-dcf3-4100-8d0a-720caebb914c (8e24c189-dcf3-4100-8d0a-720caebb914c): created successfully Apr 29 15:41:26 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-d89bf766-dd2f-4dbc-b75e-609e8f2ac47c tempest-CreateVolumesFromImageTest-79148926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9997d26-43c7-4465-80cc-736cb2d4532b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:26 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-d89bf766-dd2f-4dbc-b75e-609e8f2ac47c tempest-CreateVolumesFromImageTest-79148926 None] Flow 'volume_create_manager' (c401dedf-d568-4428-ab3c-4bbbbc531acb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:41:26 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-d89bf766-dd2f-4dbc-b75e-609e8f2ac47c tempest-CreateVolumesFromImageTest-79148926 None] Created volume successfully. Apr 29 15:41:26 devstack sudo[111682]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-2b4f6a39-00c1-424e-9690-3e207530f60e tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d237bd67-b183-42c1-9ab5-64b4e20eef4c 1073741824" returned: 0 in 0.784s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-2b4f6a39-00c1-424e-9690-3e207530f60e tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d237bd67-b183-42c1-9ab5-64b4e20eef4c {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:26 devstack sudo[111689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d237bd67-b183-42c1-9ab5-64b4e20eef4c Apr 29 15:41:26 devstack sudo[111689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:26 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-7a546d4f-d7d8-4074-b3b0-815d4e2c24a5 tempest-CreateVolumesFromImageTest-79148926 None] Acquiring lock "cinder-8e24c189-dcf3-4100-8d0a-720caebb914c-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:41:26 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-7a546d4f-d7d8-4074-b3b0-815d4e2c24a5 tempest-CreateVolumesFromImageTest-79148926 None] Lock "cinder-8e24c189-dcf3-4100-8d0a-720caebb914c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:41:26 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-7a546d4f-d7d8-4074-b3b0-815d4e2c24a5 tempest-CreateVolumesFromImageTest-79148926 None] Acquiring lock "cinder-quobyte-8e24c189-dcf3-4100-8d0a-720caebb914c" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:41:27 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-7a546d4f-d7d8-4074-b3b0-815d4e2c24a5 tempest-CreateVolumesFromImageTest-79148926 None] Lock "cinder-quobyte-8e24c189-dcf3-4100-8d0a-720caebb914c" acquired by "delete_volume" :: waited 0.014s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:41:27 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[725047bf-f4b6-4833-87c3-f17fab408e08]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:41:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7a546d4f-d7d8-4074-b3b0-815d4e2c24a5 tempest-CreateVolumesFromImageTest-79148926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-8e24c189-dcf3-4100-8d0a-720caebb914c {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:27 devstack sudo[111691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-8e24c189-dcf3-4100-8d0a-720caebb914c Apr 29 15:41:27 devstack sudo[111691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:27 devstack sudo[111689]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-2b4f6a39-00c1-424e-9690-3e207530f60e tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d237bd67-b183-42c1-9ab5-64b4e20eef4c" returned: 0 in 0.624s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:27 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-2b4f6a39-00c1-424e-9690-3e207530f60e tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] <== create_volume: return (1449ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:41:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-2b4f6a39-00c1-424e-9690-3e207530f60e tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.453s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:41:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-8151a652-ccd5-472f-9313-60ad2bc33829 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.568s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:41:27 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-8151a652-ccd5-472f-9313-60ad2bc33829 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:41:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1260975058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e992d98-714b-4a98-b707-dc3ebe9fbd1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e6c1e909d4b4ca39ad93d5e4b6a34e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:41:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:41:18Z,use_quota=True,user_id='eee87ab7247540bab787424726812dc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:41:27 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-8151a652-ccd5-472f-9313-60ad2bc33829 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Creating volume 8e992d98-714b-4a98-b707-dc3ebe9fbd1b {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:41:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-8151a652-ccd5-472f-9313-60ad2bc33829 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:41:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-8151a652-ccd5-472f-9313-60ad2bc33829 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:41:27 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-8151a652-ccd5-472f-9313-60ad2bc33829 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:41:27 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-8151a652-ccd5-472f-9313-60ad2bc33829 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:41:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-8151a652-ccd5-472f-9313-60ad2bc33829 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:41:27 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-8151a652-ccd5-472f-9313-60ad2bc33829 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:41:27 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-8151a652-ccd5-472f-9313-60ad2bc33829 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:41:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-8151a652-ccd5-472f-9313-60ad2bc33829 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-8e992d98-714b-4a98-b707-dc3ebe9fbd1b 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:27 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-2b4f6a39-00c1-424e-9690-3e207530f60e tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cb3c463-3102-47f7-ab49-ef143bad2145) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d237bd67-b183-42c1-9ab5-64b4e20eef4c', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:27 devstack sudo[111694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-8e992d98-714b-4a98-b707-dc3ebe9fbd1b 1073741824 Apr 29 15:41:27 devstack sudo[111694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:27 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-2b4f6a39-00c1-424e-9690-3e207530f60e tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a311b01-35a9-4279-a9a4-51a56832ef74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:27 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-2b4f6a39-00c1-424e-9690-3e207530f60e tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Volume volume-d237bd67-b183-42c1-9ab5-64b4e20eef4c (d237bd67-b183-42c1-9ab5-64b4e20eef4c): created successfully Apr 29 15:41:27 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-2b4f6a39-00c1-424e-9690-3e207530f60e tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a311b01-35a9-4279-a9a4-51a56832ef74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:27 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-2b4f6a39-00c1-424e-9690-3e207530f60e tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Flow 'volume_create_manager' (95ce1889-a2d0-471d-9cbf-761317d1a961) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:41:27 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-2b4f6a39-00c1-424e-9690-3e207530f60e tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Created volume successfully. Apr 29 15:41:27 devstack sudo[111691]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7a546d4f-d7d8-4074-b3b0-815d4e2c24a5 tempest-CreateVolumesFromImageTest-79148926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-8e24c189-dcf3-4100-8d0a-720caebb914c" returned: 0 in 0.757s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7a546d4f-d7d8-4074-b3b0-815d4e2c24a5 tempest-CreateVolumesFromImageTest-79148926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-8e24c189-dcf3-4100-8d0a-720caebb914c {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:27 devstack sudo[111699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-8e24c189-dcf3-4100-8d0a-720caebb914c Apr 29 15:41:27 devstack sudo[111699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:28 devstack sudo[111694]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-8151a652-ccd5-472f-9313-60ad2bc33829 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-8e992d98-714b-4a98-b707-dc3ebe9fbd1b 1073741824" returned: 0 in 0.829s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-8151a652-ccd5-472f-9313-60ad2bc33829 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-8e992d98-714b-4a98-b707-dc3ebe9fbd1b {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:28 devstack sudo[111705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-8e992d98-714b-4a98-b707-dc3ebe9fbd1b Apr 29 15:41:28 devstack sudo[111705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:28 devstack sudo[111699]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7a546d4f-d7d8-4074-b3b0-815d4e2c24a5 tempest-CreateVolumesFromImageTest-79148926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-8e24c189-dcf3-4100-8d0a-720caebb914c" returned: 0 in 0.671s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:28 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-7a546d4f-d7d8-4074-b3b0-815d4e2c24a5 tempest-CreateVolumesFromImageTest-79148926 None] Lock "cinder-quobyte-8e24c189-dcf3-4100-8d0a-720caebb914c" released by "delete_volume" :: held 1.469s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:41:28 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-7a546d4f-d7d8-4074-b3b0-815d4e2c24a5 tempest-CreateVolumesFromImageTest-79148926 None] Created reservations ['7268b46c-9ecf-438c-8c85-bc1f8f8ae28c', '622e0086-3f3e-49e1-8bdb-ef0f40f90646', '6bd7e2a7-eb88-49d3-a558-7ffa87ebd4a4', 'fe21fcfd-8190-45b6-9bea-22c0c2345a3d'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:41:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-7a546d4f-d7d8-4074-b3b0-815d4e2c24a5 tempest-CreateVolumesFromImageTest-79148926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:41:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-7a546d4f-d7d8-4074-b3b0-815d4e2c24a5 tempest-CreateVolumesFromImageTest-79148926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:41:28 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-7a546d4f-d7d8-4074-b3b0-815d4e2c24a5 tempest-CreateVolumesFromImageTest-79148926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:41:28 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-7a546d4f-d7d8-4074-b3b0-815d4e2c24a5 tempest-CreateVolumesFromImageTest-79148926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:41:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-7a546d4f-d7d8-4074-b3b0-815d4e2c24a5 tempest-CreateVolumesFromImageTest-79148926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:41:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7a546d4f-d7d8-4074-b3b0-815d4e2c24a5 tempest-CreateVolumesFromImageTest-79148926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:28 devstack sudo[111707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:41:28 devstack sudo[111707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:28 devstack sudo[111705]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-8151a652-ccd5-472f-9313-60ad2bc33829 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-8e992d98-714b-4a98-b707-dc3ebe9fbd1b" returned: 0 in 0.609s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:28 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-8151a652-ccd5-472f-9313-60ad2bc33829 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] <== create_volume: return (1479ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:41:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-8151a652-ccd5-472f-9313-60ad2bc33829 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.482s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:41:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-06bf78ff-9110-431f-8c48-43d4789e46e2 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.584s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:41:28 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-06bf78ff-9110-431f-8c48-43d4789e46e2 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:41:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2112110595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f63064e-35fd-4071-a770-949e073a17c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e6c1e909d4b4ca39ad93d5e4b6a34e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:41:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:41:18Z,use_quota=True,user_id='eee87ab7247540bab787424726812dc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:41:28 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-06bf78ff-9110-431f-8c48-43d4789e46e2 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Creating volume 6f63064e-35fd-4071-a770-949e073a17c4 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:41:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-06bf78ff-9110-431f-8c48-43d4789e46e2 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:41:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-06bf78ff-9110-431f-8c48-43d4789e46e2 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:41:28 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-06bf78ff-9110-431f-8c48-43d4789e46e2 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:41:28 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-06bf78ff-9110-431f-8c48-43d4789e46e2 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:41:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-06bf78ff-9110-431f-8c48-43d4789e46e2 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:41:28 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-06bf78ff-9110-431f-8c48-43d4789e46e2 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:41:28 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-06bf78ff-9110-431f-8c48-43d4789e46e2 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:41:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-06bf78ff-9110-431f-8c48-43d4789e46e2 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-6f63064e-35fd-4071-a770-949e073a17c4 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:29 devstack sudo[111710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-6f63064e-35fd-4071-a770-949e073a17c4 1073741824 Apr 29 15:41:29 devstack sudo[111710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:29 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-8151a652-ccd5-472f-9313-60ad2bc33829 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7d7660d-6b9c-4cc3-80ca-e2d455a4e41e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e992d98-714b-4a98-b707-dc3ebe9fbd1b', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:29 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-8151a652-ccd5-472f-9313-60ad2bc33829 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b6db408-3e78-4ccb-8ac6-6472c6f23e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:29 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-8151a652-ccd5-472f-9313-60ad2bc33829 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Volume volume-8e992d98-714b-4a98-b707-dc3ebe9fbd1b (8e992d98-714b-4a98-b707-dc3ebe9fbd1b): created successfully Apr 29 15:41:29 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-8151a652-ccd5-472f-9313-60ad2bc33829 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b6db408-3e78-4ccb-8ac6-6472c6f23e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:29 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-8151a652-ccd5-472f-9313-60ad2bc33829 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Flow 'volume_create_manager' (48cc93ab-97c8-44ab-9fe8-694c536446b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:41:29 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-8151a652-ccd5-472f-9313-60ad2bc33829 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Created volume successfully. Apr 29 15:41:29 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a969ff07-fc34-45fd-94e0-3e7967546789 tempest-CreateVolumesFromImageTest-79148926 None] Acquiring lock "cinder-6664503f-153f-4972-9945-d9958a0372c7-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:41:29 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a969ff07-fc34-45fd-94e0-3e7967546789 tempest-CreateVolumesFromImageTest-79148926 None] Lock "cinder-6664503f-153f-4972-9945-d9958a0372c7-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:41:29 devstack sudo[111707]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7a546d4f-d7d8-4074-b3b0-815d4e2c24a5 tempest-CreateVolumesFromImageTest-79148926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.644s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:29 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-7a546d4f-d7d8-4074-b3b0-815d4e2c24a5 tempest-CreateVolumesFromImageTest-79148926 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:41:29 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a969ff07-fc34-45fd-94e0-3e7967546789 tempest-CreateVolumesFromImageTest-79148926 None] Acquiring lock "cinder-quobyte-6664503f-153f-4972-9945-d9958a0372c7" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:41:29 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-7a546d4f-d7d8-4074-b3b0-815d4e2c24a5 tempest-CreateVolumesFromImageTest-79148926 None] Deleted volume successfully. Apr 29 15:41:29 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a969ff07-fc34-45fd-94e0-3e7967546789 tempest-CreateVolumesFromImageTest-79148926 None] Lock "cinder-quobyte-6664503f-153f-4972-9945-d9958a0372c7" acquired by "delete_volume" :: waited 0.035s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:41:29 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-7a546d4f-d7d8-4074-b3b0-815d4e2c24a5 tempest-CreateVolumesFromImageTest-79148926 None] Lock "cinder-8e24c189-dcf3-4100-8d0a-720caebb914c-delete_volume" released by "delete_volume" :: held 2.354s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:41:29 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae77d9f6-85d7-4011-8a35-2fda245c194d]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:41:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a969ff07-fc34-45fd-94e0-3e7967546789 tempest-CreateVolumesFromImageTest-79148926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-6664503f-153f-4972-9945-d9958a0372c7 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:29 devstack sudo[111713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-6664503f-153f-4972-9945-d9958a0372c7 Apr 29 15:41:29 devstack sudo[111713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:29 devstack sudo[111710]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-06bf78ff-9110-431f-8c48-43d4789e46e2 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-6f63064e-35fd-4071-a770-949e073a17c4 1073741824" returned: 0 in 0.743s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-06bf78ff-9110-431f-8c48-43d4789e46e2 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-6f63064e-35fd-4071-a770-949e073a17c4 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:29 devstack sudo[111718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-6f63064e-35fd-4071-a770-949e073a17c4 Apr 29 15:41:29 devstack sudo[111718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:30 devstack sudo[111713]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a969ff07-fc34-45fd-94e0-3e7967546789 tempest-CreateVolumesFromImageTest-79148926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-6664503f-153f-4972-9945-d9958a0372c7" returned: 0 in 0.817s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a969ff07-fc34-45fd-94e0-3e7967546789 tempest-CreateVolumesFromImageTest-79148926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-6664503f-153f-4972-9945-d9958a0372c7 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:30 devstack sudo[111723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-6664503f-153f-4972-9945-d9958a0372c7 Apr 29 15:41:30 devstack sudo[111723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:30 devstack sudo[111718]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-06bf78ff-9110-431f-8c48-43d4789e46e2 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-6f63064e-35fd-4071-a770-949e073a17c4" returned: 0 in 0.616s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-06bf78ff-9110-431f-8c48-43d4789e46e2 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] <== create_volume: return (1405ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:41:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-06bf78ff-9110-431f-8c48-43d4789e46e2 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.408s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:41:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-71af3f03-49fb-4f7a-a9bd-55e79834190e tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.521s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:41:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-71af3f03-49fb-4f7a-a9bd-55e79834190e tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:41:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-253172271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74729239-9924-4739-9924-ae4226ae8fa2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e6c1e909d4b4ca39ad93d5e4b6a34e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:41:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:41:19Z,use_quota=True,user_id='eee87ab7247540bab787424726812dc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:41:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-71af3f03-49fb-4f7a-a9bd-55e79834190e tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Creating volume 74729239-9924-4739-9924-ae4226ae8fa2 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:41:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-71af3f03-49fb-4f7a-a9bd-55e79834190e tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:41:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-71af3f03-49fb-4f7a-a9bd-55e79834190e tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:41:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-71af3f03-49fb-4f7a-a9bd-55e79834190e tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:41:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-71af3f03-49fb-4f7a-a9bd-55e79834190e tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:41:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-71af3f03-49fb-4f7a-a9bd-55e79834190e tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:41:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-71af3f03-49fb-4f7a-a9bd-55e79834190e tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:41:30 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-71af3f03-49fb-4f7a-a9bd-55e79834190e tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:41:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-71af3f03-49fb-4f7a-a9bd-55e79834190e tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-74729239-9924-4739-9924-ae4226ae8fa2 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:30 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-06bf78ff-9110-431f-8c48-43d4789e46e2 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (565b6a82-1440-485d-9239-25feb09cf557) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f63064e-35fd-4071-a770-949e073a17c4', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:30 devstack sudo[111726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-74729239-9924-4739-9924-ae4226ae8fa2 1073741824 Apr 29 15:41:30 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-06bf78ff-9110-431f-8c48-43d4789e46e2 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58ee6667-1e04-46af-9dc0-15709f2c2554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:30 devstack sudo[111726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:30 devstack cinder-volume[84448]: DEBUG oslo_service.periodic_task [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84448) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 15:41:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:41:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:41:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:41:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:41:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:41:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:30 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-06bf78ff-9110-431f-8c48-43d4789e46e2 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Volume volume-6f63064e-35fd-4071-a770-949e073a17c4 (6f63064e-35fd-4071-a770-949e073a17c4): created successfully Apr 29 15:41:30 devstack sudo[111728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:41:30 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-06bf78ff-9110-431f-8c48-43d4789e46e2 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58ee6667-1e04-46af-9dc0-15709f2c2554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:30 devstack sudo[111728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:30 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-06bf78ff-9110-431f-8c48-43d4789e46e2 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Flow 'volume_create_manager' (487c1058-04ac-4f59-b8fc-d03623f40cb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:41:30 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-06bf78ff-9110-431f-8c48-43d4789e46e2 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Created volume successfully. Apr 29 15:41:30 devstack sudo[111723]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a969ff07-fc34-45fd-94e0-3e7967546789 tempest-CreateVolumesFromImageTest-79148926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-6664503f-153f-4972-9945-d9958a0372c7" returned: 0 in 0.638s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:30 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a969ff07-fc34-45fd-94e0-3e7967546789 tempest-CreateVolumesFromImageTest-79148926 None] Lock "cinder-quobyte-6664503f-153f-4972-9945-d9958a0372c7" released by "delete_volume" :: held 1.504s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:41:30 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-a969ff07-fc34-45fd-94e0-3e7967546789 tempest-CreateVolumesFromImageTest-79148926 None] Created reservations ['5e4ed592-cb5f-48b5-8894-6b9305478ca7', 'b447562a-0b1a-46ee-bf7e-b5aafc185898', 'ab40447c-6774-44db-9336-7db82b6a562f', 'f74bee2f-df92-489d-83c5-f6368ba98af6'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:41:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-a969ff07-fc34-45fd-94e0-3e7967546789 tempest-CreateVolumesFromImageTest-79148926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:41:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-a969ff07-fc34-45fd-94e0-3e7967546789 tempest-CreateVolumesFromImageTest-79148926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:41:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-a969ff07-fc34-45fd-94e0-3e7967546789 tempest-CreateVolumesFromImageTest-79148926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:41:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-a969ff07-fc34-45fd-94e0-3e7967546789 tempest-CreateVolumesFromImageTest-79148926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:41:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-a969ff07-fc34-45fd-94e0-3e7967546789 tempest-CreateVolumesFromImageTest-79148926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:41:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a969ff07-fc34-45fd-94e0-3e7967546789 tempest-CreateVolumesFromImageTest-79148926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:30 devstack sudo[111733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:41:30 devstack sudo[111733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:31 devstack sudo[111728]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.680s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:31 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:41:31 devstack sudo[111726]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-71af3f03-49fb-4f7a-a9bd-55e79834190e tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-74729239-9924-4739-9924-ae4226ae8fa2 1073741824" returned: 0 in 0.845s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-71af3f03-49fb-4f7a-a9bd-55e79834190e tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-74729239-9924-4739-9924-ae4226ae8fa2 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:31 devstack sudo[111737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-74729239-9924-4739-9924-ae4226ae8fa2 Apr 29 15:41:31 devstack sudo[111737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:31 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-0a553462-4e51-4cff-ac8b-e86699ba6ae4 tempest-CreateVolumesFromImageTest-79148926 None] Acquiring lock "cinder-96ab07c5-f175-4775-acad-a3720bac45fe-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:41:31 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-0a553462-4e51-4cff-ac8b-e86699ba6ae4 tempest-CreateVolumesFromImageTest-79148926 None] Lock "cinder-96ab07c5-f175-4775-acad-a3720bac45fe-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:41:31 devstack sudo[111733]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a969ff07-fc34-45fd-94e0-3e7967546789 tempest-CreateVolumesFromImageTest-79148926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.627s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:31 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-a969ff07-fc34-45fd-94e0-3e7967546789 tempest-CreateVolumesFromImageTest-79148926 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:41:31 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-0a553462-4e51-4cff-ac8b-e86699ba6ae4 tempest-CreateVolumesFromImageTest-79148926 None] Acquiring lock "cinder-quobyte-96ab07c5-f175-4775-acad-a3720bac45fe" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:41:31 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-a969ff07-fc34-45fd-94e0-3e7967546789 tempest-CreateVolumesFromImageTest-79148926 None] Deleted volume successfully. Apr 29 15:41:31 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-0a553462-4e51-4cff-ac8b-e86699ba6ae4 tempest-CreateVolumesFromImageTest-79148926 None] Lock "cinder-quobyte-96ab07c5-f175-4775-acad-a3720bac45fe" acquired by "delete_volume" :: waited 0.023s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:41:31 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a969ff07-fc34-45fd-94e0-3e7967546789 tempest-CreateVolumesFromImageTest-79148926 None] Lock "cinder-6664503f-153f-4972-9945-d9958a0372c7-delete_volume" released by "delete_volume" :: held 2.374s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:41:31 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[d903797d-a389-499a-9724-b8f2bf3f6fcc]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:41:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-0a553462-4e51-4cff-ac8b-e86699ba6ae4 tempest-CreateVolumesFromImageTest-79148926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-96ab07c5-f175-4775-acad-a3720bac45fe {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:31 devstack sudo[111740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-96ab07c5-f175-4775-acad-a3720bac45fe Apr 29 15:41:31 devstack sudo[111740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:31 devstack sudo[111737]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-71af3f03-49fb-4f7a-a9bd-55e79834190e tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-74729239-9924-4739-9924-ae4226ae8fa2" returned: 0 in 0.674s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:31 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-71af3f03-49fb-4f7a-a9bd-55e79834190e tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] <== create_volume: return (1559ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:41:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-71af3f03-49fb-4f7a-a9bd-55e79834190e tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.562s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:41:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-6d86d833-37db-4385-b20f-b02b0100263f tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.468s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:41:31 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-6d86d833-37db-4385-b20f-b02b0100263f tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:41:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1203721398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5db738ae-fd78-4bcd-951a-54bab0f4c506,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e6c1e909d4b4ca39ad93d5e4b6a34e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:41:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:41:19Z,use_quota=True,user_id='eee87ab7247540bab787424726812dc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:41:31 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-6d86d833-37db-4385-b20f-b02b0100263f tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Creating volume 5db738ae-fd78-4bcd-951a-54bab0f4c506 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:41:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-6d86d833-37db-4385-b20f-b02b0100263f tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:41:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-6d86d833-37db-4385-b20f-b02b0100263f tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:41:31 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-6d86d833-37db-4385-b20f-b02b0100263f tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:41:31 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-6d86d833-37db-4385-b20f-b02b0100263f tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:41:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-6d86d833-37db-4385-b20f-b02b0100263f tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:41:31 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-6d86d833-37db-4385-b20f-b02b0100263f tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:41:31 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-6d86d833-37db-4385-b20f-b02b0100263f tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:41:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6d86d833-37db-4385-b20f-b02b0100263f tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5db738ae-fd78-4bcd-951a-54bab0f4c506 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:32 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-71af3f03-49fb-4f7a-a9bd-55e79834190e tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e6bbc3b-19d8-4d1c-9800-c6ce820d7213) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74729239-9924-4739-9924-ae4226ae8fa2', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:32 devstack sudo[111743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5db738ae-fd78-4bcd-951a-54bab0f4c506 1073741824 Apr 29 15:41:32 devstack sudo[111743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:32 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-71af3f03-49fb-4f7a-a9bd-55e79834190e tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bd98cad-f82f-429d-8ef8-a1e723f0d55b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:32 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-71af3f03-49fb-4f7a-a9bd-55e79834190e tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Volume volume-74729239-9924-4739-9924-ae4226ae8fa2 (74729239-9924-4739-9924-ae4226ae8fa2): created successfully Apr 29 15:41:32 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-71af3f03-49fb-4f7a-a9bd-55e79834190e tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bd98cad-f82f-429d-8ef8-a1e723f0d55b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:32 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-71af3f03-49fb-4f7a-a9bd-55e79834190e tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Flow 'volume_create_manager' (4907faa0-8e52-4fa5-b7eb-719bca66aec5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:41:32 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-71af3f03-49fb-4f7a-a9bd-55e79834190e tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Created volume successfully. Apr 29 15:41:32 devstack sudo[111740]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:32 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-0a553462-4e51-4cff-ac8b-e86699ba6ae4 tempest-CreateVolumesFromImageTest-79148926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-96ab07c5-f175-4775-acad-a3720bac45fe" returned: 0 in 0.736s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:32 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-0a553462-4e51-4cff-ac8b-e86699ba6ae4 tempest-CreateVolumesFromImageTest-79148926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-96ab07c5-f175-4775-acad-a3720bac45fe {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:32 devstack sudo[111748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-96ab07c5-f175-4775-acad-a3720bac45fe Apr 29 15:41:32 devstack sudo[111748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:32 devstack sudo[111743]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:32 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6d86d833-37db-4385-b20f-b02b0100263f tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5db738ae-fd78-4bcd-951a-54bab0f4c506 1073741824" returned: 0 in 0.867s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:32 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6d86d833-37db-4385-b20f-b02b0100263f tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5db738ae-fd78-4bcd-951a-54bab0f4c506 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:32 devstack sudo[111760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5db738ae-fd78-4bcd-951a-54bab0f4c506 Apr 29 15:41:32 devstack sudo[111760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:32 devstack sudo[111748]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:32 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-0a553462-4e51-4cff-ac8b-e86699ba6ae4 tempest-CreateVolumesFromImageTest-79148926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-96ab07c5-f175-4775-acad-a3720bac45fe" returned: 0 in 0.651s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:32 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-0a553462-4e51-4cff-ac8b-e86699ba6ae4 tempest-CreateVolumesFromImageTest-79148926 None] Lock "cinder-quobyte-96ab07c5-f175-4775-acad-a3720bac45fe" released by "delete_volume" :: held 1.434s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:41:33 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-0a553462-4e51-4cff-ac8b-e86699ba6ae4 tempest-CreateVolumesFromImageTest-79148926 None] Created reservations ['c2ecdaf4-4e42-4cff-8475-80d769d9afc2', '206634c5-e1c2-49d1-93d8-6eec5b609cd3', '52346a3c-9197-4c29-b5fb-408c4ee792b8', '581bddf6-21ce-472a-bdad-f579084fe5bb'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:41:33 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-0a553462-4e51-4cff-ac8b-e86699ba6ae4 tempest-CreateVolumesFromImageTest-79148926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:41:33 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-0a553462-4e51-4cff-ac8b-e86699ba6ae4 tempest-CreateVolumesFromImageTest-79148926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:41:33 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-0a553462-4e51-4cff-ac8b-e86699ba6ae4 tempest-CreateVolumesFromImageTest-79148926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:41:33 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-0a553462-4e51-4cff-ac8b-e86699ba6ae4 tempest-CreateVolumesFromImageTest-79148926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:41:33 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-0a553462-4e51-4cff-ac8b-e86699ba6ae4 tempest-CreateVolumesFromImageTest-79148926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:41:33 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-0a553462-4e51-4cff-ac8b-e86699ba6ae4 tempest-CreateVolumesFromImageTest-79148926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:33 devstack sudo[111762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:41:33 devstack sudo[111762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:33 devstack sudo[111760]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:33 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-6d86d833-37db-4385-b20f-b02b0100263f tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5db738ae-fd78-4bcd-951a-54bab0f4c506" returned: 0 in 0.629s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:33 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-6d86d833-37db-4385-b20f-b02b0100263f tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] <== create_volume: return (1544ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:41:33 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-6d86d833-37db-4385-b20f-b02b0100263f tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.547s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:41:33 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-35cf0739-0cbd-4e93-9857-9a84c5224f1c tempest-VolumeDependencyTests-347675874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 12.430s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:41:33 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-35cf0739-0cbd-4e93-9857-9a84c5224f1c tempest-VolumeDependencyTests-347675874 None] Creating offline snapshot 01b461f7-6528-4cac-bcd1-5d4f53c44885 of volume 125a8290-20d5-4d49-b9e0-6b57d70322f4 {{(pid=84448) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 15:41:33 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6d86d833-37db-4385-b20f-b02b0100263f tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eeaeca8-7c9a-4b1a-94d9-d697a8bf5628) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5db738ae-fd78-4bcd-951a-54bab0f4c506', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:33 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6d86d833-37db-4385-b20f-b02b0100263f tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3856f6f5-5ede-43b9-a4b4-4b76bfe60f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:33 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[b277a9cb-45ba-4575-ad8e-afdf9e2aec47]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:41:33 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-35cf0739-0cbd-4e93-9857-9a84c5224f1c tempest-VolumeDependencyTests-347675874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-125a8290-20d5-4d49-b9e0-6b57d70322f4 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:33 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-6d86d833-37db-4385-b20f-b02b0100263f tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Volume volume-5db738ae-fd78-4bcd-951a-54bab0f4c506 (5db738ae-fd78-4bcd-951a-54bab0f4c506): created successfully Apr 29 15:41:33 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6d86d833-37db-4385-b20f-b02b0100263f tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3856f6f5-5ede-43b9-a4b4-4b76bfe60f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:33 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-6d86d833-37db-4385-b20f-b02b0100263f tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Flow 'volume_create_manager' (ee9d200c-802e-4c86-a646-e8aba1eb1746) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:41:33 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-6d86d833-37db-4385-b20f-b02b0100263f tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Created volume successfully. Apr 29 15:41:33 devstack sudo[111765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-125a8290-20d5-4d49-b9e0-6b57d70322f4 Apr 29 15:41:33 devstack sudo[111765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:33 devstack sudo[111762]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:33 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-7b8c3f4e-89db-4cba-8c65-17d516d5d5f9 tempest-CreateVolumesFromImageTest-79148926 None] Acquiring lock "cinder-7fbe3557-c97f-4d19-84de-051acd42c362-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:41:33 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-0a553462-4e51-4cff-ac8b-e86699ba6ae4 tempest-CreateVolumesFromImageTest-79148926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.642s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:33 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-0a553462-4e51-4cff-ac8b-e86699ba6ae4 tempest-CreateVolumesFromImageTest-79148926 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:41:33 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-0a553462-4e51-4cff-ac8b-e86699ba6ae4 tempest-CreateVolumesFromImageTest-79148926 None] Deleted volume successfully. Apr 29 15:41:33 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-7b8c3f4e-89db-4cba-8c65-17d516d5d5f9 tempest-CreateVolumesFromImageTest-79148926 None] Lock "cinder-7fbe3557-c97f-4d19-84de-051acd42c362-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:41:33 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-0a553462-4e51-4cff-ac8b-e86699ba6ae4 tempest-CreateVolumesFromImageTest-79148926 None] Lock "cinder-96ab07c5-f175-4775-acad-a3720bac45fe-delete_volume" released by "delete_volume" :: held 2.312s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:41:33 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-7b8c3f4e-89db-4cba-8c65-17d516d5d5f9 tempest-CreateVolumesFromImageTest-79148926 None] Acquiring lock "cinder-quobyte-7fbe3557-c97f-4d19-84de-051acd42c362" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:41:33 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-7b8c3f4e-89db-4cba-8c65-17d516d5d5f9 tempest-CreateVolumesFromImageTest-79148926 None] Lock "cinder-quobyte-7fbe3557-c97f-4d19-84de-051acd42c362" acquired by "delete_volume" :: waited 0.015s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:41:33 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a74e5d-42e4-4cbb-8e5b-b0532b1dcfc0]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:41:33 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7b8c3f4e-89db-4cba-8c65-17d516d5d5f9 tempest-CreateVolumesFromImageTest-79148926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7fbe3557-c97f-4d19-84de-051acd42c362 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:33 devstack sudo[111768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7fbe3557-c97f-4d19-84de-051acd42c362 Apr 29 15:41:33 devstack sudo[111768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:34 devstack sudo[111765]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:34 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-35cf0739-0cbd-4e93-9857-9a84c5224f1c tempest-VolumeDependencyTests-347675874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-125a8290-20d5-4d49-b9e0-6b57d70322f4" returned: 0 in 0.739s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:34 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-35cf0739-0cbd-4e93-9857-9a84c5224f1c tempest-VolumeDependencyTests-347675874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-125a8290-20d5-4d49-b9e0-6b57d70322f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-125a8290-20d5-4d49-b9e0-6b57d70322f4.01b461f7-6528-4cac-bcd1-5d4f53c44885 1G {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:34 devstack sudo[111773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-125a8290-20d5-4d49-b9e0-6b57d70322f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-125a8290-20d5-4d49-b9e0-6b57d70322f4.01b461f7-6528-4cac-bcd1-5d4f53c44885 1G Apr 29 15:41:34 devstack sudo[111773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:34 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-afb17076-59b6-46f0-9d22-33525cdbf360 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Acquiring lock "cinder-5db738ae-fd78-4bcd-951a-54bab0f4c506-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:41:34 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-afb17076-59b6-46f0-9d22-33525cdbf360 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Lock "cinder-5db738ae-fd78-4bcd-951a-54bab0f4c506-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:41:34 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-afb17076-59b6-46f0-9d22-33525cdbf360 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Acquiring lock "cinder-quobyte-5db738ae-fd78-4bcd-951a-54bab0f4c506" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:41:34 devstack sudo[111768]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:34 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7b8c3f4e-89db-4cba-8c65-17d516d5d5f9 tempest-CreateVolumesFromImageTest-79148926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7fbe3557-c97f-4d19-84de-051acd42c362" returned: 0 in 0.766s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:34 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7b8c3f4e-89db-4cba-8c65-17d516d5d5f9 tempest-CreateVolumesFromImageTest-79148926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7fbe3557-c97f-4d19-84de-051acd42c362 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:34 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-afb17076-59b6-46f0-9d22-33525cdbf360 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Lock "cinder-quobyte-5db738ae-fd78-4bcd-951a-54bab0f4c506" acquired by "delete_volume" :: waited 0.031s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:41:34 devstack sudo[111779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7fbe3557-c97f-4d19-84de-051acd42c362 Apr 29 15:41:34 devstack sudo[111779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:34 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f90e75-9737-43b2-a73c-73774f722103]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:41:34 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-afb17076-59b6-46f0-9d22-33525cdbf360 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5db738ae-fd78-4bcd-951a-54bab0f4c506 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:34 devstack sudo[111781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5db738ae-fd78-4bcd-951a-54bab0f4c506 Apr 29 15:41:34 devstack sudo[111781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:35 devstack sudo[111773]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:35 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-35cf0739-0cbd-4e93-9857-9a84c5224f1c tempest-VolumeDependencyTests-347675874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-125a8290-20d5-4d49-b9e0-6b57d70322f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-125a8290-20d5-4d49-b9e0-6b57d70322f4.01b461f7-6528-4cac-bcd1-5d4f53c44885 1G" returned: 0 in 0.827s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:35 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-35cf0739-0cbd-4e93-9857-9a84c5224f1c tempest-VolumeDependencyTests-347675874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-125a8290-20d5-4d49-b9e0-6b57d70322f4 -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-125a8290-20d5-4d49-b9e0-6b57d70322f4.01b461f7-6528-4cac-bcd1-5d4f53c44885 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:35 devstack sudo[111786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-125a8290-20d5-4d49-b9e0-6b57d70322f4 -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-125a8290-20d5-4d49-b9e0-6b57d70322f4.01b461f7-6528-4cac-bcd1-5d4f53c44885 Apr 29 15:41:35 devstack sudo[111786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:35 devstack sudo[111779]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:35 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7b8c3f4e-89db-4cba-8c65-17d516d5d5f9 tempest-CreateVolumesFromImageTest-79148926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7fbe3557-c97f-4d19-84de-051acd42c362" returned: 0 in 0.635s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:35 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-7b8c3f4e-89db-4cba-8c65-17d516d5d5f9 tempest-CreateVolumesFromImageTest-79148926 None] Lock "cinder-quobyte-7fbe3557-c97f-4d19-84de-051acd42c362" released by "delete_volume" :: held 1.452s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:41:35 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-7b8c3f4e-89db-4cba-8c65-17d516d5d5f9 tempest-CreateVolumesFromImageTest-79148926 None] Created reservations ['f3a0c925-6523-4f93-b00d-638393d580c0', '99ad384d-81f7-422a-ab3e-55b2baabaa59', 'b696c678-6428-4e41-b5e9-0665df4814c9', 'cbc213ad-394f-408d-9f12-0560c431836e'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:41:35 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-7b8c3f4e-89db-4cba-8c65-17d516d5d5f9 tempest-CreateVolumesFromImageTest-79148926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:41:35 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-7b8c3f4e-89db-4cba-8c65-17d516d5d5f9 tempest-CreateVolumesFromImageTest-79148926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:41:35 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-7b8c3f4e-89db-4cba-8c65-17d516d5d5f9 tempest-CreateVolumesFromImageTest-79148926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:41:35 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-7b8c3f4e-89db-4cba-8c65-17d516d5d5f9 tempest-CreateVolumesFromImageTest-79148926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:41:35 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-7b8c3f4e-89db-4cba-8c65-17d516d5d5f9 tempest-CreateVolumesFromImageTest-79148926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:41:35 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7b8c3f4e-89db-4cba-8c65-17d516d5d5f9 tempest-CreateVolumesFromImageTest-79148926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:35 devstack sudo[111793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:41:35 devstack sudo[111793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:35 devstack sudo[111781]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:35 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-afb17076-59b6-46f0-9d22-33525cdbf360 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5db738ae-fd78-4bcd-951a-54bab0f4c506" returned: 0 in 0.806s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:35 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-afb17076-59b6-46f0-9d22-33525cdbf360 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5db738ae-fd78-4bcd-951a-54bab0f4c506 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:35 devstack sudo[111795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5db738ae-fd78-4bcd-951a-54bab0f4c506 Apr 29 15:41:35 devstack sudo[111795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:35 devstack sudo[111786]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:35 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-35cf0739-0cbd-4e93-9857-9a84c5224f1c tempest-VolumeDependencyTests-347675874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-125a8290-20d5-4d49-b9e0-6b57d70322f4 -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-125a8290-20d5-4d49-b9e0-6b57d70322f4.01b461f7-6528-4cac-bcd1-5d4f53c44885" returned: 0 in 0.705s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:35 devstack cinder-volume[84448]: WARNING cinder.volume.drivers.remotefs [None req-35cf0739-0cbd-4e93-9857-9a84c5224f1c tempest-VolumeDependencyTests-347675874 None] /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-125a8290-20d5-4d49-b9e0-6b57d70322f4.01b461f7-6528-4cac-bcd1-5d4f53c44885 is being set with open permissions: ugo+rw Apr 29 15:41:35 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-35cf0739-0cbd-4e93-9857-9a84c5224f1c tempest-VolumeDependencyTests-347675874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-125a8290-20d5-4d49-b9e0-6b57d70322f4.01b461f7-6528-4cac-bcd1-5d4f53c44885 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:35 devstack sudo[111800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-125a8290-20d5-4d49-b9e0-6b57d70322f4.01b461f7-6528-4cac-bcd1-5d4f53c44885 Apr 29 15:41:35 devstack sudo[111800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:35 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-c72fc5cb-ee02-47ef-8a2f-3605836ac055 tempest-CreateVolumesFromImageTest-79148926 None] Acquiring lock "cinder-2b71aeaf-7bc3-4710-a36b-5c72145660a1-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:41:36 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-c72fc5cb-ee02-47ef-8a2f-3605836ac055 tempest-CreateVolumesFromImageTest-79148926 None] Lock "cinder-2b71aeaf-7bc3-4710-a36b-5c72145660a1-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:41:36 devstack sudo[111793]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:36 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7b8c3f4e-89db-4cba-8c65-17d516d5d5f9 tempest-CreateVolumesFromImageTest-79148926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.633s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:36 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-7b8c3f4e-89db-4cba-8c65-17d516d5d5f9 tempest-CreateVolumesFromImageTest-79148926 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:41:36 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-7b8c3f4e-89db-4cba-8c65-17d516d5d5f9 tempest-CreateVolumesFromImageTest-79148926 None] Deleted volume successfully. Apr 29 15:41:36 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-c72fc5cb-ee02-47ef-8a2f-3605836ac055 tempest-CreateVolumesFromImageTest-79148926 None] Acquiring lock "cinder-quobyte-2b71aeaf-7bc3-4710-a36b-5c72145660a1" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:41:36 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-7b8c3f4e-89db-4cba-8c65-17d516d5d5f9 tempest-CreateVolumesFromImageTest-79148926 None] Lock "cinder-7fbe3557-c97f-4d19-84de-051acd42c362-delete_volume" released by "delete_volume" :: held 2.341s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:41:36 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-c72fc5cb-ee02-47ef-8a2f-3605836ac055 tempest-CreateVolumesFromImageTest-79148926 None] Lock "cinder-quobyte-2b71aeaf-7bc3-4710-a36b-5c72145660a1" acquired by "delete_volume" :: waited 0.024s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:41:36 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c4dc74-2605-4b37-b1a1-878dc653bb21]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:41:36 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c72fc5cb-ee02-47ef-8a2f-3605836ac055 tempest-CreateVolumesFromImageTest-79148926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2b71aeaf-7bc3-4710-a36b-5c72145660a1 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:36 devstack sudo[111795]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:36 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-afb17076-59b6-46f0-9d22-33525cdbf360 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-5db738ae-fd78-4bcd-951a-54bab0f4c506" returned: 0 in 0.748s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:36 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-afb17076-59b6-46f0-9d22-33525cdbf360 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Lock "cinder-quobyte-5db738ae-fd78-4bcd-951a-54bab0f4c506" released by "delete_volume" :: held 1.605s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:41:36 devstack sudo[111804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2b71aeaf-7bc3-4710-a36b-5c72145660a1 Apr 29 15:41:36 devstack sudo[111804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:36 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-afb17076-59b6-46f0-9d22-33525cdbf360 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Created reservations ['4eda50cd-8065-4e75-915c-2d61ba6a32b3', 'a71ee5d0-331a-4fe3-b86a-d48761928caf', '3d0bdda1-05d8-4c44-b669-de67f504dc21', '7d7b5ca2-5a66-4b54-9de0-e8d45a391d22'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:41:36 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-afb17076-59b6-46f0-9d22-33525cdbf360 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:41:36 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-afb17076-59b6-46f0-9d22-33525cdbf360 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:41:36 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-afb17076-59b6-46f0-9d22-33525cdbf360 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:41:36 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-afb17076-59b6-46f0-9d22-33525cdbf360 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:41:36 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-afb17076-59b6-46f0-9d22-33525cdbf360 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:41:36 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-afb17076-59b6-46f0-9d22-33525cdbf360 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:36 devstack sudo[111807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:41:36 devstack sudo[111807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:36 devstack sudo[111800]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:36 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-35cf0739-0cbd-4e93-9857-9a84c5224f1c tempest-VolumeDependencyTests-347675874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-125a8290-20d5-4d49-b9e0-6b57d70322f4.01b461f7-6528-4cac-bcd1-5d4f53c44885" returned: 0 in 0.674s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:36 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-35cf0739-0cbd-4e93-9857-9a84c5224f1c tempest-VolumeDependencyTests-347675874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-125a8290-20d5-4d49-b9e0-6b57d70322f4.info {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:36 devstack sudo[111810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-125a8290-20d5-4d49-b9e0-6b57d70322f4.info Apr 29 15:41:36 devstack sudo[111810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:36 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-993cbaf1-6e3e-48ff-971b-99d20b46e875 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Acquiring lock "cinder-74729239-9924-4739-9924-ae4226ae8fa2-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:41:36 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-993cbaf1-6e3e-48ff-971b-99d20b46e875 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Lock "cinder-74729239-9924-4739-9924-ae4226ae8fa2-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:41:36 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-993cbaf1-6e3e-48ff-971b-99d20b46e875 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Acquiring lock "cinder-quobyte-74729239-9924-4739-9924-ae4226ae8fa2" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:41:36 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-993cbaf1-6e3e-48ff-971b-99d20b46e875 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Lock "cinder-quobyte-74729239-9924-4739-9924-ae4226ae8fa2" acquired by "delete_volume" :: waited 0.018s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:41:36 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6ca69f-37cb-4a92-ab39-88727d84dc82]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:41:36 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-993cbaf1-6e3e-48ff-971b-99d20b46e875 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-74729239-9924-4739-9924-ae4226ae8fa2 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:36 devstack sudo[111804]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c72fc5cb-ee02-47ef-8a2f-3605836ac055 tempest-CreateVolumesFromImageTest-79148926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2b71aeaf-7bc3-4710-a36b-5c72145660a1" returned: 0 in 0.868s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c72fc5cb-ee02-47ef-8a2f-3605836ac055 tempest-CreateVolumesFromImageTest-79148926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2b71aeaf-7bc3-4710-a36b-5c72145660a1 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:37 devstack sudo[111817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2b71aeaf-7bc3-4710-a36b-5c72145660a1 Apr 29 15:41:37 devstack sudo[111817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:37 devstack sudo[111807]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-afb17076-59b6-46f0-9d22-33525cdbf360 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.682s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:37 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-afb17076-59b6-46f0-9d22-33525cdbf360 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:41:37 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-afb17076-59b6-46f0-9d22-33525cdbf360 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Deleted volume successfully. Apr 29 15:41:37 devstack sudo[111816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-74729239-9924-4739-9924-ae4226ae8fa2 Apr 29 15:41:37 devstack sudo[111816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:37 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-afb17076-59b6-46f0-9d22-33525cdbf360 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Lock "cinder-5db738ae-fd78-4bcd-951a-54bab0f4c506-delete_volume" released by "delete_volume" :: held 2.542s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:41:37 devstack sudo[111810]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-35cf0739-0cbd-4e93-9857-9a84c5224f1c tempest-VolumeDependencyTests-347675874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-125a8290-20d5-4d49-b9e0-6b57d70322f4.info" returned: 0 in 0.765s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:37 devstack cinder-volume[84448]: WARNING cinder.volume.drivers.remotefs [None req-35cf0739-0cbd-4e93-9857-9a84c5224f1c tempest-VolumeDependencyTests-347675874 None] /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-125a8290-20d5-4d49-b9e0-6b57d70322f4.info is being set with open permissions: ugo+rw Apr 29 15:41:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-35cf0739-0cbd-4e93-9857-9a84c5224f1c tempest-VolumeDependencyTests-347675874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-125a8290-20d5-4d49-b9e0-6b57d70322f4.info {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:37 devstack sudo[111821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-125a8290-20d5-4d49-b9e0-6b57d70322f4.info Apr 29 15:41:37 devstack sudo[111821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:37 devstack sudo[111817]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c72fc5cb-ee02-47ef-8a2f-3605836ac055 tempest-CreateVolumesFromImageTest-79148926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2b71aeaf-7bc3-4710-a36b-5c72145660a1" returned: 0 in 0.716s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:37 devstack sudo[111816]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:37 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-c72fc5cb-ee02-47ef-8a2f-3605836ac055 tempest-CreateVolumesFromImageTest-79148926 None] Lock "cinder-quobyte-2b71aeaf-7bc3-4710-a36b-5c72145660a1" released by "delete_volume" :: held 1.642s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:41:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-993cbaf1-6e3e-48ff-971b-99d20b46e875 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-74729239-9924-4739-9924-ae4226ae8fa2" returned: 0 in 0.790s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-993cbaf1-6e3e-48ff-971b-99d20b46e875 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-74729239-9924-4739-9924-ae4226ae8fa2 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:37 devstack sudo[111827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-74729239-9924-4739-9924-ae4226ae8fa2 Apr 29 15:41:37 devstack sudo[111827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:37 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-c72fc5cb-ee02-47ef-8a2f-3605836ac055 tempest-CreateVolumesFromImageTest-79148926 None] Created reservations ['187a44d3-0e98-48f3-896e-dde46d6c4538', 'b650bb06-5f6a-46b5-884a-9d3e528dd98b', 'aabfadd3-420c-48e2-a1bd-2fb5579c4083', '5e6ffb73-5332-429c-9584-f69567890a37'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:41:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-c72fc5cb-ee02-47ef-8a2f-3605836ac055 tempest-CreateVolumesFromImageTest-79148926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:41:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-c72fc5cb-ee02-47ef-8a2f-3605836ac055 tempest-CreateVolumesFromImageTest-79148926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:41:37 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-c72fc5cb-ee02-47ef-8a2f-3605836ac055 tempest-CreateVolumesFromImageTest-79148926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:41:37 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-c72fc5cb-ee02-47ef-8a2f-3605836ac055 tempest-CreateVolumesFromImageTest-79148926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:41:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-c72fc5cb-ee02-47ef-8a2f-3605836ac055 tempest-CreateVolumesFromImageTest-79148926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:41:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c72fc5cb-ee02-47ef-8a2f-3605836ac055 tempest-CreateVolumesFromImageTest-79148926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:37 devstack sudo[111830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:41:37 devstack sudo[111830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:37 devstack sudo[111821]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-35cf0739-0cbd-4e93-9857-9a84c5224f1c tempest-VolumeDependencyTests-347675874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-125a8290-20d5-4d49-b9e0-6b57d70322f4.info" returned: 0 in 0.691s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-35cf0739-0cbd-4e93-9857-9a84c5224f1c tempest-VolumeDependencyTests-347675874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.508s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:41:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-7edd15b4-0774-47af-a38d-ebd51dbf5cf2 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.100s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:41:38 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-7edd15b4-0774-47af-a38d-ebd51dbf5cf2 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:41:19Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7abd3063-2349-469d-9c94-99a992748cf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e9d0ec4088a4196b7b5be876b87300a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:41:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:41:19Z,use_quota=True,user_id='bf89206f2e2a4851ae1e22d4cd0f3ee5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4692619c-8248-4eac-87ae-155ed93e3396),volume_type_id=4692619c-8248-4eac-87ae-155ed93e3396)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:41:38 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-7edd15b4-0774-47af-a38d-ebd51dbf5cf2 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] Creating volume 7abd3063-2349-469d-9c94-99a992748cf3 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:41:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-7edd15b4-0774-47af-a38d-ebd51dbf5cf2 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:41:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-7edd15b4-0774-47af-a38d-ebd51dbf5cf2 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:41:38 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-7edd15b4-0774-47af-a38d-ebd51dbf5cf2 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:41:38 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-7edd15b4-0774-47af-a38d-ebd51dbf5cf2 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:41:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-7edd15b4-0774-47af-a38d-ebd51dbf5cf2 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:41:38 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-7edd15b4-0774-47af-a38d-ebd51dbf5cf2 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:41:38 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-7edd15b4-0774-47af-a38d-ebd51dbf5cf2 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:41:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7edd15b4-0774-47af-a38d-ebd51dbf5cf2 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7abd3063-2349-469d-9c94-99a992748cf3 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:38 devstack sudo[111832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7abd3063-2349-469d-9c94-99a992748cf3 1073741824 Apr 29 15:41:38 devstack sudo[111832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:38 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-35cf0739-0cbd-4e93-9857-9a84c5224f1c tempest-VolumeDependencyTests-347675874 None] Create snapshot completed successfully Apr 29 15:41:38 devstack sudo[111827]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-993cbaf1-6e3e-48ff-971b-99d20b46e875 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-74729239-9924-4739-9924-ae4226ae8fa2" returned: 0 in 0.649s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:38 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-993cbaf1-6e3e-48ff-971b-99d20b46e875 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Lock "cinder-quobyte-74729239-9924-4739-9924-ae4226ae8fa2" released by "delete_volume" :: held 1.488s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:41:38 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-993cbaf1-6e3e-48ff-971b-99d20b46e875 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Created reservations ['c69f5170-02c1-4d59-a58a-6c50172f0fdc', '6033d087-9ea2-40d1-a661-88858e43dff3', '7bb3ed32-570e-44c9-abe3-697605000be5', '6e64db87-1cb8-491c-849e-e7ca9ae78528'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:41:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-993cbaf1-6e3e-48ff-971b-99d20b46e875 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:41:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-993cbaf1-6e3e-48ff-971b-99d20b46e875 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:41:38 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-993cbaf1-6e3e-48ff-971b-99d20b46e875 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:41:38 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-993cbaf1-6e3e-48ff-971b-99d20b46e875 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:41:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-993cbaf1-6e3e-48ff-971b-99d20b46e875 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:41:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-993cbaf1-6e3e-48ff-971b-99d20b46e875 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:38 devstack sudo[111830]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c72fc5cb-ee02-47ef-8a2f-3605836ac055 tempest-CreateVolumesFromImageTest-79148926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.718s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:38 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-c72fc5cb-ee02-47ef-8a2f-3605836ac055 tempest-CreateVolumesFromImageTest-79148926 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:41:38 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-c72fc5cb-ee02-47ef-8a2f-3605836ac055 tempest-CreateVolumesFromImageTest-79148926 None] Deleted volume successfully. Apr 29 15:41:38 devstack sudo[111836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:41:38 devstack sudo[111836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:38 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-c72fc5cb-ee02-47ef-8a2f-3605836ac055 tempest-CreateVolumesFromImageTest-79148926 None] Lock "cinder-2b71aeaf-7bc3-4710-a36b-5c72145660a1-delete_volume" released by "delete_volume" :: held 2.613s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:41:39 devstack sudo[111832]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:39 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7edd15b4-0774-47af-a38d-ebd51dbf5cf2 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7abd3063-2349-469d-9c94-99a992748cf3 1073741824" returned: 0 in 1.053s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:39 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7edd15b4-0774-47af-a38d-ebd51dbf5cf2 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7abd3063-2349-469d-9c94-99a992748cf3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:39 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-7b90e4d5-3834-492d-84dd-1f21fd426014 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Acquiring lock "cinder-6f63064e-35fd-4071-a770-949e073a17c4-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:41:39 devstack sudo[111876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7abd3063-2349-469d-9c94-99a992748cf3 Apr 29 15:41:39 devstack sudo[111876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:39 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-7b90e4d5-3834-492d-84dd-1f21fd426014 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Lock "cinder-6f63064e-35fd-4071-a770-949e073a17c4-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:41:39 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-7b90e4d5-3834-492d-84dd-1f21fd426014 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Acquiring lock "cinder-quobyte-6f63064e-35fd-4071-a770-949e073a17c4" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:41:39 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-7b90e4d5-3834-492d-84dd-1f21fd426014 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Lock "cinder-quobyte-6f63064e-35fd-4071-a770-949e073a17c4" acquired by "delete_volume" :: waited 0.023s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:41:39 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[788339b8-71ad-42a3-b998-e30d3abe6ea2]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:41:39 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7b90e4d5-3834-492d-84dd-1f21fd426014 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-6f63064e-35fd-4071-a770-949e073a17c4 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:39 devstack sudo[111836]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:39 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-993cbaf1-6e3e-48ff-971b-99d20b46e875 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 1.039s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:39 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-993cbaf1-6e3e-48ff-971b-99d20b46e875 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:41:39 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdf3d053-5f72-4bed-ab22-a0ffc307e1c1 tempest-VolumeDependencyTests-347675874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:41:39 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-993cbaf1-6e3e-48ff-971b-99d20b46e875 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Deleted volume successfully. Apr 29 15:41:39 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cdf3d053-5f72-4bed-ab22-a0ffc307e1c1 tempest-VolumeDependencyTests-347675874 None] Flow 'volume_create_manager' (1500ff55-13ce-4ec2-a679-534d73e08396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:41:39 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cdf3d053-5f72-4bed-ab22-a0ffc307e1c1 tempest-VolumeDependencyTests-347675874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c6aa685-2aa8-48e4-88e8-9ef653871ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:39 devstack sudo[111881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-6f63064e-35fd-4071-a770-949e073a17c4 Apr 29 15:41:39 devstack sudo[111881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:39 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-993cbaf1-6e3e-48ff-971b-99d20b46e875 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Lock "cinder-74729239-9924-4739-9924-ae4226ae8fa2-delete_volume" released by "delete_volume" :: held 2.872s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:41:39 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cdf3d053-5f72-4bed-ab22-a0ffc307e1c1 tempest-VolumeDependencyTests-347675874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c6aa685-2aa8-48e4-88e8-9ef653871ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:41:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1665046357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dd50a7e-6504-4a5f-a442-4ce074d279f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aeb81c62ac284048b36f567290e59d0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:41:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=01b461f7-6528-4cac-bcd1-5d4f53c44885,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:41:40Z,use_quota=True,user_id='5f2f077a45ee40b48b1d0833faeef45f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:39 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cdf3d053-5f72-4bed-ab22-a0ffc307e1c1 tempest-VolumeDependencyTests-347675874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38cb82c1-3209-40c0-9cdc-d1c31ed4a16d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:39 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cdf3d053-5f72-4bed-ab22-a0ffc307e1c1 tempest-VolumeDependencyTests-347675874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38cb82c1-3209-40c0-9cdc-d1c31ed4a16d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:39 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cdf3d053-5f72-4bed-ab22-a0ffc307e1c1 tempest-VolumeDependencyTests-347675874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b435c37e-381c-4011-906e-ca512b8db750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:39 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cdf3d053-5f72-4bed-ab22-a0ffc307e1c1 tempest-VolumeDependencyTests-347675874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b435c37e-381c-4011-906e-ca512b8db750) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7dd50a7e-6504-4a5f-a442-4ce074d279f2', 'volume_name': 'volume-7dd50a7e-6504-4a5f-a442-4ce074d279f2', 'volume_size': 1, 'snapshot_id': '01b461f7-6528-4cac-bcd1-5d4f53c44885'}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:39 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cdf3d053-5f72-4bed-ab22-a0ffc307e1c1 tempest-VolumeDependencyTests-347675874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (682308bf-0a6e-46f8-b412-1da3e89e580e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:39 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cdf3d053-5f72-4bed-ab22-a0ffc307e1c1 tempest-VolumeDependencyTests-347675874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (682308bf-0a6e-46f8-b412-1da3e89e580e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:39 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cdf3d053-5f72-4bed-ab22-a0ffc307e1c1 tempest-VolumeDependencyTests-347675874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (688d3171-ed7c-4f99-a661-7a87e6a5934f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:39 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-cdf3d053-5f72-4bed-ab22-a0ffc307e1c1 tempest-VolumeDependencyTests-347675874 None] Volume 7dd50a7e-6504-4a5f-a442-4ce074d279f2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7dd50a7e-6504-4a5f-a442-4ce074d279f2', 'volume_size': 1, 'snapshot_id': '01b461f7-6528-4cac-bcd1-5d4f53c44885'} Apr 29 15:41:39 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-cdf3d053-5f72-4bed-ab22-a0ffc307e1c1 tempest-VolumeDependencyTests-347675874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:41:39 devstack sudo[111876]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:39 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7edd15b4-0774-47af-a38d-ebd51dbf5cf2 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7abd3063-2349-469d-9c94-99a992748cf3" returned: 0 in 0.809s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:39 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-7edd15b4-0774-47af-a38d-ebd51dbf5cf2 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] <== create_volume: return (1950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:41:39 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-7edd15b4-0774-47af-a38d-ebd51dbf5cf2 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.953s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:41:39 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-cdf3d053-5f72-4bed-ab22-a0ffc307e1c1 tempest-VolumeDependencyTests-347675874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.190s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:41:39 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-cdf3d053-5f72-4bed-ab22-a0ffc307e1c1 tempest-VolumeDependencyTests-347675874 None] Acquiring lock "cinder-quobyte-01b461f7-6528-4cac-bcd1-5d4f53c44885-7dd50a7e-6504-4a5f-a442-4ce074d279f2" by "_create_volume_from_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:41:39 devstack cinder-volume[84448]: DEBUG cinder.volume.volume_utils [None req-7edd15b4-0774-47af-a38d-ebd51dbf5cf2 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] Attempting download of 088bd261-61fd-428d-8444-2cf93043dc26 ((None, [{'url': 'file:///opt/stack/data/glance/images/088bd261-61fd-428d-8444-2cf93043dc26', 'metadata': {}}])) to volume 7abd3063-2349-469d-9c94-99a992748cf3. {{(pid=84448) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 29 15:41:40 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-cdf3d053-5f72-4bed-ab22-a0ffc307e1c1 tempest-VolumeDependencyTests-347675874 None] Lock "cinder-quobyte-01b461f7-6528-4cac-bcd1-5d4f53c44885-7dd50a7e-6504-4a5f-a442-4ce074d279f2" acquired by "_create_volume_from_snapshot" :: waited 0.040s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:41:40 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-cdf3d053-5f72-4bed-ab22-a0ffc307e1c1 tempest-VolumeDependencyTests-347675874 None] Creating volume 7dd50a7e-6504-4a5f-a442-4ce074d279f2 from snapshot 01b461f7-6528-4cac-bcd1-5d4f53c44885 {{(pid=84448) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 15:41:40 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-cdf3d053-5f72-4bed-ab22-a0ffc307e1c1 tempest-VolumeDependencyTests-347675874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:41:40 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-cdf3d053-5f72-4bed-ab22-a0ffc307e1c1 tempest-VolumeDependencyTests-347675874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:41:40 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-cdf3d053-5f72-4bed-ab22-a0ffc307e1c1 tempest-VolumeDependencyTests-347675874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:41:40 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-cdf3d053-5f72-4bed-ab22-a0ffc307e1c1 tempest-VolumeDependencyTests-347675874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:41:40 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-cdf3d053-5f72-4bed-ab22-a0ffc307e1c1 tempest-VolumeDependencyTests-347675874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:41:40 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-cdf3d053-5f72-4bed-ab22-a0ffc307e1c1 tempest-VolumeDependencyTests-347675874 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:41:40 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-cdf3d053-5f72-4bed-ab22-a0ffc307e1c1 tempest-VolumeDependencyTests-347675874 None] Acquiring lock "cinder-quobyte-7dd50a7e-6504-4a5f-a442-4ce074d279f2" by "_copy_volume_from_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:41:40 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-cdf3d053-5f72-4bed-ab22-a0ffc307e1c1 tempest-VolumeDependencyTests-347675874 None] Lock "cinder-quobyte-7dd50a7e-6504-4a5f-a442-4ce074d279f2" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:41:40 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-cdf3d053-5f72-4bed-ab22-a0ffc307e1c1 tempest-VolumeDependencyTests-347675874 None] snapshot: 01b461f7-6528-4cac-bcd1-5d4f53c44885, volume: 7dd50a7e-6504-4a5f-a442-4ce074d279f2, {{(pid=84448) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 15:41:40 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-cdf3d053-5f72-4bed-ab22-a0ffc307e1c1 tempest-VolumeDependencyTests-347675874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:41:40 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-cdf3d053-5f72-4bed-ab22-a0ffc307e1c1 tempest-VolumeDependencyTests-347675874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:41:40 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-cdf3d053-5f72-4bed-ab22-a0ffc307e1c1 tempest-VolumeDependencyTests-347675874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:41:40 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-cdf3d053-5f72-4bed-ab22-a0ffc307e1c1 tempest-VolumeDependencyTests-347675874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:41:40 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-cdf3d053-5f72-4bed-ab22-a0ffc307e1c1 tempest-VolumeDependencyTests-347675874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:41:40 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea6194d-4500-4b8d-9920-1999d0a1dcbc]: (4, 'raw') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:41:40 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7edd15b4-0774-47af-a38d-ebd51dbf5cf2 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_088bd261-61fd-428d-8444-2cf93043dc26_pa1a4ovl {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:40 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb820c6-51b5-4000-bd3e-7ae3f6e7e09b]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:41:40 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cdf3d053-5f72-4bed-ab22-a0ffc307e1c1 tempest-VolumeDependencyTests-347675874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-125a8290-20d5-4d49-b9e0-6b57d70322f4.01b461f7-6528-4cac-bcd1-5d4f53c44885 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:40 devstack sudo[111886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_088bd261-61fd-428d-8444-2cf93043dc26_pa1a4ovl Apr 29 15:41:40 devstack sudo[111886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:40 devstack sudo[111887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-125a8290-20d5-4d49-b9e0-6b57d70322f4.01b461f7-6528-4cac-bcd1-5d4f53c44885 Apr 29 15:41:40 devstack sudo[111887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:40 devstack sudo[111881]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:40 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7b90e4d5-3834-492d-84dd-1f21fd426014 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-6f63064e-35fd-4071-a770-949e073a17c4" returned: 0 in 1.053s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:40 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7b90e4d5-3834-492d-84dd-1f21fd426014 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-6f63064e-35fd-4071-a770-949e073a17c4 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:40 devstack sudo[111894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-6f63064e-35fd-4071-a770-949e073a17c4 Apr 29 15:41:40 devstack sudo[111894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:40 devstack sudo[111886]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:40 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7edd15b4-0774-47af-a38d-ebd51dbf5cf2 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_088bd261-61fd-428d-8444-2cf93043dc26_pa1a4ovl" returned: 0 in 0.853s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:40 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7edd15b4-0774-47af-a38d-ebd51dbf5cf2 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_088bd261-61fd-428d-8444-2cf93043dc26_pa1a4ovl {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:41 devstack sudo[111887]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cdf3d053-5f72-4bed-ab22-a0ffc307e1c1 tempest-VolumeDependencyTests-347675874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-125a8290-20d5-4d49-b9e0-6b57d70322f4.01b461f7-6528-4cac-bcd1-5d4f53c44885" returned: 0 in 0.938s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:41 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-cdf3d053-5f72-4bed-ab22-a0ffc307e1c1 tempest-VolumeDependencyTests-347675874 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-125a8290-20d5-4d49-b9e0-6b57d70322f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84448) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 15:41:41 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-cdf3d053-5f72-4bed-ab22-a0ffc307e1c1 tempest-VolumeDependencyTests-347675874 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-125a8290-20d5-4d49-b9e0-6b57d70322f4 {{(pid=84448) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 15:41:41 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-cdf3d053-5f72-4bed-ab22-a0ffc307e1c1 tempest-VolumeDependencyTests-347675874 None] Creating direct copy from snapshot {{(pid=84448) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 15:41:41 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[991f9214-0eaf-41b7-b73e-5cf2c1f62a72]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:41:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cdf3d053-5f72-4bed-ab22-a0ffc307e1c1 tempest-VolumeDependencyTests-347675874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-125a8290-20d5-4d49-b9e0-6b57d70322f4 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:41 devstack sudo[111901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_088bd261-61fd-428d-8444-2cf93043dc26_pa1a4ovl Apr 29 15:41:41 devstack sudo[111901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:41 devstack sudo[111902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-125a8290-20d5-4d49-b9e0-6b57d70322f4 Apr 29 15:41:41 devstack sudo[111902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:41 devstack sudo[111894]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7b90e4d5-3834-492d-84dd-1f21fd426014 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-6f63064e-35fd-4071-a770-949e073a17c4" returned: 0 in 0.687s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:41 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-7b90e4d5-3834-492d-84dd-1f21fd426014 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Lock "cinder-quobyte-6f63064e-35fd-4071-a770-949e073a17c4" released by "delete_volume" :: held 1.859s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:41:41 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-7b90e4d5-3834-492d-84dd-1f21fd426014 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Created reservations ['c85fbe83-4d3c-41cd-98f7-f49b237ed9dd', '5afb1b30-023d-4430-8951-58d2f2aa036a', '29b7ac2e-5a51-444e-94c1-d8021e86f3d5', '4ed71943-6913-4c96-9396-005ee2a56ef7'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:41:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-7b90e4d5-3834-492d-84dd-1f21fd426014 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:41:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-7b90e4d5-3834-492d-84dd-1f21fd426014 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:41:41 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-7b90e4d5-3834-492d-84dd-1f21fd426014 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:41:41 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-7b90e4d5-3834-492d-84dd-1f21fd426014 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:41:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-7b90e4d5-3834-492d-84dd-1f21fd426014 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:41:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7b90e4d5-3834-492d-84dd-1f21fd426014 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:41 devstack sudo[111906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:41:41 devstack sudo[111906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:41 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-64d36ca8-2571-433d-81e7-42edb233b404 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Acquiring lock "cinder-8e992d98-714b-4a98-b707-dc3ebe9fbd1b-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:41:41 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-64d36ca8-2571-433d-81e7-42edb233b404 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Lock "cinder-8e992d98-714b-4a98-b707-dc3ebe9fbd1b-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:41:41 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-64d36ca8-2571-433d-81e7-42edb233b404 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Acquiring lock "cinder-quobyte-8e992d98-714b-4a98-b707-dc3ebe9fbd1b" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:41:41 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-64d36ca8-2571-433d-81e7-42edb233b404 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Lock "cinder-quobyte-8e992d98-714b-4a98-b707-dc3ebe9fbd1b" acquired by "delete_volume" :: waited 0.023s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:41:41 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e0e936f-12fb-4788-910b-9230f4cfead3]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:41:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-64d36ca8-2571-433d-81e7-42edb233b404 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-8e992d98-714b-4a98-b707-dc3ebe9fbd1b {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:41 devstack sudo[111901]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7edd15b4-0774-47af-a38d-ebd51dbf5cf2 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_088bd261-61fd-428d-8444-2cf93043dc26_pa1a4ovl" returned: 1 in 0.906s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7edd15b4-0774-47af-a38d-ebd51dbf5cf2 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_088bd261-61fd-428d-8444-2cf93043dc26_pa1a4ovl' failed. Not Retrying. {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 15:41:41 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[e195bee1-103c-487e-9a5b-fc956f440d72]: (4, 'raw') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:41:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7edd15b4-0774-47af-a38d-ebd51dbf5cf2 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_088bd261-61fd-428d-8444-2cf93043dc26_7fytk1wsdevstack@QuobyteHD {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:42 devstack sudo[111911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-8e992d98-714b-4a98-b707-dc3ebe9fbd1b Apr 29 15:41:42 devstack sudo[111911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:42 devstack sudo[111913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_088bd261-61fd-428d-8444-2cf93043dc26_7fytk1wsdevstack@QuobyteHD Apr 29 15:41:42 devstack sudo[111913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:42 devstack sudo[111902]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:42 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cdf3d053-5f72-4bed-ab22-a0ffc307e1c1 tempest-VolumeDependencyTests-347675874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-125a8290-20d5-4d49-b9e0-6b57d70322f4" returned: 0 in 1.027s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:42 devstack cinder-volume[84448]: DEBUG cinder.utils [None req-cdf3d053-5f72-4bed-ab22-a0ffc307e1c1 tempest-VolumeDependencyTests-347675874 None] Path /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7dd50a7e-6504-4a5f-a442-4ce074d279f2 not found in is_blk_device check {{(pid=84448) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 15:41:42 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cdf3d053-5f72-4bed-ab22-a0ffc307e1c1 tempest-VolumeDependencyTests-347675874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-125a8290-20d5-4d49-b9e0-6b57d70322f4 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7dd50a7e-6504-4a5f-a442-4ce074d279f2 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:42 devstack sudo[111917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-125a8290-20d5-4d49-b9e0-6b57d70322f4 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7dd50a7e-6504-4a5f-a442-4ce074d279f2 Apr 29 15:41:42 devstack sudo[111917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:42 devstack sudo[111906]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:42 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7b90e4d5-3834-492d-84dd-1f21fd426014 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.900s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:42 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-7b90e4d5-3834-492d-84dd-1f21fd426014 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:41:42 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-7b90e4d5-3834-492d-84dd-1f21fd426014 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Deleted volume successfully. Apr 29 15:41:42 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-7b90e4d5-3834-492d-84dd-1f21fd426014 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Lock "cinder-6f63064e-35fd-4071-a770-949e073a17c4-delete_volume" released by "delete_volume" :: held 3.087s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:41:42 devstack sudo[111913]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:42 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7edd15b4-0774-47af-a38d-ebd51dbf5cf2 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_088bd261-61fd-428d-8444-2cf93043dc26_7fytk1wsdevstack@QuobyteHD" returned: 0 in 0.862s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:42 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7edd15b4-0774-47af-a38d-ebd51dbf5cf2 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_088bd261-61fd-428d-8444-2cf93043dc26_7fytk1wsdevstack@QuobyteHD {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:42 devstack sudo[111911]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:42 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-64d36ca8-2571-433d-81e7-42edb233b404 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-8e992d98-714b-4a98-b707-dc3ebe9fbd1b" returned: 0 in 1.009s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:42 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-64d36ca8-2571-433d-81e7-42edb233b404 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-8e992d98-714b-4a98-b707-dc3ebe9fbd1b {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:42 devstack sudo[111932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-8e992d98-714b-4a98-b707-dc3ebe9fbd1b Apr 29 15:41:42 devstack sudo[111932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:42 devstack sudo[111927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_088bd261-61fd-428d-8444-2cf93043dc26_7fytk1wsdevstack@QuobyteHD Apr 29 15:41:42 devstack sudo[111927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:43 devstack sudo[111932]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:43 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-64d36ca8-2571-433d-81e7-42edb233b404 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-8e992d98-714b-4a98-b707-dc3ebe9fbd1b" returned: 0 in 0.971s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:43 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-64d36ca8-2571-433d-81e7-42edb233b404 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Lock "cinder-quobyte-8e992d98-714b-4a98-b707-dc3ebe9fbd1b" released by "delete_volume" :: held 2.127s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:41:44 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-64d36ca8-2571-433d-81e7-42edb233b404 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Created reservations ['1ce8ea83-b620-4b8e-9f31-839ad006934f', '313aa49e-4b7c-437b-b48f-252cc49ddac8', '710d9bcb-7b96-42f5-8f95-58245b306190', '96a2a0b6-0709-42cb-a763-14f2e430ad72'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:41:44 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-64d36ca8-2571-433d-81e7-42edb233b404 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:41:44 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-64d36ca8-2571-433d-81e7-42edb233b404 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:41:44 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-64d36ca8-2571-433d-81e7-42edb233b404 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:41:44 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-64d36ca8-2571-433d-81e7-42edb233b404 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:41:44 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-64d36ca8-2571-433d-81e7-42edb233b404 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:41:44 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-64d36ca8-2571-433d-81e7-42edb233b404 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:44 devstack sudo[111946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:41:44 devstack sudo[111946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:44 devstack sudo[111927]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:44 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7edd15b4-0774-47af-a38d-ebd51dbf5cf2 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_088bd261-61fd-428d-8444-2cf93043dc26_7fytk1wsdevstack@QuobyteHD" returned: 1 in 1.651s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:44 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7edd15b4-0774-47af-a38d-ebd51dbf5cf2 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_088bd261-61fd-428d-8444-2cf93043dc26_7fytk1wsdevstack@QuobyteHD' failed. Not Retrying. {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 15:41:44 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [None req-7edd15b4-0774-47af-a38d-ebd51dbf5cf2 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] 088bd261-61fd-428d-8444-2cf93043dc26 was raw, converting to raw {{(pid=84448) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 29 15:41:44 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7edd15b4-0774-47af-a38d-ebd51dbf5cf2 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_088bd261-61fd-428d-8444-2cf93043dc26_7fytk1wsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7abd3063-2349-469d-9c94-99a992748cf3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:44 devstack sudo[111948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_088bd261-61fd-428d-8444-2cf93043dc26_7fytk1wsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7abd3063-2349-469d-9c94-99a992748cf3 Apr 29 15:41:44 devstack sudo[111948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:45 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-5dd1e8d7-352e-44c4-950c-5ce91fa0206c tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Acquiring lock "cinder-d237bd67-b183-42c1-9ab5-64b4e20eef4c-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:41:45 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-5dd1e8d7-352e-44c4-950c-5ce91fa0206c tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Lock "cinder-d237bd67-b183-42c1-9ab5-64b4e20eef4c-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:41:45 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-5dd1e8d7-352e-44c4-950c-5ce91fa0206c tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Acquiring lock "cinder-quobyte-d237bd67-b183-42c1-9ab5-64b4e20eef4c" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:41:45 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-5dd1e8d7-352e-44c4-950c-5ce91fa0206c tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Lock "cinder-quobyte-d237bd67-b183-42c1-9ab5-64b4e20eef4c" acquired by "delete_volume" :: waited 0.061s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:41:45 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0894c1b-b815-4f13-8264-168732864ebb]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:41:45 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-5dd1e8d7-352e-44c4-950c-5ce91fa0206c tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d237bd67-b183-42c1-9ab5-64b4e20eef4c {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:45 devstack sudo[111946]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:45 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-64d36ca8-2571-433d-81e7-42edb233b404 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 1.590s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:45 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-64d36ca8-2571-433d-81e7-42edb233b404 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:41:45 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-64d36ca8-2571-433d-81e7-42edb233b404 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Deleted volume successfully. Apr 29 15:41:45 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-64d36ca8-2571-433d-81e7-42edb233b404 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Lock "cinder-8e992d98-714b-4a98-b707-dc3ebe9fbd1b-delete_volume" released by "delete_volume" :: held 4.209s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:41:45 devstack sudo[111953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d237bd67-b183-42c1-9ab5-64b4e20eef4c Apr 29 15:41:45 devstack sudo[111953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:46 devstack sudo[111948]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:46 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7edd15b4-0774-47af-a38d-ebd51dbf5cf2 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_088bd261-61fd-428d-8444-2cf93043dc26_7fytk1wsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7abd3063-2349-469d-9c94-99a992748cf3" returned: 0 in 1.942s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:46 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [None req-7edd15b4-0774-47af-a38d-ebd51dbf5cf2 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_088bd261-61fd-428d-8444-2cf93043dc26_7fytk1wsdevstack@QuobyteHD, size 0.00 MB, duration 1.94 sec, destination /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7abd3063-2349-469d-9c94-99a992748cf3 {{(pid=84448) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 15:41:46 devstack cinder-volume[84448]: INFO cinder.image.image_utils [None req-7edd15b4-0774-47af-a38d-ebd51dbf5cf2 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] Converted 0.00 MB image at 0.00 MB/s Apr 29 15:41:46 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7edd15b4-0774-47af-a38d-ebd51dbf5cf2 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7abd3063-2349-469d-9c94-99a992748cf3 1G {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:46 devstack sudo[111957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7abd3063-2349-469d-9c94-99a992748cf3 1G Apr 29 15:41:46 devstack sudo[111957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:47 devstack sudo[111953]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:47 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-5dd1e8d7-352e-44c4-950c-5ce91fa0206c tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d237bd67-b183-42c1-9ab5-64b4e20eef4c" returned: 0 in 1.651s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:47 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-5dd1e8d7-352e-44c4-950c-5ce91fa0206c tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d237bd67-b183-42c1-9ab5-64b4e20eef4c {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:47 devstack sudo[111962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d237bd67-b183-42c1-9ab5-64b4e20eef4c Apr 29 15:41:47 devstack sudo[111962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:47 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf187fad-6a61-42d8-b880-7884d840318d tempest-VolumeImageDependencyTests-1307160939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:41:47 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cf187fad-6a61-42d8-b880-7884d840318d tempest-VolumeImageDependencyTests-1307160939 None] Flow 'volume_create_manager' (67ac15a9-fab4-432c-88fc-b9fe71aa8023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:41:47 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cf187fad-6a61-42d8-b880-7884d840318d tempest-VolumeImageDependencyTests-1307160939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ac146a8-a797-47ac-9f7f-256ea552ff45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:47 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cf187fad-6a61-42d8-b880-7884d840318d tempest-VolumeImageDependencyTests-1307160939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ac146a8-a797-47ac-9f7f-256ea552ff45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:41:47Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45057860-8463-4b9f-ae3f-3cfe2243b7bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a29748d81f464672b5f2e2d080b6d086',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:41:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:41:48Z,use_quota=True,user_id='0a314754c97541eb9615314c752f7f00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:47 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cf187fad-6a61-42d8-b880-7884d840318d tempest-VolumeImageDependencyTests-1307160939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd011219-4fed-462b-b69e-09c7dac67329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:47 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cf187fad-6a61-42d8-b880-7884d840318d tempest-VolumeImageDependencyTests-1307160939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd011219-4fed-462b-b69e-09c7dac67329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:47 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cf187fad-6a61-42d8-b880-7884d840318d tempest-VolumeImageDependencyTests-1307160939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5af2ef1a-e865-40ce-b5a1-b96dbbb74667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:48 devstack cinder-volume[84448]: DEBUG cinder.image.glance [None req-cf187fad-6a61-42d8-b880-7884d840318d tempest-VolumeImageDependencyTests-1307160939 None] Creating Keystone auth plugin from conf {{(pid=84448) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 29 15:41:48 devstack sudo[111957]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:48 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7edd15b4-0774-47af-a38d-ebd51dbf5cf2 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7abd3063-2349-469d-9c94-99a992748cf3 1G" returned: 0 in 2.011s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:48 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[335ea97f-7d71-4541-b319-92ef880bdfab]: (4, 'raw') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:41:48 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7edd15b4-0774-47af-a38d-ebd51dbf5cf2 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7abd3063-2349-469d-9c94-99a992748cf3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:48 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cf187fad-6a61-42d8-b880-7884d840318d tempest-VolumeImageDependencyTests-1307160939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5af2ef1a-e865-40ce-b5a1-b96dbbb74667) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '45057860-8463-4b9f-ae3f-3cfe2243b7bb', 'volume_name': 'volume-45057860-8463-4b9f-ae3f-3cfe2243b7bb', 'volume_size': 1, 'image_id': '0855b1ce-856e-46ea-9692-0087ae5f4836', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0855b1ce-856e-46ea-9692-0087ae5f4836', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ef645a9828b1e9caf2fe34208f2ea6e3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a29748d81f464672b5f2e2d080b6d086', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3ec3d1514a4d0281bf2bf01d3abfd1d2164a921d0b16800da7e2c22e65e70e9dd17860b0bda1515a1eabee9e7ce07dc4765dcd325cc8d5efa8a44a50152c000a', 'id': '0855b1ce-856e-46ea-9692-0087ae5f4836', 'created_at': datetime.datetime(2026, 4, 29, 13, 41, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 13, 41, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0855b1ce-856e-46ea-9692-0087ae5f4836/file', 'properties': {}}, 'image_service': }' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:48 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cf187fad-6a61-42d8-b880-7884d840318d tempest-VolumeImageDependencyTests-1307160939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2185085-3e31-4ec3-a3fe-8c02f3748ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:48 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cf187fad-6a61-42d8-b880-7884d840318d tempest-VolumeImageDependencyTests-1307160939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2185085-3e31-4ec3-a3fe-8c02f3748ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:48 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cf187fad-6a61-42d8-b880-7884d840318d tempest-VolumeImageDependencyTests-1307160939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b05d2245-cc10-4b2e-9f6b-0ce412ef6992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:48 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-cf187fad-6a61-42d8-b880-7884d840318d tempest-VolumeImageDependencyTests-1307160939 None] Volume 45057860-8463-4b9f-ae3f-3cfe2243b7bb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-45057860-8463-4b9f-ae3f-3cfe2243b7bb', 'volume_size': 1, 'image_id': '0855b1ce-856e-46ea-9692-0087ae5f4836', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0855b1ce-856e-46ea-9692-0087ae5f4836', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ef645a9828b1e9caf2fe34208f2ea6e3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a29748d81f464672b5f2e2d080b6d086', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3ec3d1514a4d0281bf2bf01d3abfd1d2164a921d0b16800da7e2c22e65e70e9dd17860b0bda1515a1eabee9e7ce07dc4765dcd325cc8d5efa8a44a50152c000a', 'id': '0855b1ce-856e-46ea-9692-0087ae5f4836', 'created_at': datetime.datetime(2026, 4, 29, 13, 41, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 13, 41, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0855b1ce-856e-46ea-9692-0087ae5f4836/file', 'properties': {}}, 'image_service': } Apr 29 15:41:48 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf187fad-6a61-42d8-b880-7884d840318d tempest-VolumeImageDependencyTests-1307160939 None] Trying to clone 45057860-8463-4b9f-ae3f-3cfe2243b7bb from image 0855b1ce-856e-46ea-9692-0087ae5f4836 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0855b1ce-856e-46ea-9692-0087ae5f4836', 'metadata': {}}]). {{(pid=84448) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 29 15:41:48 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [None req-cf187fad-6a61-42d8-b880-7884d840318d tempest-VolumeImageDependencyTests-1307160939 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0855b1ce-856e-46ea-9692-0087ae5f4836_9xnhpiujdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=84448) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 29 15:41:48 devstack cinder-volume[84448]: INFO cinder.image.image_utils [None req-cf187fad-6a61-42d8-b880-7884d840318d tempest-VolumeImageDependencyTests-1307160939 None] Image download 0.00 MB at 0.00 MB/s Apr 29 15:41:48 devstack sudo[111967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7abd3063-2349-469d-9c94-99a992748cf3 Apr 29 15:41:48 devstack sudo[111967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:48 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0fbb51-f972-48fc-a3b2-1e775453d7c4]: (4, 'raw') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:41:48 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cf187fad-6a61-42d8-b880-7884d840318d tempest-VolumeImageDependencyTests-1307160939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0855b1ce-856e-46ea-9692-0087ae5f4836_9xnhpiujdevstack@QuobyteHD {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:49 devstack sudo[111917]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:49 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cdf3d053-5f72-4bed-ab22-a0ffc307e1c1 tempest-VolumeDependencyTests-347675874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-125a8290-20d5-4d49-b9e0-6b57d70322f4 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7dd50a7e-6504-4a5f-a442-4ce074d279f2" returned: 0 in 6.932s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:49 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ad3e9e-a64f-475a-a73b-c7624a43b99d]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:41:49 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cdf3d053-5f72-4bed-ab22-a0ffc307e1c1 tempest-VolumeDependencyTests-347675874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-125a8290-20d5-4d49-b9e0-6b57d70322f4 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:49 devstack sudo[111970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0855b1ce-856e-46ea-9692-0087ae5f4836_9xnhpiujdevstack@QuobyteHD Apr 29 15:41:49 devstack sudo[111970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:49 devstack sudo[111962]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:49 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-5dd1e8d7-352e-44c4-950c-5ce91fa0206c tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-d237bd67-b183-42c1-9ab5-64b4e20eef4c" returned: 0 in 1.872s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:49 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-5dd1e8d7-352e-44c4-950c-5ce91fa0206c tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Lock "cinder-quobyte-d237bd67-b183-42c1-9ab5-64b4e20eef4c" released by "delete_volume" :: held 3.661s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:41:49 devstack sudo[111971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-125a8290-20d5-4d49-b9e0-6b57d70322f4 Apr 29 15:41:49 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-5dd1e8d7-352e-44c4-950c-5ce91fa0206c tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Created reservations ['fb3d847d-a373-4101-8683-96b3f489193d', 'a7127cc6-6c40-4f17-a400-60834ac71f6e', '99d41010-f909-4f66-a24c-59a89536c60e', '70c52f68-8d35-4142-90ba-53b8877538b4'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:41:49 devstack sudo[111971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:49 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-5dd1e8d7-352e-44c4-950c-5ce91fa0206c tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:41:49 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-5dd1e8d7-352e-44c4-950c-5ce91fa0206c tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:41:49 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-5dd1e8d7-352e-44c4-950c-5ce91fa0206c tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:41:49 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-5dd1e8d7-352e-44c4-950c-5ce91fa0206c tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:41:49 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-5dd1e8d7-352e-44c4-950c-5ce91fa0206c tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:41:49 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-5dd1e8d7-352e-44c4-950c-5ce91fa0206c tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:49 devstack sudo[111974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:41:49 devstack sudo[111974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:49 devstack sudo[111967]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:49 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7edd15b4-0774-47af-a38d-ebd51dbf5cf2 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7abd3063-2349-469d-9c94-99a992748cf3" returned: 0 in 1.103s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:49 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7edd15b4-0774-47af-a38d-ebd51dbf5cf2 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7abd3063-2349-469d-9c94-99a992748cf3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:49 devstack sudo[111978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7abd3063-2349-469d-9c94-99a992748cf3 Apr 29 15:41:49 devstack sudo[111970]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:49 devstack sudo[111978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:49 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cf187fad-6a61-42d8-b880-7884d840318d tempest-VolumeImageDependencyTests-1307160939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0855b1ce-856e-46ea-9692-0087ae5f4836_9xnhpiujdevstack@QuobyteHD" returned: 0 in 0.792s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:49 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cf187fad-6a61-42d8-b880-7884d840318d tempest-VolumeImageDependencyTests-1307160939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0855b1ce-856e-46ea-9692-0087ae5f4836_9xnhpiujdevstack@QuobyteHD {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:49 devstack sudo[111984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0855b1ce-856e-46ea-9692-0087ae5f4836_9xnhpiujdevstack@QuobyteHD Apr 29 15:41:49 devstack sudo[111984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:49 devstack sudo[111974]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:49 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-5dd1e8d7-352e-44c4-950c-5ce91fa0206c tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.609s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:49 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-5dd1e8d7-352e-44c4-950c-5ce91fa0206c tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:41:49 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-5dd1e8d7-352e-44c4-950c-5ce91fa0206c tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Deleted volume successfully. Apr 29 15:41:49 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-5dd1e8d7-352e-44c4-950c-5ce91fa0206c tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Lock "cinder-d237bd67-b183-42c1-9ab5-64b4e20eef4c-delete_volume" released by "delete_volume" :: held 4.594s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:41:50 devstack sudo[111971]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cdf3d053-5f72-4bed-ab22-a0ffc307e1c1 tempest-VolumeDependencyTests-347675874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-125a8290-20d5-4d49-b9e0-6b57d70322f4" returned: 0 in 1.003s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:50 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [None req-cdf3d053-5f72-4bed-ab22-a0ffc307e1c1 tempest-VolumeDependencyTests-347675874 None] Image conversion details: src /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-125a8290-20d5-4d49-b9e0-6b57d70322f4, size 1024.00 MB, duration 6.93 sec, destination /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7dd50a7e-6504-4a5f-a442-4ce074d279f2 {{(pid=84448) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 15:41:50 devstack cinder-volume[84448]: INFO cinder.image.image_utils [None req-cdf3d053-5f72-4bed-ab22-a0ffc307e1c1 tempest-VolumeDependencyTests-347675874 None] Converted 1024.00 MB image at 147.68 MB/s Apr 29 15:41:50 devstack cinder-volume[84448]: WARNING cinder.volume.drivers.remotefs [None req-cdf3d053-5f72-4bed-ab22-a0ffc307e1c1 tempest-VolumeDependencyTests-347675874 None] /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7dd50a7e-6504-4a5f-a442-4ce074d279f2 is being set with open permissions: ugo+rw Apr 29 15:41:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cdf3d053-5f72-4bed-ab22-a0ffc307e1c1 tempest-VolumeDependencyTests-347675874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7dd50a7e-6504-4a5f-a442-4ce074d279f2 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:50 devstack sudo[111988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7dd50a7e-6504-4a5f-a442-4ce074d279f2 Apr 29 15:41:50 devstack sudo[111988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:50 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-ecfc299b-d3c9-412d-a42d-53a02c63af89 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Acquiring lock "cinder-19d55b30-8e91-4780-80f8-e391711ccbf0-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:41:50 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-ecfc299b-d3c9-412d-a42d-53a02c63af89 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Lock "cinder-19d55b30-8e91-4780-80f8-e391711ccbf0-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:41:50 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-ecfc299b-d3c9-412d-a42d-53a02c63af89 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Acquiring lock "cinder-quobyte-19d55b30-8e91-4780-80f8-e391711ccbf0" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:41:50 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-ecfc299b-d3c9-412d-a42d-53a02c63af89 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Lock "cinder-quobyte-19d55b30-8e91-4780-80f8-e391711ccbf0" acquired by "delete_volume" :: waited 0.024s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:41:50 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[a08d8d6b-8b8e-4320-a57b-431113716c8c]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:41:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ecfc299b-d3c9-412d-a42d-53a02c63af89 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-19d55b30-8e91-4780-80f8-e391711ccbf0 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:50 devstack sudo[111978]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7edd15b4-0774-47af-a38d-ebd51dbf5cf2 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7abd3063-2349-469d-9c94-99a992748cf3" returned: 1 in 0.873s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7edd15b4-0774-47af-a38d-ebd51dbf5cf2 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7abd3063-2349-469d-9c94-99a992748cf3' failed. Not Retrying. {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 15:41:50 devstack cinder-volume[84448]: DEBUG cinder.volume.volume_utils [None req-7edd15b4-0774-47af-a38d-ebd51dbf5cf2 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] Downloaded image 088bd261-61fd-428d-8444-2cf93043dc26 ((None, [{'url': 'file:///opt/stack/data/glance/images/088bd261-61fd-428d-8444-2cf93043dc26', 'metadata': {}}])) to volume 7abd3063-2349-469d-9c94-99a992748cf3 successfully. {{(pid=84448) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 29 15:41:50 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [None req-7edd15b4-0774-47af-a38d-ebd51dbf5cf2 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] Temporary image 088bd261-61fd-428d-8444-2cf93043dc26 for user bf89206f2e2a4851ae1e22d4cd0f3ee5 is deleted. {{(pid=84448) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 29 15:41:50 devstack cinder-volume[84448]: DEBUG cinder.volume.volume_utils [None req-7edd15b4-0774-47af-a38d-ebd51dbf5cf2 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] Marking volume 7abd3063-2349-469d-9c94-99a992748cf3 as bootable. {{(pid=84448) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 29 15:41:50 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-7edd15b4-0774-47af-a38d-ebd51dbf5cf2 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] Copying metadata from image 088bd261-61fd-428d-8444-2cf93043dc26 to 7abd3063-2349-469d-9c94-99a992748cf3. {{(pid=84448) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 29 15:41:50 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-7edd15b4-0774-47af-a38d-ebd51dbf5cf2 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] Creating volume glance metadata for volume 7abd3063-2349-469d-9c94-99a992748cf3 backed by image 088bd261-61fd-428d-8444-2cf93043dc26 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '088bd261-61fd-428d-8444-2cf93043dc26', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '30db540f4e09025684182ec615e4a1f6', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=84448) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 29 15:41:50 devstack sudo[111993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-19d55b30-8e91-4780-80f8-e391711ccbf0 Apr 29 15:41:50 devstack sudo[111993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:50 devstack sudo[111984]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cf187fad-6a61-42d8-b880-7884d840318d tempest-VolumeImageDependencyTests-1307160939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0855b1ce-856e-46ea-9692-0087ae5f4836_9xnhpiujdevstack@QuobyteHD" returned: 1 in 0.779s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cf187fad-6a61-42d8-b880-7884d840318d tempest-VolumeImageDependencyTests-1307160939 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0855b1ce-856e-46ea-9692-0087ae5f4836_9xnhpiujdevstack@QuobyteHD' failed. Not Retrying. {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 15:41:50 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [None req-cf187fad-6a61-42d8-b880-7884d840318d tempest-VolumeImageDependencyTests-1307160939 None] Temporary image 0855b1ce-856e-46ea-9692-0087ae5f4836 is fetched for user 0a314754c97541eb9615314c752f7f00. {{(pid=84448) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 29 15:41:50 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-7edd15b4-0774-47af-a38d-ebd51dbf5cf2 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03c63006-a030-47f7-90f3-f95525a1992b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7abd3063-2349-469d-9c94-99a992748cf3', 'volume_size': 1, 'image_id': '088bd261-61fd-428d-8444-2cf93043dc26', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/088bd261-61fd-428d-8444-2cf93043dc26', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '30db540f4e09025684182ec615e4a1f6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9e9d0ec4088a4196b7b5be876b87300a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '71a40f588345c81b94cc20ff4add260ad75544ddb6956af05aa25d4fbee9802f14dbb6fb06089a50818f0a395eddaf1c07c1e264f76f1187ea3df2d14e07b984', 'id': '088bd261-61fd-428d-8444-2cf93043dc26', 'created_at': datetime.datetime(2026, 4, 29, 13, 41, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 13, 41, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/088bd261-61fd-428d-8444-2cf93043dc26/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:50 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-7edd15b4-0774-47af-a38d-ebd51dbf5cf2 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c91e70c-fe8b-4777-82a7-cc6f4ab4c701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:50 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-7edd15b4-0774-47af-a38d-ebd51dbf5cf2 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] Volume volume-7abd3063-2349-469d-9c94-99a992748cf3 (7abd3063-2349-469d-9c94-99a992748cf3): created successfully Apr 29 15:41:50 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-7edd15b4-0774-47af-a38d-ebd51dbf5cf2 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c91e70c-fe8b-4777-82a7-cc6f4ab4c701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:50 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-7edd15b4-0774-47af-a38d-ebd51dbf5cf2 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] Flow 'volume_create_manager' (b584810a-becc-48dd-ac9c-8584322f856b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:41:50 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[446aa13c-ff52-458e-bc53-c0b68c26fc06]: (4, 'raw') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:41:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cf187fad-6a61-42d8-b880-7884d840318d tempest-VolumeImageDependencyTests-1307160939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0855b1ce-856e-46ea-9692-0087ae5f4836_9xnhpiujdevstack@QuobyteHD {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:50 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-7edd15b4-0774-47af-a38d-ebd51dbf5cf2 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] Created volume successfully. Apr 29 15:41:50 devstack sudo[111998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0855b1ce-856e-46ea-9692-0087ae5f4836_9xnhpiujdevstack@QuobyteHD Apr 29 15:41:50 devstack sudo[111998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:50 devstack sudo[111988]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cdf3d053-5f72-4bed-ab22-a0ffc307e1c1 tempest-VolumeDependencyTests-347675874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7dd50a7e-6504-4a5f-a442-4ce074d279f2" returned: 0 in 0.750s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:50 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-cdf3d053-5f72-4bed-ab22-a0ffc307e1c1 tempest-VolumeDependencyTests-347675874 None] Lock "cinder-quobyte-7dd50a7e-6504-4a5f-a442-4ce074d279f2" released by "_copy_volume_from_snapshot" :: held 10.792s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:41:50 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-cdf3d053-5f72-4bed-ab22-a0ffc307e1c1 tempest-VolumeDependencyTests-347675874 None] Lock "cinder-quobyte-01b461f7-6528-4cac-bcd1-5d4f53c44885-7dd50a7e-6504-4a5f-a442-4ce074d279f2" released by "_create_volume_from_snapshot" :: held 10.835s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:41:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-cdf3d053-5f72-4bed-ab22-a0ffc307e1c1 tempest-VolumeDependencyTests-347675874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.877s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:41:50 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cdf3d053-5f72-4bed-ab22-a0ffc307e1c1 tempest-VolumeDependencyTests-347675874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (688d3171-ed7c-4f99-a661-7a87e6a5934f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7dd50a7e-6504-4a5f-a442-4ce074d279f2', 'volume_size': 1, 'snapshot_id': '01b461f7-6528-4cac-bcd1-5d4f53c44885'}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:50 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cdf3d053-5f72-4bed-ab22-a0ffc307e1c1 tempest-VolumeDependencyTests-347675874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (154e434f-fbf1-438d-ab31-5f51d6c55ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:50 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-cdf3d053-5f72-4bed-ab22-a0ffc307e1c1 tempest-VolumeDependencyTests-347675874 None] Volume volume-7dd50a7e-6504-4a5f-a442-4ce074d279f2 (7dd50a7e-6504-4a5f-a442-4ce074d279f2): created successfully Apr 29 15:41:50 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cdf3d053-5f72-4bed-ab22-a0ffc307e1c1 tempest-VolumeDependencyTests-347675874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (154e434f-fbf1-438d-ab31-5f51d6c55ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:50 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cdf3d053-5f72-4bed-ab22-a0ffc307e1c1 tempest-VolumeDependencyTests-347675874 None] Flow 'volume_create_manager' (1500ff55-13ce-4ec2-a679-534d73e08396) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:41:50 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-cdf3d053-5f72-4bed-ab22-a0ffc307e1c1 tempest-VolumeDependencyTests-347675874 None] Created volume successfully. Apr 29 15:41:51 devstack sudo[111993]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:51 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ecfc299b-d3c9-412d-a42d-53a02c63af89 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-19d55b30-8e91-4780-80f8-e391711ccbf0" returned: 0 in 0.794s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:51 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ecfc299b-d3c9-412d-a42d-53a02c63af89 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-19d55b30-8e91-4780-80f8-e391711ccbf0 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:51 devstack sudo[112004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-19d55b30-8e91-4780-80f8-e391711ccbf0 Apr 29 15:41:51 devstack sudo[112004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:51 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-fa5be82e-ae23-4ed3-9a3c-cb9a8f7d8e33 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] Acquiring lock "cinder-7abd3063-2349-469d-9c94-99a992748cf3-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:41:51 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-fa5be82e-ae23-4ed3-9a3c-cb9a8f7d8e33 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] Lock "cinder-7abd3063-2349-469d-9c94-99a992748cf3-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:41:51 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-fa5be82e-ae23-4ed3-9a3c-cb9a8f7d8e33 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] Acquiring lock "cinder-quobyte-7abd3063-2349-469d-9c94-99a992748cf3" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:41:51 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-fa5be82e-ae23-4ed3-9a3c-cb9a8f7d8e33 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] Lock "cinder-quobyte-7abd3063-2349-469d-9c94-99a992748cf3" acquired by "delete_volume" :: waited 0.020s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:41:51 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[13086cd7-f1a2-48a6-88ce-48786360c2cf]: (4, 'raw') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:41:51 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-fa5be82e-ae23-4ed3-9a3c-cb9a8f7d8e33 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7abd3063-2349-469d-9c94-99a992748cf3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:51 devstack sudo[111998]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:51 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cf187fad-6a61-42d8-b880-7884d840318d tempest-VolumeImageDependencyTests-1307160939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0855b1ce-856e-46ea-9692-0087ae5f4836_9xnhpiujdevstack@QuobyteHD" returned: 0 in 0.788s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:51 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cf187fad-6a61-42d8-b880-7884d840318d tempest-VolumeImageDependencyTests-1307160939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0855b1ce-856e-46ea-9692-0087ae5f4836_9xnhpiujdevstack@QuobyteHD {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:51 devstack sudo[112008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7abd3063-2349-469d-9c94-99a992748cf3 Apr 29 15:41:51 devstack sudo[112008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:51 devstack sudo[112009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0855b1ce-856e-46ea-9692-0087ae5f4836_9xnhpiujdevstack@QuobyteHD Apr 29 15:41:51 devstack sudo[112009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:51 devstack sudo[112004]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:51 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ecfc299b-d3c9-412d-a42d-53a02c63af89 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-19d55b30-8e91-4780-80f8-e391711ccbf0" returned: 0 in 0.634s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:51 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-ecfc299b-d3c9-412d-a42d-53a02c63af89 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Lock "cinder-quobyte-19d55b30-8e91-4780-80f8-e391711ccbf0" released by "delete_volume" :: held 1.474s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:41:51 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-ecfc299b-d3c9-412d-a42d-53a02c63af89 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Created reservations ['4b43b44c-21ed-4aba-a9bb-9a686fe22b76', '58e07a3f-0fa8-4f24-9bb0-0c8a7a5237be', 'b6039d2a-a761-4a3f-b238-5002f4915b03', '4f7cf223-f3bb-4f46-ae65-37e335c2e93b'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:41:51 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-ecfc299b-d3c9-412d-a42d-53a02c63af89 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:41:51 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-ecfc299b-d3c9-412d-a42d-53a02c63af89 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:41:51 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-ecfc299b-d3c9-412d-a42d-53a02c63af89 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:41:51 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-ecfc299b-d3c9-412d-a42d-53a02c63af89 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:41:51 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-ecfc299b-d3c9-412d-a42d-53a02c63af89 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:41:51 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ecfc299b-d3c9-412d-a42d-53a02c63af89 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:51 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-5dc99ace-a86b-4f98-8555-9b34821dddcc tempest-VolumeDependencyTests-347675874 None] Acquiring lock "cinder-01b461f7-6528-4cac-bcd1-5d4f53c44885-delete_snapshot" by "delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:41:51 devstack sudo[112013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:41:51 devstack sudo[112013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:52 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-5dc99ace-a86b-4f98-8555-9b34821dddcc tempest-VolumeDependencyTests-347675874 None] Lock "cinder-01b461f7-6528-4cac-bcd1-5d4f53c44885-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:41:52 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-5dc99ace-a86b-4f98-8555-9b34821dddcc tempest-VolumeDependencyTests-347675874 None] Acquiring lock "cinder-quobyte-125a8290-20d5-4d49-b9e0-6b57d70322f4" by "delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:41:52 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-5dc99ace-a86b-4f98-8555-9b34821dddcc tempest-VolumeDependencyTests-347675874 None] Lock "cinder-quobyte-125a8290-20d5-4d49-b9e0-6b57d70322f4" acquired by "delete_snapshot" :: waited 0.022s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:41:52 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-5dc99ace-a86b-4f98-8555-9b34821dddcc tempest-VolumeDependencyTests-347675874 None] Acquiring lock "cinder-quobyte-01b461f7-6528-4cac-bcd1-5d4f53c44885" by "_delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:41:52 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-5dc99ace-a86b-4f98-8555-9b34821dddcc tempest-VolumeDependencyTests-347675874 None] Lock "cinder-quobyte-01b461f7-6528-4cac-bcd1-5d4f53c44885" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:41:52 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-5dc99ace-a86b-4f98-8555-9b34821dddcc tempest-VolumeDependencyTests-347675874 None] Deleting offline snapshot 01b461f7-6528-4cac-bcd1-5d4f53c44885 of volume 125a8290-20d5-4d49-b9e0-6b57d70322f4 {{(pid=84448) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 15:41:52 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-5dc99ace-a86b-4f98-8555-9b34821dddcc tempest-VolumeDependencyTests-347675874 None] snapshot_file for this snap is: volume-125a8290-20d5-4d49-b9e0-6b57d70322f4.01b461f7-6528-4cac-bcd1-5d4f53c44885 {{(pid=84448) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 15:41:52 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f1278f7-eb21-46a5-b723-ecbd20f979e6]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:41:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-5dc99ace-a86b-4f98-8555-9b34821dddcc tempest-VolumeDependencyTests-347675874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-125a8290-20d5-4d49-b9e0-6b57d70322f4.01b461f7-6528-4cac-bcd1-5d4f53c44885 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:52 devstack sudo[112009]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cf187fad-6a61-42d8-b880-7884d840318d tempest-VolumeImageDependencyTests-1307160939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0855b1ce-856e-46ea-9692-0087ae5f4836_9xnhpiujdevstack@QuobyteHD" returned: 1 in 0.744s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cf187fad-6a61-42d8-b880-7884d840318d tempest-VolumeImageDependencyTests-1307160939 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0855b1ce-856e-46ea-9692-0087ae5f4836_9xnhpiujdevstack@QuobyteHD' failed. Not Retrying. {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 15:41:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-cf187fad-6a61-42d8-b880-7884d840318d tempest-VolumeImageDependencyTests-1307160939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:41:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-cf187fad-6a61-42d8-b880-7884d840318d tempest-VolumeImageDependencyTests-1307160939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:41:52 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-cf187fad-6a61-42d8-b880-7884d840318d tempest-VolumeImageDependencyTests-1307160939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:41:47Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45057860-8463-4b9f-ae3f-3cfe2243b7bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a29748d81f464672b5f2e2d080b6d086',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:41:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:41:48Z,use_quota=True,user_id='0a314754c97541eb9615314c752f7f00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:41:52 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-cf187fad-6a61-42d8-b880-7884d840318d tempest-VolumeImageDependencyTests-1307160939 None] Creating volume 45057860-8463-4b9f-ae3f-3cfe2243b7bb {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:41:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-cf187fad-6a61-42d8-b880-7884d840318d tempest-VolumeImageDependencyTests-1307160939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:41:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-cf187fad-6a61-42d8-b880-7884d840318d tempest-VolumeImageDependencyTests-1307160939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:41:52 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-cf187fad-6a61-42d8-b880-7884d840318d tempest-VolumeImageDependencyTests-1307160939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:41:52 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-cf187fad-6a61-42d8-b880-7884d840318d tempest-VolumeImageDependencyTests-1307160939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:41:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-cf187fad-6a61-42d8-b880-7884d840318d tempest-VolumeImageDependencyTests-1307160939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:41:52 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-cf187fad-6a61-42d8-b880-7884d840318d tempest-VolumeImageDependencyTests-1307160939 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:41:52 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-cf187fad-6a61-42d8-b880-7884d840318d tempest-VolumeImageDependencyTests-1307160939 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:41:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cf187fad-6a61-42d8-b880-7884d840318d tempest-VolumeImageDependencyTests-1307160939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-45057860-8463-4b9f-ae3f-3cfe2243b7bb 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:52 devstack sudo[112021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-45057860-8463-4b9f-ae3f-3cfe2243b7bb 1073741824 Apr 29 15:41:52 devstack sudo[112021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:52 devstack sudo[112020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-125a8290-20d5-4d49-b9e0-6b57d70322f4.01b461f7-6528-4cac-bcd1-5d4f53c44885 Apr 29 15:41:52 devstack sudo[112020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:52 devstack sudo[112008]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-fa5be82e-ae23-4ed3-9a3c-cb9a8f7d8e33 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7abd3063-2349-469d-9c94-99a992748cf3" returned: 0 in 0.851s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-fa5be82e-ae23-4ed3-9a3c-cb9a8f7d8e33 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7abd3063-2349-469d-9c94-99a992748cf3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:52 devstack sudo[112024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7abd3063-2349-469d-9c94-99a992748cf3 Apr 29 15:41:52 devstack sudo[112024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:52 devstack sudo[112013]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ecfc299b-d3c9-412d-a42d-53a02c63af89 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.780s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:52 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-ecfc299b-d3c9-412d-a42d-53a02c63af89 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:41:52 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-ecfc299b-d3c9-412d-a42d-53a02c63af89 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Deleted volume successfully. Apr 29 15:41:52 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-ecfc299b-d3c9-412d-a42d-53a02c63af89 tempest-CreateVolumesFromSourceVolumeTest-2110424478 None] Lock "cinder-19d55b30-8e91-4780-80f8-e391711ccbf0-delete_volume" released by "delete_volume" :: held 2.538s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:41:53 devstack sudo[112024]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-fa5be82e-ae23-4ed3-9a3c-cb9a8f7d8e33 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7abd3063-2349-469d-9c94-99a992748cf3" returned: 1 in 0.832s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-fa5be82e-ae23-4ed3-9a3c-cb9a8f7d8e33 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7abd3063-2349-469d-9c94-99a992748cf3' failed. Not Retrying. {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 15:41:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-fa5be82e-ae23-4ed3-9a3c-cb9a8f7d8e33 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7abd3063-2349-469d-9c94-99a992748cf3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:53 devstack sudo[112020]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-5dc99ace-a86b-4f98-8555-9b34821dddcc tempest-VolumeDependencyTests-347675874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-125a8290-20d5-4d49-b9e0-6b57d70322f4.01b461f7-6528-4cac-bcd1-5d4f53c44885" returned: 0 in 0.981s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:53 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-5dc99ace-a86b-4f98-8555-9b34821dddcc tempest-VolumeDependencyTests-347675874 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-125a8290-20d5-4d49-b9e0-6b57d70322f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84448) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 15:41:53 devstack sudo[112038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7abd3063-2349-469d-9c94-99a992748cf3 Apr 29 15:41:53 devstack sudo[112038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:53 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[a69b22c2-672a-48e8-ac47-9af00f03e178]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:41:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-5dc99ace-a86b-4f98-8555-9b34821dddcc tempest-VolumeDependencyTests-347675874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-125a8290-20d5-4d49-b9e0-6b57d70322f4 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:53 devstack sudo[112021]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cf187fad-6a61-42d8-b880-7884d840318d tempest-VolumeImageDependencyTests-1307160939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-45057860-8463-4b9f-ae3f-3cfe2243b7bb 1073741824" returned: 0 in 1.019s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cf187fad-6a61-42d8-b880-7884d840318d tempest-VolumeImageDependencyTests-1307160939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-45057860-8463-4b9f-ae3f-3cfe2243b7bb {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:53 devstack sudo[112040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-125a8290-20d5-4d49-b9e0-6b57d70322f4 Apr 29 15:41:53 devstack sudo[112040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:53 devstack sudo[112041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-45057860-8463-4b9f-ae3f-3cfe2243b7bb Apr 29 15:41:53 devstack sudo[112041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:53 devstack sudo[112038]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-fa5be82e-ae23-4ed3-9a3c-cb9a8f7d8e33 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7abd3063-2349-469d-9c94-99a992748cf3" returned: 0 in 0.752s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:53 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-fa5be82e-ae23-4ed3-9a3c-cb9a8f7d8e33 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] Lock "cinder-quobyte-7abd3063-2349-469d-9c94-99a992748cf3" released by "delete_volume" :: held 2.534s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:41:53 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-fa5be82e-ae23-4ed3-9a3c-cb9a8f7d8e33 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] Created reservations ['71cd5259-8e00-4226-86ed-a85878da8794', 'db68ba94-c09d-417b-b424-76c2d9e07e2d', '211d2397-d4a2-4241-8ac9-714d7c183154', 'a8aad900-47af-4e33-a38c-6c95c433f164'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:41:53 devstack sudo[112041]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cf187fad-6a61-42d8-b880-7884d840318d tempest-VolumeImageDependencyTests-1307160939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-45057860-8463-4b9f-ae3f-3cfe2243b7bb" returned: 0 in 0.753s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:53 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-cf187fad-6a61-42d8-b880-7884d840318d tempest-VolumeImageDependencyTests-1307160939 None] <== create_volume: return (1820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:41:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-cf187fad-6a61-42d8-b880-7884d840318d tempest-VolumeImageDependencyTests-1307160939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.823s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:41:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-fa5be82e-ae23-4ed3-9a3c-cb9a8f7d8e33 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:41:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-fa5be82e-ae23-4ed3-9a3c-cb9a8f7d8e33 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:41:54 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-fa5be82e-ae23-4ed3-9a3c-cb9a8f7d8e33 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:41:54 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-fa5be82e-ae23-4ed3-9a3c-cb9a8f7d8e33 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:41:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-fa5be82e-ae23-4ed3-9a3c-cb9a8f7d8e33 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:41:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-fa5be82e-ae23-4ed3-9a3c-cb9a8f7d8e33 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:54 devstack sudo[112050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:41:54 devstack cinder-volume[84448]: DEBUG cinder.volume.volume_utils [None req-cf187fad-6a61-42d8-b880-7884d840318d tempest-VolumeImageDependencyTests-1307160939 None] Attempting download of 0855b1ce-856e-46ea-9692-0087ae5f4836 ((None, [{'url': 'file:///opt/stack/data/glance/images/0855b1ce-856e-46ea-9692-0087ae5f4836', 'metadata': {}}])) to volume 45057860-8463-4b9f-ae3f-3cfe2243b7bb. {{(pid=84448) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 29 15:41:54 devstack sudo[112050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:54 devstack sudo[112040]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-5dc99ace-a86b-4f98-8555-9b34821dddcc tempest-VolumeDependencyTests-347675874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-125a8290-20d5-4d49-b9e0-6b57d70322f4" returned: 0 in 0.954s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-5dc99ace-a86b-4f98-8555-9b34821dddcc tempest-VolumeDependencyTests-347675874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-125a8290-20d5-4d49-b9e0-6b57d70322f4.01b461f7-6528-4cac-bcd1-5d4f53c44885 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:54 devstack sudo[112052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-125a8290-20d5-4d49-b9e0-6b57d70322f4.01b461f7-6528-4cac-bcd1-5d4f53c44885 Apr 29 15:41:54 devstack sudo[112052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:54 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[06191fae-d61d-4e07-be6b-0c2b760d5527]: (4, 'raw') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:41:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cf187fad-6a61-42d8-b880-7884d840318d tempest-VolumeImageDependencyTests-1307160939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0855b1ce-856e-46ea-9692-0087ae5f4836_x4d58mxl {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:54 devstack sudo[112054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0855b1ce-856e-46ea-9692-0087ae5f4836_x4d58mxl Apr 29 15:41:54 devstack sudo[112054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:54 devstack sudo[112054]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cf187fad-6a61-42d8-b880-7884d840318d tempest-VolumeImageDependencyTests-1307160939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0855b1ce-856e-46ea-9692-0087ae5f4836_x4d58mxl" returned: 0 in 0.809s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cf187fad-6a61-42d8-b880-7884d840318d tempest-VolumeImageDependencyTests-1307160939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0855b1ce-856e-46ea-9692-0087ae5f4836_x4d58mxl {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:54 devstack sudo[112050]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-fa5be82e-ae23-4ed3-9a3c-cb9a8f7d8e33 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.981s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:54 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-fa5be82e-ae23-4ed3-9a3c-cb9a8f7d8e33 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:41:55 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-fa5be82e-ae23-4ed3-9a3c-cb9a8f7d8e33 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] Deleted volume successfully. Apr 29 15:41:55 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-fa5be82e-ae23-4ed3-9a3c-cb9a8f7d8e33 tempest-VolumeAndVolumeTypeFromImageTest-1169933922 None] Lock "cinder-7abd3063-2349-469d-9c94-99a992748cf3-delete_volume" released by "delete_volume" :: held 3.770s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:41:55 devstack sudo[112052]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-5dc99ace-a86b-4f98-8555-9b34821dddcc tempest-VolumeDependencyTests-347675874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-125a8290-20d5-4d49-b9e0-6b57d70322f4.01b461f7-6528-4cac-bcd1-5d4f53c44885" returned: 0 in 0.957s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-5dc99ace-a86b-4f98-8555-9b34821dddcc tempest-VolumeDependencyTests-347675874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-125a8290-20d5-4d49-b9e0-6b57d70322f4.01b461f7-6528-4cac-bcd1-5d4f53c44885 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:55 devstack sudo[112064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-125a8290-20d5-4d49-b9e0-6b57d70322f4.01b461f7-6528-4cac-bcd1-5d4f53c44885 Apr 29 15:41:55 devstack sudo[112064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:55 devstack sudo[112063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0855b1ce-856e-46ea-9692-0087ae5f4836_x4d58mxl Apr 29 15:41:55 devstack sudo[112063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:55 devstack sudo[112064]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-5dc99ace-a86b-4f98-8555-9b34821dddcc tempest-VolumeDependencyTests-347675874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-125a8290-20d5-4d49-b9e0-6b57d70322f4.01b461f7-6528-4cac-bcd1-5d4f53c44885" returned: 0 in 0.656s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:55 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-5dc99ace-a86b-4f98-8555-9b34821dddcc tempest-VolumeDependencyTests-347675874 None] Lock "cinder-quobyte-01b461f7-6528-4cac-bcd1-5d4f53c44885" released by "_delete_snapshot" :: held 3.697s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:41:55 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-5dc99ace-a86b-4f98-8555-9b34821dddcc tempest-VolumeDependencyTests-347675874 None] Lock "cinder-quobyte-125a8290-20d5-4d49-b9e0-6b57d70322f4" released by "delete_snapshot" :: held 3.735s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:41:55 devstack sudo[112063]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cf187fad-6a61-42d8-b880-7884d840318d tempest-VolumeImageDependencyTests-1307160939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0855b1ce-856e-46ea-9692-0087ae5f4836_x4d58mxl" returned: 1 in 0.857s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cf187fad-6a61-42d8-b880-7884d840318d tempest-VolumeImageDependencyTests-1307160939 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0855b1ce-856e-46ea-9692-0087ae5f4836_x4d58mxl' failed. Not Retrying. {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 15:41:55 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[4274af0a-f505-4782-a3d2-c0a4543fe4de]: (4, 'raw') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:41:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cf187fad-6a61-42d8-b880-7884d840318d tempest-VolumeImageDependencyTests-1307160939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0855b1ce-856e-46ea-9692-0087ae5f4836_9xnhpiujdevstack@QuobyteHD {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:55 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-5dc99ace-a86b-4f98-8555-9b34821dddcc tempest-VolumeDependencyTests-347675874 None] Created reservations ['adcec4cd-439d-40bd-9a9a-7d21f11b8bb0', '4fa60ec6-67fc-4344-8a1b-4850cc067e75', 'b22ba638-b179-49e7-942c-d82b763479e8', '3050d171-c086-42db-a4cd-7767e2950299'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:41:55 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-5dc99ace-a86b-4f98-8555-9b34821dddcc tempest-VolumeDependencyTests-347675874 None] Delete snapshot completed successfully. Apr 29 15:41:55 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-5dc99ace-a86b-4f98-8555-9b34821dddcc tempest-VolumeDependencyTests-347675874 None] Lock "cinder-01b461f7-6528-4cac-bcd1-5d4f53c44885-delete_snapshot" released by "delete_snapshot" :: held 3.911s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:41:55 devstack sudo[112070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0855b1ce-856e-46ea-9692-0087ae5f4836_9xnhpiujdevstack@QuobyteHD Apr 29 15:41:55 devstack sudo[112070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:56 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-c46712b3-7fe1-424e-89f5-da90fde3ea99 tempest-VolumeDependencyTests-347675874 None] Acquiring lock "cinder-125a8290-20d5-4d49-b9e0-6b57d70322f4-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:41:56 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-c46712b3-7fe1-424e-89f5-da90fde3ea99 tempest-VolumeDependencyTests-347675874 None] Lock "cinder-125a8290-20d5-4d49-b9e0-6b57d70322f4-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:41:56 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-c46712b3-7fe1-424e-89f5-da90fde3ea99 tempest-VolumeDependencyTests-347675874 None] Acquiring lock "cinder-quobyte-125a8290-20d5-4d49-b9e0-6b57d70322f4" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:41:56 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-c46712b3-7fe1-424e-89f5-da90fde3ea99 tempest-VolumeDependencyTests-347675874 None] Lock "cinder-quobyte-125a8290-20d5-4d49-b9e0-6b57d70322f4" acquired by "delete_volume" :: waited 0.024s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:41:56 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[40bb223f-3365-486f-a7ce-a4873dc082ab]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:41:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c46712b3-7fe1-424e-89f5-da90fde3ea99 tempest-VolumeDependencyTests-347675874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-125a8290-20d5-4d49-b9e0-6b57d70322f4 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:56 devstack sudo[112073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-125a8290-20d5-4d49-b9e0-6b57d70322f4 Apr 29 15:41:56 devstack sudo[112073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:56 devstack sudo[112070]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cf187fad-6a61-42d8-b880-7884d840318d tempest-VolumeImageDependencyTests-1307160939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0855b1ce-856e-46ea-9692-0087ae5f4836_9xnhpiujdevstack@QuobyteHD" returned: 0 in 0.910s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cf187fad-6a61-42d8-b880-7884d840318d tempest-VolumeImageDependencyTests-1307160939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0855b1ce-856e-46ea-9692-0087ae5f4836_9xnhpiujdevstack@QuobyteHD {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:56 devstack sudo[112077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0855b1ce-856e-46ea-9692-0087ae5f4836_9xnhpiujdevstack@QuobyteHD Apr 29 15:41:56 devstack sudo[112077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:57 devstack sudo[112073]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:57 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c46712b3-7fe1-424e-89f5-da90fde3ea99 tempest-VolumeDependencyTests-347675874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-125a8290-20d5-4d49-b9e0-6b57d70322f4" returned: 0 in 1.087s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:57 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c46712b3-7fe1-424e-89f5-da90fde3ea99 tempest-VolumeDependencyTests-347675874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-125a8290-20d5-4d49-b9e0-6b57d70322f4 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:57 devstack sudo[112085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-125a8290-20d5-4d49-b9e0-6b57d70322f4 Apr 29 15:41:57 devstack sudo[112085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:57 devstack sudo[112077]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:57 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cf187fad-6a61-42d8-b880-7884d840318d tempest-VolumeImageDependencyTests-1307160939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0855b1ce-856e-46ea-9692-0087ae5f4836_9xnhpiujdevstack@QuobyteHD" returned: 1 in 0.955s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:57 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cf187fad-6a61-42d8-b880-7884d840318d tempest-VolumeImageDependencyTests-1307160939 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0855b1ce-856e-46ea-9692-0087ae5f4836_9xnhpiujdevstack@QuobyteHD' failed. Not Retrying. {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 15:41:57 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [None req-cf187fad-6a61-42d8-b880-7884d840318d tempest-VolumeImageDependencyTests-1307160939 None] 0855b1ce-856e-46ea-9692-0087ae5f4836 was raw, converting to raw {{(pid=84448) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 29 15:41:57 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cf187fad-6a61-42d8-b880-7884d840318d tempest-VolumeImageDependencyTests-1307160939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_0855b1ce-856e-46ea-9692-0087ae5f4836_9xnhpiujdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-45057860-8463-4b9f-ae3f-3cfe2243b7bb {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:57 devstack sudo[112087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_0855b1ce-856e-46ea-9692-0087ae5f4836_9xnhpiujdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-45057860-8463-4b9f-ae3f-3cfe2243b7bb Apr 29 15:41:57 devstack sudo[112087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:58 devstack sudo[112085]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:58 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c46712b3-7fe1-424e-89f5-da90fde3ea99 tempest-VolumeDependencyTests-347675874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-125a8290-20d5-4d49-b9e0-6b57d70322f4" returned: 0 in 0.784s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:58 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-c46712b3-7fe1-424e-89f5-da90fde3ea99 tempest-VolumeDependencyTests-347675874 None] Lock "cinder-quobyte-125a8290-20d5-4d49-b9e0-6b57d70322f4" released by "delete_volume" :: held 1.973s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:41:58 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-c46712b3-7fe1-424e-89f5-da90fde3ea99 tempest-VolumeDependencyTests-347675874 None] Created reservations ['99f07bc2-95eb-4d80-b799-f7d1f4cceb77', '8a512046-f1e4-43d1-8d80-f17afd7adb34', 'aa74b1c1-8524-46c4-a6b7-3f51b2c12368', '33bd06f1-38de-4580-aab1-a52c9a57d92f'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:41:58 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-c46712b3-7fe1-424e-89f5-da90fde3ea99 tempest-VolumeDependencyTests-347675874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:41:58 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-c46712b3-7fe1-424e-89f5-da90fde3ea99 tempest-VolumeDependencyTests-347675874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:41:58 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-c46712b3-7fe1-424e-89f5-da90fde3ea99 tempest-VolumeDependencyTests-347675874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:41:58 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-c46712b3-7fe1-424e-89f5-da90fde3ea99 tempest-VolumeDependencyTests-347675874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:41:58 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-c46712b3-7fe1-424e-89f5-da90fde3ea99 tempest-VolumeDependencyTests-347675874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:41:58 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c46712b3-7fe1-424e-89f5-da90fde3ea99 tempest-VolumeDependencyTests-347675874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:58 devstack sudo[112093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:41:58 devstack sudo[112093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:58 devstack sudo[112087]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:58 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cf187fad-6a61-42d8-b880-7884d840318d tempest-VolumeImageDependencyTests-1307160939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_0855b1ce-856e-46ea-9692-0087ae5f4836_9xnhpiujdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-45057860-8463-4b9f-ae3f-3cfe2243b7bb" returned: 0 in 1.001s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:58 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [None req-cf187fad-6a61-42d8-b880-7884d840318d tempest-VolumeImageDependencyTests-1307160939 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0855b1ce-856e-46ea-9692-0087ae5f4836_9xnhpiujdevstack@QuobyteHD, size 0.00 MB, duration 1.01 sec, destination /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-45057860-8463-4b9f-ae3f-3cfe2243b7bb {{(pid=84448) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 15:41:58 devstack cinder-volume[84448]: INFO cinder.image.image_utils [None req-cf187fad-6a61-42d8-b880-7884d840318d tempest-VolumeImageDependencyTests-1307160939 None] Converted 0.00 MB image at 0.00 MB/s Apr 29 15:41:58 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cf187fad-6a61-42d8-b880-7884d840318d tempest-VolumeImageDependencyTests-1307160939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-45057860-8463-4b9f-ae3f-3cfe2243b7bb 1G {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:58 devstack sudo[112095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-45057860-8463-4b9f-ae3f-3cfe2243b7bb 1G Apr 29 15:41:58 devstack sudo[112095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:59 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ed88826-413a-4365-a35b-4414e4359004 tempest-VolumeDependencyTests-347675874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:41:59 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-5ed88826-413a-4365-a35b-4414e4359004 tempest-VolumeDependencyTests-347675874 None] Flow 'volume_create_manager' (b2792329-ba9c-4d78-9af1-e9bf17955793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:41:59 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-5ed88826-413a-4365-a35b-4414e4359004 tempest-VolumeDependencyTests-347675874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2af83d40-c5d9-45f8-834e-cea1fdbeb9f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:59 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-5ed88826-413a-4365-a35b-4414e4359004 tempest-VolumeDependencyTests-347675874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2af83d40-c5d9-45f8-834e-cea1fdbeb9f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:41:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-992913060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=977f6a7a-1f28-4b8d-81c5-5105a37a54ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aeb81c62ac284048b36f567290e59d0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:41:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:41:59Z,use_quota=True,user_id='5f2f077a45ee40b48b1d0833faeef45f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:59 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-5ed88826-413a-4365-a35b-4414e4359004 tempest-VolumeDependencyTests-347675874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4219245-c4d8-4561-8d62-a02640d4644e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:59 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-5ed88826-413a-4365-a35b-4414e4359004 tempest-VolumeDependencyTests-347675874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4219245-c4d8-4561-8d62-a02640d4644e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:59 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-5ed88826-413a-4365-a35b-4414e4359004 tempest-VolumeDependencyTests-347675874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93a5ff89-ce3b-4577-9488-0062eeb9c94f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:59 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-5ed88826-413a-4365-a35b-4414e4359004 tempest-VolumeDependencyTests-347675874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93a5ff89-ce3b-4577-9488-0062eeb9c94f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '977f6a7a-1f28-4b8d-81c5-5105a37a54ae', 'volume_name': 'volume-977f6a7a-1f28-4b8d-81c5-5105a37a54ae', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:59 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-5ed88826-413a-4365-a35b-4414e4359004 tempest-VolumeDependencyTests-347675874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb1f4dc3-6d88-432b-a08c-d54214c8bde0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:59 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-5ed88826-413a-4365-a35b-4414e4359004 tempest-VolumeDependencyTests-347675874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb1f4dc3-6d88-432b-a08c-d54214c8bde0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:41:59 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-5ed88826-413a-4365-a35b-4414e4359004 tempest-VolumeDependencyTests-347675874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea545515-ff97-49e6-88d3-3168e2c248b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:41:59 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-5ed88826-413a-4365-a35b-4414e4359004 tempest-VolumeDependencyTests-347675874 None] Volume 977f6a7a-1f28-4b8d-81c5-5105a37a54ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-977f6a7a-1f28-4b8d-81c5-5105a37a54ae', 'volume_size': 1} Apr 29 15:41:59 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-5ed88826-413a-4365-a35b-4414e4359004 tempest-VolumeDependencyTests-347675874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:41:59 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-5ed88826-413a-4365-a35b-4414e4359004 tempest-VolumeDependencyTests-347675874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:41:59 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-5ed88826-413a-4365-a35b-4414e4359004 tempest-VolumeDependencyTests-347675874 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:41:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-992913060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=977f6a7a-1f28-4b8d-81c5-5105a37a54ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aeb81c62ac284048b36f567290e59d0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:41:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:41:59Z,use_quota=True,user_id='5f2f077a45ee40b48b1d0833faeef45f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:41:59 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-5ed88826-413a-4365-a35b-4414e4359004 tempest-VolumeDependencyTests-347675874 None] Creating volume 977f6a7a-1f28-4b8d-81c5-5105a37a54ae {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:41:59 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-5ed88826-413a-4365-a35b-4414e4359004 tempest-VolumeDependencyTests-347675874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:41:59 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-5ed88826-413a-4365-a35b-4414e4359004 tempest-VolumeDependencyTests-347675874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:41:59 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-5ed88826-413a-4365-a35b-4414e4359004 tempest-VolumeDependencyTests-347675874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:41:59 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-5ed88826-413a-4365-a35b-4414e4359004 tempest-VolumeDependencyTests-347675874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:41:59 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-5ed88826-413a-4365-a35b-4414e4359004 tempest-VolumeDependencyTests-347675874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:41:59 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-5ed88826-413a-4365-a35b-4414e4359004 tempest-VolumeDependencyTests-347675874 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:41:59 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-5ed88826-413a-4365-a35b-4414e4359004 tempest-VolumeDependencyTests-347675874 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:41:59 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-5ed88826-413a-4365-a35b-4414e4359004 tempest-VolumeDependencyTests-347675874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-977f6a7a-1f28-4b8d-81c5-5105a37a54ae 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:41:59 devstack sudo[112098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-977f6a7a-1f28-4b8d-81c5-5105a37a54ae 1073741824 Apr 29 15:41:59 devstack sudo[112098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:41:59 devstack sudo[112093]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:59 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c46712b3-7fe1-424e-89f5-da90fde3ea99 tempest-VolumeDependencyTests-347675874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 1.079s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:59 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-c46712b3-7fe1-424e-89f5-da90fde3ea99 tempest-VolumeDependencyTests-347675874 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:41:59 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-c46712b3-7fe1-424e-89f5-da90fde3ea99 tempest-VolumeDependencyTests-347675874 None] Deleted volume successfully. Apr 29 15:41:59 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-c46712b3-7fe1-424e-89f5-da90fde3ea99 tempest-VolumeDependencyTests-347675874 None] Lock "cinder-125a8290-20d5-4d49-b9e0-6b57d70322f4-delete_volume" released by "delete_volume" :: held 3.372s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:41:59 devstack sudo[112095]: pam_unix(sudo:session): session closed for user root Apr 29 15:41:59 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cf187fad-6a61-42d8-b880-7884d840318d tempest-VolumeImageDependencyTests-1307160939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-45057860-8463-4b9f-ae3f-3cfe2243b7bb 1G" returned: 0 in 1.152s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:41:59 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e3ea1c8-cacc-4556-b20a-bcb3c63f94a8]: (4, 'raw') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:41:59 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cf187fad-6a61-42d8-b880-7884d840318d tempest-VolumeImageDependencyTests-1307160939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-45057860-8463-4b9f-ae3f-3cfe2243b7bb {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:00 devstack sudo[112103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-45057860-8463-4b9f-ae3f-3cfe2243b7bb Apr 29 15:42:00 devstack sudo[112103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:00 devstack sudo[112098]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:00 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-5ed88826-413a-4365-a35b-4414e4359004 tempest-VolumeDependencyTests-347675874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-977f6a7a-1f28-4b8d-81c5-5105a37a54ae 1073741824" returned: 0 in 1.252s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:00 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-5ed88826-413a-4365-a35b-4414e4359004 tempest-VolumeDependencyTests-347675874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-977f6a7a-1f28-4b8d-81c5-5105a37a54ae {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:00 devstack sudo[112112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-977f6a7a-1f28-4b8d-81c5-5105a37a54ae Apr 29 15:42:00 devstack sudo[112112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:00 devstack sudo[112103]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:00 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cf187fad-6a61-42d8-b880-7884d840318d tempest-VolumeImageDependencyTests-1307160939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-45057860-8463-4b9f-ae3f-3cfe2243b7bb" returned: 0 in 0.982s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:00 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cf187fad-6a61-42d8-b880-7884d840318d tempest-VolumeImageDependencyTests-1307160939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-45057860-8463-4b9f-ae3f-3cfe2243b7bb {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:01 devstack sudo[112114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-45057860-8463-4b9f-ae3f-3cfe2243b7bb Apr 29 15:42:01 devstack sudo[112114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:01 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-85e8ca5a-2bc7-4f09-bb65-48a7144e7025 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:42:01 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-85e8ca5a-2bc7-4f09-bb65-48a7144e7025 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Flow 'volume_create_manager' (f86c3988-f334-44cb-9f48-6655cc6f5a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:42:01 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-85e8ca5a-2bc7-4f09-bb65-48a7144e7025 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca0a237c-5a1b-4f40-b649-b7a975ee6fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:42:01 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-85e8ca5a-2bc7-4f09-bb65-48a7144e7025 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca0a237c-5a1b-4f40-b649-b7a975ee6fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:42:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-512608008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20059d47-dd80-4c12-81a4-7f5e32768aab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc69cec5ae4a486083f88dfbeb5e2570',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:42:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:42:01Z,use_quota=True,user_id='cc0c3f24d7bc4f68b863ce492f25e005',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:42:01 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-85e8ca5a-2bc7-4f09-bb65-48a7144e7025 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31d53157-952c-44bf-8c5c-55d777880b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:42:01 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-85e8ca5a-2bc7-4f09-bb65-48a7144e7025 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31d53157-952c-44bf-8c5c-55d777880b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:42:01 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-85e8ca5a-2bc7-4f09-bb65-48a7144e7025 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72172652-0b05-4fe6-8a34-2169e3a420a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:42:01 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-85e8ca5a-2bc7-4f09-bb65-48a7144e7025 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72172652-0b05-4fe6-8a34-2169e3a420a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20059d47-dd80-4c12-81a4-7f5e32768aab', 'volume_name': 'volume-20059d47-dd80-4c12-81a4-7f5e32768aab', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:42:01 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-85e8ca5a-2bc7-4f09-bb65-48a7144e7025 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad7255fa-f5a5-4e94-8c2f-9d82ece9683b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:42:01 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-85e8ca5a-2bc7-4f09-bb65-48a7144e7025 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad7255fa-f5a5-4e94-8c2f-9d82ece9683b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:42:01 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-85e8ca5a-2bc7-4f09-bb65-48a7144e7025 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (125087af-feb2-40e3-980b-4cd9c932f22a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:42:01 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-85e8ca5a-2bc7-4f09-bb65-48a7144e7025 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Volume 20059d47-dd80-4c12-81a4-7f5e32768aab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20059d47-dd80-4c12-81a4-7f5e32768aab', 'volume_size': 1} Apr 29 15:42:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-85e8ca5a-2bc7-4f09-bb65-48a7144e7025 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:42:01 devstack sudo[112112]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-5ed88826-413a-4365-a35b-4414e4359004 tempest-VolumeDependencyTests-347675874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-977f6a7a-1f28-4b8d-81c5-5105a37a54ae" returned: 0 in 0.745s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:01 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-5ed88826-413a-4365-a35b-4414e4359004 tempest-VolumeDependencyTests-347675874 None] <== create_volume: return (2070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:42:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-5ed88826-413a-4365-a35b-4414e4359004 tempest-VolumeDependencyTests-347675874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.073s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:42:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-85e8ca5a-2bc7-4f09-bb65-48a7144e7025 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.183s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:42:01 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-85e8ca5a-2bc7-4f09-bb65-48a7144e7025 tempest-CreateVolumesFromSnapshotTest-1193587883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:42:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-512608008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20059d47-dd80-4c12-81a4-7f5e32768aab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc69cec5ae4a486083f88dfbeb5e2570',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:42:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:42:01Z,use_quota=True,user_id='cc0c3f24d7bc4f68b863ce492f25e005',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:42:01 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-85e8ca5a-2bc7-4f09-bb65-48a7144e7025 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Creating volume 20059d47-dd80-4c12-81a4-7f5e32768aab {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:42:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-85e8ca5a-2bc7-4f09-bb65-48a7144e7025 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:42:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-85e8ca5a-2bc7-4f09-bb65-48a7144e7025 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:42:01 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-85e8ca5a-2bc7-4f09-bb65-48a7144e7025 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:42:01 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-85e8ca5a-2bc7-4f09-bb65-48a7144e7025 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:42:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-85e8ca5a-2bc7-4f09-bb65-48a7144e7025 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:42:01 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-85e8ca5a-2bc7-4f09-bb65-48a7144e7025 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:42:01 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-85e8ca5a-2bc7-4f09-bb65-48a7144e7025 tempest-CreateVolumesFromSnapshotTest-1193587883 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:42:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-85e8ca5a-2bc7-4f09-bb65-48a7144e7025 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-20059d47-dd80-4c12-81a4-7f5e32768aab 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:01 devstack sudo[112117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-20059d47-dd80-4c12-81a4-7f5e32768aab 1073741824 Apr 29 15:42:01 devstack sudo[112117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:01 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-5ed88826-413a-4365-a35b-4414e4359004 tempest-VolumeDependencyTests-347675874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea545515-ff97-49e6-88d3-3168e2c248b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-977f6a7a-1f28-4b8d-81c5-5105a37a54ae', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:42:01 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-5ed88826-413a-4365-a35b-4414e4359004 tempest-VolumeDependencyTests-347675874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df382885-8bbe-4e56-8727-c9a92d9f6dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:42:01 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-5ed88826-413a-4365-a35b-4414e4359004 tempest-VolumeDependencyTests-347675874 None] Volume volume-977f6a7a-1f28-4b8d-81c5-5105a37a54ae (977f6a7a-1f28-4b8d-81c5-5105a37a54ae): created successfully Apr 29 15:42:01 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-5ed88826-413a-4365-a35b-4414e4359004 tempest-VolumeDependencyTests-347675874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df382885-8bbe-4e56-8727-c9a92d9f6dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:42:01 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-5ed88826-413a-4365-a35b-4414e4359004 tempest-VolumeDependencyTests-347675874 None] Flow 'volume_create_manager' (b2792329-ba9c-4d78-9af1-e9bf17955793) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:42:01 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-5ed88826-413a-4365-a35b-4414e4359004 tempest-VolumeDependencyTests-347675874 None] Created volume successfully. Apr 29 15:42:01 devstack sudo[112114]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cf187fad-6a61-42d8-b880-7884d840318d tempest-VolumeImageDependencyTests-1307160939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-45057860-8463-4b9f-ae3f-3cfe2243b7bb" returned: 1 in 0.894s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cf187fad-6a61-42d8-b880-7884d840318d tempest-VolumeImageDependencyTests-1307160939 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-45057860-8463-4b9f-ae3f-3cfe2243b7bb' failed. Not Retrying. {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 15:42:01 devstack cinder-volume[84448]: DEBUG cinder.volume.volume_utils [None req-cf187fad-6a61-42d8-b880-7884d840318d tempest-VolumeImageDependencyTests-1307160939 None] Downloaded image 0855b1ce-856e-46ea-9692-0087ae5f4836 ((None, [{'url': 'file:///opt/stack/data/glance/images/0855b1ce-856e-46ea-9692-0087ae5f4836', 'metadata': {}}])) to volume 45057860-8463-4b9f-ae3f-3cfe2243b7bb successfully. {{(pid=84448) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 29 15:42:01 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [None req-cf187fad-6a61-42d8-b880-7884d840318d tempest-VolumeImageDependencyTests-1307160939 None] Temporary image 0855b1ce-856e-46ea-9692-0087ae5f4836 for user 0a314754c97541eb9615314c752f7f00 is deleted. {{(pid=84448) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 29 15:42:01 devstack cinder-volume[84448]: DEBUG cinder.volume.volume_utils [None req-cf187fad-6a61-42d8-b880-7884d840318d tempest-VolumeImageDependencyTests-1307160939 None] Marking volume 45057860-8463-4b9f-ae3f-3cfe2243b7bb as bootable. {{(pid=84448) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 29 15:42:01 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf187fad-6a61-42d8-b880-7884d840318d tempest-VolumeImageDependencyTests-1307160939 None] Copying metadata from image 0855b1ce-856e-46ea-9692-0087ae5f4836 to 45057860-8463-4b9f-ae3f-3cfe2243b7bb. {{(pid=84448) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 29 15:42:01 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf187fad-6a61-42d8-b880-7884d840318d tempest-VolumeImageDependencyTests-1307160939 None] Creating volume glance metadata for volume 45057860-8463-4b9f-ae3f-3cfe2243b7bb backed by image 0855b1ce-856e-46ea-9692-0087ae5f4836 with: {'image_id': '0855b1ce-856e-46ea-9692-0087ae5f4836', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'ef645a9828b1e9caf2fe34208f2ea6e3', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=84448) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 29 15:42:01 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cf187fad-6a61-42d8-b880-7884d840318d tempest-VolumeImageDependencyTests-1307160939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b05d2245-cc10-4b2e-9f6b-0ce412ef6992) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45057860-8463-4b9f-ae3f-3cfe2243b7bb', 'volume_size': 1, 'image_id': '0855b1ce-856e-46ea-9692-0087ae5f4836', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0855b1ce-856e-46ea-9692-0087ae5f4836', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ef645a9828b1e9caf2fe34208f2ea6e3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a29748d81f464672b5f2e2d080b6d086', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3ec3d1514a4d0281bf2bf01d3abfd1d2164a921d0b16800da7e2c22e65e70e9dd17860b0bda1515a1eabee9e7ce07dc4765dcd325cc8d5efa8a44a50152c000a', 'id': '0855b1ce-856e-46ea-9692-0087ae5f4836', 'created_at': datetime.datetime(2026, 4, 29, 13, 41, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 13, 41, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0855b1ce-856e-46ea-9692-0087ae5f4836/file', 'properties': {}}, 'image_service': }' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:42:01 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cf187fad-6a61-42d8-b880-7884d840318d tempest-VolumeImageDependencyTests-1307160939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6f680e7-073f-45d9-a240-a7b469b2ed8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:42:01 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-cf187fad-6a61-42d8-b880-7884d840318d tempest-VolumeImageDependencyTests-1307160939 None] Volume volume-45057860-8463-4b9f-ae3f-3cfe2243b7bb (45057860-8463-4b9f-ae3f-3cfe2243b7bb): created successfully Apr 29 15:42:01 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cf187fad-6a61-42d8-b880-7884d840318d tempest-VolumeImageDependencyTests-1307160939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6f680e7-073f-45d9-a240-a7b469b2ed8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:42:01 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-cf187fad-6a61-42d8-b880-7884d840318d tempest-VolumeImageDependencyTests-1307160939 None] Flow 'volume_create_manager' (67ac15a9-fab4-432c-88fc-b9fe71aa8023) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:42:01 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-cf187fad-6a61-42d8-b880-7884d840318d tempest-VolumeImageDependencyTests-1307160939 None] Created volume successfully. Apr 29 15:42:02 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-bede4c10-02fe-41bc-90f9-a52552852816 tempest-VolumeImageDependencyTests-1307160939 None] Acquiring lock "cinder-45057860-8463-4b9f-ae3f-3cfe2243b7bb-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:42:02 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-bede4c10-02fe-41bc-90f9-a52552852816 tempest-VolumeImageDependencyTests-1307160939 None] Lock "cinder-45057860-8463-4b9f-ae3f-3cfe2243b7bb-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:42:02 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-bede4c10-02fe-41bc-90f9-a52552852816 tempest-VolumeImageDependencyTests-1307160939 None] Acquiring lock "cinder-quobyte-45057860-8463-4b9f-ae3f-3cfe2243b7bb" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:42:02 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-bede4c10-02fe-41bc-90f9-a52552852816 tempest-VolumeImageDependencyTests-1307160939 None] Lock "cinder-quobyte-45057860-8463-4b9f-ae3f-3cfe2243b7bb" acquired by "delete_volume" :: waited 0.020s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:42:02 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[6221a561-9a70-4103-97e2-97d446aec2d4]: (4, 'raw') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:42:02 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-bede4c10-02fe-41bc-90f9-a52552852816 tempest-VolumeImageDependencyTests-1307160939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-45057860-8463-4b9f-ae3f-3cfe2243b7bb {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:02 devstack sudo[112125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-45057860-8463-4b9f-ae3f-3cfe2243b7bb Apr 29 15:42:02 devstack sudo[112125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:02 devstack sudo[112117]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:02 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-85e8ca5a-2bc7-4f09-bb65-48a7144e7025 tempest-CreateVolumesFromSnapshotTest-1193587883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-20059d47-dd80-4c12-81a4-7f5e32768aab 1073741824" returned: 0 in 1.106s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:02 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-85e8ca5a-2bc7-4f09-bb65-48a7144e7025 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-20059d47-dd80-4c12-81a4-7f5e32768aab {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:02 devstack sudo[112128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-20059d47-dd80-4c12-81a4-7f5e32768aab Apr 29 15:42:02 devstack sudo[112128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:03 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-16ec6e6e-2c8b-4ca8-a535-f8f7e21f3289 tempest-VolumeDependencyTests-347675874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:42:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-16ec6e6e-2c8b-4ca8-a535-f8f7e21f3289 tempest-VolumeDependencyTests-347675874 None] Flow 'volume_create_manager' (1bc35d1a-87e7-4cef-8661-1ae020697a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:42:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-16ec6e6e-2c8b-4ca8-a535-f8f7e21f3289 tempest-VolumeDependencyTests-347675874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (799b3405-2200-4fdc-95b5-dbff82ec4c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:42:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-16ec6e6e-2c8b-4ca8-a535-f8f7e21f3289 tempest-VolumeDependencyTests-347675874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (799b3405-2200-4fdc-95b5-dbff82ec4c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:42:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-116411788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fda57970-6ec3-47f5-9bda-f66cb6db29b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aeb81c62ac284048b36f567290e59d0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:42:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=977f6a7a-1f28-4b8d-81c5-5105a37a54ae,status='creating',terminated_at=None,updated_at=2026-04-29T13:42:03Z,use_quota=True,user_id='5f2f077a45ee40b48b1d0833faeef45f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:42:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-16ec6e6e-2c8b-4ca8-a535-f8f7e21f3289 tempest-VolumeDependencyTests-347675874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c1c981f-dbbf-47ae-af0d-e56cf270e89d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:42:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-16ec6e6e-2c8b-4ca8-a535-f8f7e21f3289 tempest-VolumeDependencyTests-347675874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c1c981f-dbbf-47ae-af0d-e56cf270e89d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:42:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-16ec6e6e-2c8b-4ca8-a535-f8f7e21f3289 tempest-VolumeDependencyTests-347675874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59f0c908-f1e9-4480-aefc-315e47888752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:42:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-16ec6e6e-2c8b-4ca8-a535-f8f7e21f3289 tempest-VolumeDependencyTests-347675874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59f0c908-f1e9-4480-aefc-315e47888752) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'fda57970-6ec3-47f5-9bda-f66cb6db29b3', 'volume_name': 'volume-fda57970-6ec3-47f5-9bda-f66cb6db29b3', 'volume_size': 1, 'source_volid': '977f6a7a-1f28-4b8d-81c5-5105a37a54ae', 'source_volstatus': 'available'}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:42:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-16ec6e6e-2c8b-4ca8-a535-f8f7e21f3289 tempest-VolumeDependencyTests-347675874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (111bcc1e-2a50-469a-a80e-fc57923cc7c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:42:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-16ec6e6e-2c8b-4ca8-a535-f8f7e21f3289 tempest-VolumeDependencyTests-347675874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (111bcc1e-2a50-469a-a80e-fc57923cc7c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:42:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-16ec6e6e-2c8b-4ca8-a535-f8f7e21f3289 tempest-VolumeDependencyTests-347675874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9de9328a-dd05-4dc4-8bfe-86dab53f6362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:42:03 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-16ec6e6e-2c8b-4ca8-a535-f8f7e21f3289 tempest-VolumeDependencyTests-347675874 None] Volume fda57970-6ec3-47f5-9bda-f66cb6db29b3: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-fda57970-6ec3-47f5-9bda-f66cb6db29b3', 'volume_size': 1, 'source_volid': '977f6a7a-1f28-4b8d-81c5-5105a37a54ae', 'source_volstatus': 'available'} Apr 29 15:42:03 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-16ec6e6e-2c8b-4ca8-a535-f8f7e21f3289 tempest-VolumeDependencyTests-347675874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:42:03 devstack sudo[112125]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:03 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-bede4c10-02fe-41bc-90f9-a52552852816 tempest-VolumeImageDependencyTests-1307160939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-45057860-8463-4b9f-ae3f-3cfe2243b7bb" returned: 0 in 0.939s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:03 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-bede4c10-02fe-41bc-90f9-a52552852816 tempest-VolumeImageDependencyTests-1307160939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-45057860-8463-4b9f-ae3f-3cfe2243b7bb {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:03 devstack sudo[112132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-45057860-8463-4b9f-ae3f-3cfe2243b7bb Apr 29 15:42:03 devstack sudo[112132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:03 devstack sudo[112128]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:03 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-85e8ca5a-2bc7-4f09-bb65-48a7144e7025 tempest-CreateVolumesFromSnapshotTest-1193587883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-20059d47-dd80-4c12-81a4-7f5e32768aab" returned: 0 in 0.995s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:03 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-85e8ca5a-2bc7-4f09-bb65-48a7144e7025 tempest-CreateVolumesFromSnapshotTest-1193587883 None] <== create_volume: return (2160ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:42:03 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-85e8ca5a-2bc7-4f09-bb65-48a7144e7025 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.164s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:42:03 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-16ec6e6e-2c8b-4ca8-a535-f8f7e21f3289 tempest-VolumeDependencyTests-347675874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.352s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:42:03 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-16ec6e6e-2c8b-4ca8-a535-f8f7e21f3289 tempest-VolumeDependencyTests-347675874 None] Cloning volume 977f6a7a-1f28-4b8d-81c5-5105a37a54ae to volume fda57970-6ec3-47f5-9bda-f66cb6db29b3 Apr 29 15:42:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-85e8ca5a-2bc7-4f09-bb65-48a7144e7025 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (125087af-feb2-40e3-980b-4cd9c932f22a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20059d47-dd80-4c12-81a4-7f5e32768aab', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:42:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-85e8ca5a-2bc7-4f09-bb65-48a7144e7025 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c3939ba-704b-456b-9550-bee9729f812f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:42:03 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-85e8ca5a-2bc7-4f09-bb65-48a7144e7025 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Volume volume-20059d47-dd80-4c12-81a4-7f5e32768aab (20059d47-dd80-4c12-81a4-7f5e32768aab): created successfully Apr 29 15:42:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-85e8ca5a-2bc7-4f09-bb65-48a7144e7025 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c3939ba-704b-456b-9550-bee9729f812f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:42:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-85e8ca5a-2bc7-4f09-bb65-48a7144e7025 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Flow 'volume_create_manager' (f86c3988-f334-44cb-9f48-6655cc6f5a6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:42:03 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-16ec6e6e-2c8b-4ca8-a535-f8f7e21f3289 tempest-VolumeDependencyTests-347675874 None] Creating offline snapshot e6aa8b57-09bf-4e40-af93-148052b5c672 of volume 977f6a7a-1f28-4b8d-81c5-5105a37a54ae {{(pid=84448) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 15:42:03 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-85e8ca5a-2bc7-4f09-bb65-48a7144e7025 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Created volume successfully. Apr 29 15:42:03 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea3096d-953d-44fc-82ec-9394419a04e7]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:42:03 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-16ec6e6e-2c8b-4ca8-a535-f8f7e21f3289 tempest-VolumeDependencyTests-347675874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-977f6a7a-1f28-4b8d-81c5-5105a37a54ae {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:03 devstack sudo[112135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-977f6a7a-1f28-4b8d-81c5-5105a37a54ae Apr 29 15:42:03 devstack sudo[112135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:04 devstack sudo[112132]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:04 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-bede4c10-02fe-41bc-90f9-a52552852816 tempest-VolumeImageDependencyTests-1307160939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-45057860-8463-4b9f-ae3f-3cfe2243b7bb" returned: 1 in 0.962s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:04 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-bede4c10-02fe-41bc-90f9-a52552852816 tempest-VolumeImageDependencyTests-1307160939 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-45057860-8463-4b9f-ae3f-3cfe2243b7bb' failed. Not Retrying. {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 15:42:04 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-bede4c10-02fe-41bc-90f9-a52552852816 tempest-VolumeImageDependencyTests-1307160939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-45057860-8463-4b9f-ae3f-3cfe2243b7bb {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:04 devstack sudo[112140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-45057860-8463-4b9f-ae3f-3cfe2243b7bb Apr 29 15:42:04 devstack sudo[112140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:04 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-ed47736f-28cc-4b2d-a1a6-f7fb3c9fde83 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:42:04 devstack sudo[112135]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:04 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-16ec6e6e-2c8b-4ca8-a535-f8f7e21f3289 tempest-VolumeDependencyTests-347675874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-977f6a7a-1f28-4b8d-81c5-5105a37a54ae" returned: 0 in 1.084s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:04 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-16ec6e6e-2c8b-4ca8-a535-f8f7e21f3289 tempest-VolumeDependencyTests-347675874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-977f6a7a-1f28-4b8d-81c5-5105a37a54ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-977f6a7a-1f28-4b8d-81c5-5105a37a54ae.e6aa8b57-09bf-4e40-af93-148052b5c672 1G {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:04 devstack sudo[112145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-977f6a7a-1f28-4b8d-81c5-5105a37a54ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-977f6a7a-1f28-4b8d-81c5-5105a37a54ae.e6aa8b57-09bf-4e40-af93-148052b5c672 1G Apr 29 15:42:04 devstack sudo[112145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:05 devstack sudo[112140]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:05 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-bede4c10-02fe-41bc-90f9-a52552852816 tempest-VolumeImageDependencyTests-1307160939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-45057860-8463-4b9f-ae3f-3cfe2243b7bb" returned: 0 in 0.945s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:05 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-bede4c10-02fe-41bc-90f9-a52552852816 tempest-VolumeImageDependencyTests-1307160939 None] Lock "cinder-quobyte-45057860-8463-4b9f-ae3f-3cfe2243b7bb" released by "delete_volume" :: held 2.935s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:42:05 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-bede4c10-02fe-41bc-90f9-a52552852816 tempest-VolumeImageDependencyTests-1307160939 None] Created reservations ['b510e1e5-ef75-41f2-9e50-30c2124a952e', 'a5d56657-4197-4468-b5a1-d623163c63ba', '129b93c7-3aa3-4622-92b2-3b2f5a696822', '59f7b80a-05a5-4205-ab9f-c28246c1c6f1'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:42:05 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-bede4c10-02fe-41bc-90f9-a52552852816 tempest-VolumeImageDependencyTests-1307160939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:42:05 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-bede4c10-02fe-41bc-90f9-a52552852816 tempest-VolumeImageDependencyTests-1307160939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:42:05 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-bede4c10-02fe-41bc-90f9-a52552852816 tempest-VolumeImageDependencyTests-1307160939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:42:05 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-bede4c10-02fe-41bc-90f9-a52552852816 tempest-VolumeImageDependencyTests-1307160939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:42:05 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-bede4c10-02fe-41bc-90f9-a52552852816 tempest-VolumeImageDependencyTests-1307160939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:42:05 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-bede4c10-02fe-41bc-90f9-a52552852816 tempest-VolumeImageDependencyTests-1307160939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:05 devstack sudo[112148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:42:05 devstack sudo[112148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:05 devstack sudo[112145]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:05 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-16ec6e6e-2c8b-4ca8-a535-f8f7e21f3289 tempest-VolumeDependencyTests-347675874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-977f6a7a-1f28-4b8d-81c5-5105a37a54ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-977f6a7a-1f28-4b8d-81c5-5105a37a54ae.e6aa8b57-09bf-4e40-af93-148052b5c672 1G" returned: 0 in 1.056s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:05 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-16ec6e6e-2c8b-4ca8-a535-f8f7e21f3289 tempest-VolumeDependencyTests-347675874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-977f6a7a-1f28-4b8d-81c5-5105a37a54ae -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-977f6a7a-1f28-4b8d-81c5-5105a37a54ae.e6aa8b57-09bf-4e40-af93-148052b5c672 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:06 devstack sudo[112153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-977f6a7a-1f28-4b8d-81c5-5105a37a54ae -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-977f6a7a-1f28-4b8d-81c5-5105a37a54ae.e6aa8b57-09bf-4e40-af93-148052b5c672 Apr 29 15:42:06 devstack sudo[112153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:06 devstack sudo[112148]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:06 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-bede4c10-02fe-41bc-90f9-a52552852816 tempest-VolumeImageDependencyTests-1307160939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.814s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:06 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-bede4c10-02fe-41bc-90f9-a52552852816 tempest-VolumeImageDependencyTests-1307160939 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:42:06 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-bede4c10-02fe-41bc-90f9-a52552852816 tempest-VolumeImageDependencyTests-1307160939 None] Deleted volume successfully. Apr 29 15:42:06 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-bede4c10-02fe-41bc-90f9-a52552852816 tempest-VolumeImageDependencyTests-1307160939 None] Lock "cinder-45057860-8463-4b9f-ae3f-3cfe2243b7bb-delete_volume" released by "delete_volume" :: held 4.020s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:42:07 devstack sudo[112153]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:07 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-16ec6e6e-2c8b-4ca8-a535-f8f7e21f3289 tempest-VolumeDependencyTests-347675874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-977f6a7a-1f28-4b8d-81c5-5105a37a54ae -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-977f6a7a-1f28-4b8d-81c5-5105a37a54ae.e6aa8b57-09bf-4e40-af93-148052b5c672" returned: 0 in 1.102s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:07 devstack cinder-volume[84448]: WARNING cinder.volume.drivers.remotefs [None req-16ec6e6e-2c8b-4ca8-a535-f8f7e21f3289 tempest-VolumeDependencyTests-347675874 None] /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-977f6a7a-1f28-4b8d-81c5-5105a37a54ae.e6aa8b57-09bf-4e40-af93-148052b5c672 is being set with open permissions: ugo+rw Apr 29 15:42:07 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-16ec6e6e-2c8b-4ca8-a535-f8f7e21f3289 tempest-VolumeDependencyTests-347675874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-977f6a7a-1f28-4b8d-81c5-5105a37a54ae.e6aa8b57-09bf-4e40-af93-148052b5c672 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:07 devstack sudo[112160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-977f6a7a-1f28-4b8d-81c5-5105a37a54ae.e6aa8b57-09bf-4e40-af93-148052b5c672 Apr 29 15:42:07 devstack sudo[112160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:07 devstack sudo[112160]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:07 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-16ec6e6e-2c8b-4ca8-a535-f8f7e21f3289 tempest-VolumeDependencyTests-347675874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-977f6a7a-1f28-4b8d-81c5-5105a37a54ae.e6aa8b57-09bf-4e40-af93-148052b5c672" returned: 0 in 0.704s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:07 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-16ec6e6e-2c8b-4ca8-a535-f8f7e21f3289 tempest-VolumeDependencyTests-347675874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-977f6a7a-1f28-4b8d-81c5-5105a37a54ae.info {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:07 devstack sudo[112163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-977f6a7a-1f28-4b8d-81c5-5105a37a54ae.info Apr 29 15:42:07 devstack sudo[112163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:08 devstack sudo[112163]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:08 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-16ec6e6e-2c8b-4ca8-a535-f8f7e21f3289 tempest-VolumeDependencyTests-347675874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-977f6a7a-1f28-4b8d-81c5-5105a37a54ae.info" returned: 0 in 0.743s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:08 devstack cinder-volume[84448]: WARNING cinder.volume.drivers.remotefs [None req-16ec6e6e-2c8b-4ca8-a535-f8f7e21f3289 tempest-VolumeDependencyTests-347675874 None] /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-977f6a7a-1f28-4b8d-81c5-5105a37a54ae.info is being set with open permissions: ugo+rw Apr 29 15:42:08 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-16ec6e6e-2c8b-4ca8-a535-f8f7e21f3289 tempest-VolumeDependencyTests-347675874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-977f6a7a-1f28-4b8d-81c5-5105a37a54ae.info {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:08 devstack sudo[112166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-977f6a7a-1f28-4b8d-81c5-5105a37a54ae.info Apr 29 15:42:08 devstack sudo[112166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:09 devstack sudo[112166]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:09 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-16ec6e6e-2c8b-4ca8-a535-f8f7e21f3289 tempest-VolumeDependencyTests-347675874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-977f6a7a-1f28-4b8d-81c5-5105a37a54ae.info" returned: 0 in 0.635s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:09 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-16ec6e6e-2c8b-4ca8-a535-f8f7e21f3289 tempest-VolumeDependencyTests-347675874 None] Acquiring lock "cinder-quobyte-fda57970-6ec3-47f5-9bda-f66cb6db29b3" by "_copy_volume_from_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:42:09 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-16ec6e6e-2c8b-4ca8-a535-f8f7e21f3289 tempest-VolumeDependencyTests-347675874 None] Lock "cinder-quobyte-fda57970-6ec3-47f5-9bda-f66cb6db29b3" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:42:09 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-16ec6e6e-2c8b-4ca8-a535-f8f7e21f3289 tempest-VolumeDependencyTests-347675874 None] snapshot: e6aa8b57-09bf-4e40-af93-148052b5c672, volume: fda57970-6ec3-47f5-9bda-f66cb6db29b3, {{(pid=84448) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 15:42:09 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-16ec6e6e-2c8b-4ca8-a535-f8f7e21f3289 tempest-VolumeDependencyTests-347675874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:42:09 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-16ec6e6e-2c8b-4ca8-a535-f8f7e21f3289 tempest-VolumeDependencyTests-347675874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:42:09 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-16ec6e6e-2c8b-4ca8-a535-f8f7e21f3289 tempest-VolumeDependencyTests-347675874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:42:09 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-16ec6e6e-2c8b-4ca8-a535-f8f7e21f3289 tempest-VolumeDependencyTests-347675874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:42:09 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-16ec6e6e-2c8b-4ca8-a535-f8f7e21f3289 tempest-VolumeDependencyTests-347675874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:42:09 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[942e3945-0c5a-4660-9d44-0ca3604f065e]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:42:09 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-16ec6e6e-2c8b-4ca8-a535-f8f7e21f3289 tempest-VolumeDependencyTests-347675874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-977f6a7a-1f28-4b8d-81c5-5105a37a54ae.e6aa8b57-09bf-4e40-af93-148052b5c672 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:09 devstack sudo[112169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-977f6a7a-1f28-4b8d-81c5-5105a37a54ae.e6aa8b57-09bf-4e40-af93-148052b5c672 Apr 29 15:42:09 devstack sudo[112169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:10 devstack sudo[112169]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:10 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-16ec6e6e-2c8b-4ca8-a535-f8f7e21f3289 tempest-VolumeDependencyTests-347675874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-977f6a7a-1f28-4b8d-81c5-5105a37a54ae.e6aa8b57-09bf-4e40-af93-148052b5c672" returned: 0 in 0.740s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:10 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-16ec6e6e-2c8b-4ca8-a535-f8f7e21f3289 tempest-VolumeDependencyTests-347675874 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-977f6a7a-1f28-4b8d-81c5-5105a37a54ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84448) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 15:42:10 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-16ec6e6e-2c8b-4ca8-a535-f8f7e21f3289 tempest-VolumeDependencyTests-347675874 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-977f6a7a-1f28-4b8d-81c5-5105a37a54ae {{(pid=84448) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 15:42:10 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-16ec6e6e-2c8b-4ca8-a535-f8f7e21f3289 tempest-VolumeDependencyTests-347675874 None] Creating direct copy from snapshot {{(pid=84448) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 15:42:10 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d9a7f0-462f-4810-ab76-3e42b7e09320]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:42:10 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-16ec6e6e-2c8b-4ca8-a535-f8f7e21f3289 tempest-VolumeDependencyTests-347675874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-977f6a7a-1f28-4b8d-81c5-5105a37a54ae {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:10 devstack sudo[112174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-977f6a7a-1f28-4b8d-81c5-5105a37a54ae Apr 29 15:42:10 devstack sudo[112174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:10 devstack sudo[112174]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:10 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-16ec6e6e-2c8b-4ca8-a535-f8f7e21f3289 tempest-VolumeDependencyTests-347675874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-977f6a7a-1f28-4b8d-81c5-5105a37a54ae" returned: 0 in 0.791s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:10 devstack cinder-volume[84448]: DEBUG cinder.utils [None req-16ec6e6e-2c8b-4ca8-a535-f8f7e21f3289 tempest-VolumeDependencyTests-347675874 None] Path /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-fda57970-6ec3-47f5-9bda-f66cb6db29b3 not found in is_blk_device check {{(pid=84448) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 15:42:10 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-16ec6e6e-2c8b-4ca8-a535-f8f7e21f3289 tempest-VolumeDependencyTests-347675874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-977f6a7a-1f28-4b8d-81c5-5105a37a54ae /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-fda57970-6ec3-47f5-9bda-f66cb6db29b3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:10 devstack sudo[112180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-977f6a7a-1f28-4b8d-81c5-5105a37a54ae /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-fda57970-6ec3-47f5-9bda-f66cb6db29b3 Apr 29 15:42:10 devstack sudo[112180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:16 devstack sudo[112180]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:16 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-16ec6e6e-2c8b-4ca8-a535-f8f7e21f3289 tempest-VolumeDependencyTests-347675874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-977f6a7a-1f28-4b8d-81c5-5105a37a54ae /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-fda57970-6ec3-47f5-9bda-f66cb6db29b3" returned: 0 in 5.508s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:16 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f58be3f-9073-4819-bf71-3b33caceabc8]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:42:16 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-16ec6e6e-2c8b-4ca8-a535-f8f7e21f3289 tempest-VolumeDependencyTests-347675874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-977f6a7a-1f28-4b8d-81c5-5105a37a54ae {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:16 devstack sudo[112194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-977f6a7a-1f28-4b8d-81c5-5105a37a54ae Apr 29 15:42:16 devstack sudo[112194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:17 devstack sudo[112194]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:17 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-16ec6e6e-2c8b-4ca8-a535-f8f7e21f3289 tempest-VolumeDependencyTests-347675874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-977f6a7a-1f28-4b8d-81c5-5105a37a54ae" returned: 0 in 0.932s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:17 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [None req-16ec6e6e-2c8b-4ca8-a535-f8f7e21f3289 tempest-VolumeDependencyTests-347675874 None] Image conversion details: src /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-977f6a7a-1f28-4b8d-81c5-5105a37a54ae, size 1024.00 MB, duration 5.51 sec, destination /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-fda57970-6ec3-47f5-9bda-f66cb6db29b3 {{(pid=84448) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 15:42:17 devstack cinder-volume[84448]: INFO cinder.image.image_utils [None req-16ec6e6e-2c8b-4ca8-a535-f8f7e21f3289 tempest-VolumeDependencyTests-347675874 None] Converted 1024.00 MB image at 185.86 MB/s Apr 29 15:42:17 devstack cinder-volume[84448]: WARNING cinder.volume.drivers.remotefs [None req-16ec6e6e-2c8b-4ca8-a535-f8f7e21f3289 tempest-VolumeDependencyTests-347675874 None] /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-fda57970-6ec3-47f5-9bda-f66cb6db29b3 is being set with open permissions: ugo+rw Apr 29 15:42:17 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-16ec6e6e-2c8b-4ca8-a535-f8f7e21f3289 tempest-VolumeDependencyTests-347675874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-fda57970-6ec3-47f5-9bda-f66cb6db29b3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:17 devstack sudo[112199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-fda57970-6ec3-47f5-9bda-f66cb6db29b3 Apr 29 15:42:17 devstack sudo[112199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:17 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:SELECT=130,cinder:UPDATE=155,cinder:DELETE=20,cinder:INSERT=48 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:42:17 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:UPDATE=193,cinder:SELECT=130,cinder:INSERT=50,cinder:DELETE=12 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:42:17 devstack sudo[112199]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:17 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-16ec6e6e-2c8b-4ca8-a535-f8f7e21f3289 tempest-VolumeDependencyTests-347675874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-fda57970-6ec3-47f5-9bda-f66cb6db29b3" returned: 0 in 0.656s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:17 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-16ec6e6e-2c8b-4ca8-a535-f8f7e21f3289 tempest-VolumeDependencyTests-347675874 None] Lock "cinder-quobyte-fda57970-6ec3-47f5-9bda-f66cb6db29b3" released by "_copy_volume_from_snapshot" :: held 8.743s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:42:17 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-16ec6e6e-2c8b-4ca8-a535-f8f7e21f3289 tempest-VolumeDependencyTests-347675874 None] Acquiring lock "cinder-quobyte-e6aa8b57-09bf-4e40-af93-148052b5c672" by "_delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:42:18 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-16ec6e6e-2c8b-4ca8-a535-f8f7e21f3289 tempest-VolumeDependencyTests-347675874 None] Lock "cinder-quobyte-e6aa8b57-09bf-4e40-af93-148052b5c672" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:42:18 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-16ec6e6e-2c8b-4ca8-a535-f8f7e21f3289 tempest-VolumeDependencyTests-347675874 None] Deleting offline snapshot e6aa8b57-09bf-4e40-af93-148052b5c672 of volume 977f6a7a-1f28-4b8d-81c5-5105a37a54ae {{(pid=84448) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 15:42:18 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-16ec6e6e-2c8b-4ca8-a535-f8f7e21f3289 tempest-VolumeDependencyTests-347675874 None] snapshot_file for this snap is: volume-977f6a7a-1f28-4b8d-81c5-5105a37a54ae.e6aa8b57-09bf-4e40-af93-148052b5c672 {{(pid=84448) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 15:42:18 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef3fc1f-0df7-4ef3-ad8e-a20be8d7f621]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:42:18 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-16ec6e6e-2c8b-4ca8-a535-f8f7e21f3289 tempest-VolumeDependencyTests-347675874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-977f6a7a-1f28-4b8d-81c5-5105a37a54ae.e6aa8b57-09bf-4e40-af93-148052b5c672 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:18 devstack sudo[112202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-977f6a7a-1f28-4b8d-81c5-5105a37a54ae.e6aa8b57-09bf-4e40-af93-148052b5c672 Apr 29 15:42:18 devstack sudo[112202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:18 devstack sudo[112202]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:18 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-16ec6e6e-2c8b-4ca8-a535-f8f7e21f3289 tempest-VolumeDependencyTests-347675874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-977f6a7a-1f28-4b8d-81c5-5105a37a54ae.e6aa8b57-09bf-4e40-af93-148052b5c672" returned: 0 in 0.715s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:18 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-16ec6e6e-2c8b-4ca8-a535-f8f7e21f3289 tempest-VolumeDependencyTests-347675874 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-977f6a7a-1f28-4b8d-81c5-5105a37a54ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84448) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 15:42:18 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4d0f4a-97df-41f9-a65b-a525e0424d6c]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:42:18 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-16ec6e6e-2c8b-4ca8-a535-f8f7e21f3289 tempest-VolumeDependencyTests-347675874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-977f6a7a-1f28-4b8d-81c5-5105a37a54ae {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:18 devstack sudo[112207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-977f6a7a-1f28-4b8d-81c5-5105a37a54ae Apr 29 15:42:18 devstack sudo[112207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:19 devstack sudo[112207]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:19 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-16ec6e6e-2c8b-4ca8-a535-f8f7e21f3289 tempest-VolumeDependencyTests-347675874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-977f6a7a-1f28-4b8d-81c5-5105a37a54ae" returned: 0 in 0.727s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:19 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-16ec6e6e-2c8b-4ca8-a535-f8f7e21f3289 tempest-VolumeDependencyTests-347675874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-977f6a7a-1f28-4b8d-81c5-5105a37a54ae.e6aa8b57-09bf-4e40-af93-148052b5c672 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:19 devstack sudo[112212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-977f6a7a-1f28-4b8d-81c5-5105a37a54ae.e6aa8b57-09bf-4e40-af93-148052b5c672 Apr 29 15:42:19 devstack sudo[112212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:20 devstack sudo[112212]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:20 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-16ec6e6e-2c8b-4ca8-a535-f8f7e21f3289 tempest-VolumeDependencyTests-347675874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-977f6a7a-1f28-4b8d-81c5-5105a37a54ae.e6aa8b57-09bf-4e40-af93-148052b5c672" returned: 0 in 0.882s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:20 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-16ec6e6e-2c8b-4ca8-a535-f8f7e21f3289 tempest-VolumeDependencyTests-347675874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-977f6a7a-1f28-4b8d-81c5-5105a37a54ae.e6aa8b57-09bf-4e40-af93-148052b5c672 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:20 devstack sudo[112218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-977f6a7a-1f28-4b8d-81c5-5105a37a54ae.e6aa8b57-09bf-4e40-af93-148052b5c672 Apr 29 15:42:20 devstack sudo[112218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:21 devstack sudo[112218]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:21 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-16ec6e6e-2c8b-4ca8-a535-f8f7e21f3289 tempest-VolumeDependencyTests-347675874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-977f6a7a-1f28-4b8d-81c5-5105a37a54ae.e6aa8b57-09bf-4e40-af93-148052b5c672" returned: 0 in 0.608s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:21 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-16ec6e6e-2c8b-4ca8-a535-f8f7e21f3289 tempest-VolumeDependencyTests-347675874 None] Lock "cinder-quobyte-e6aa8b57-09bf-4e40-af93-148052b5c672" released by "_delete_snapshot" :: held 3.047s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:42:21 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-16ec6e6e-2c8b-4ca8-a535-f8f7e21f3289 tempest-VolumeDependencyTests-347675874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.370s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:42:21 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-ed47736f-28cc-4b2d-a1a6-f7fb3c9fde83 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 16.230s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:42:21 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-16ec6e6e-2c8b-4ca8-a535-f8f7e21f3289 tempest-VolumeDependencyTests-347675874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9de9328a-dd05-4dc4-8bfe-86dab53f6362) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fda57970-6ec3-47f5-9bda-f66cb6db29b3', 'volume_size': 1, 'source_volid': '977f6a7a-1f28-4b8d-81c5-5105a37a54ae', 'source_volstatus': 'available'}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:42:21 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-16ec6e6e-2c8b-4ca8-a535-f8f7e21f3289 tempest-VolumeDependencyTests-347675874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89c07862-34f8-4b06-91bb-5a0e3f006dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:42:21 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-ed47736f-28cc-4b2d-a1a6-f7fb3c9fde83 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Creating offline snapshot 133b1327-05fc-43c7-872e-ead2a51ff800 of volume 20059d47-dd80-4c12-81a4-7f5e32768aab {{(pid=84448) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 15:42:21 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-16ec6e6e-2c8b-4ca8-a535-f8f7e21f3289 tempest-VolumeDependencyTests-347675874 None] Volume volume-fda57970-6ec3-47f5-9bda-f66cb6db29b3 (fda57970-6ec3-47f5-9bda-f66cb6db29b3): created successfully Apr 29 15:42:21 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-16ec6e6e-2c8b-4ca8-a535-f8f7e21f3289 tempest-VolumeDependencyTests-347675874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89c07862-34f8-4b06-91bb-5a0e3f006dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:42:21 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-16ec6e6e-2c8b-4ca8-a535-f8f7e21f3289 tempest-VolumeDependencyTests-347675874 None] Flow 'volume_create_manager' (1bc35d1a-87e7-4cef-8661-1ae020697a50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:42:21 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff9daffb-faa3-49b6-a05d-b4c8decec051]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:42:21 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ed47736f-28cc-4b2d-a1a6-f7fb3c9fde83 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-20059d47-dd80-4c12-81a4-7f5e32768aab {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:21 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-16ec6e6e-2c8b-4ca8-a535-f8f7e21f3289 tempest-VolumeDependencyTests-347675874 None] Created volume successfully. Apr 29 15:42:21 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-a48e0459-c79d-4c5a-abf7-aa600cce4e41 tempest-SnapshotDependencyTests-156111334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:42:21 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-a48e0459-c79d-4c5a-abf7-aa600cce4e41 tempest-SnapshotDependencyTests-156111334 None] Flow 'volume_create_manager' (d4249faf-3296-4313-933f-4a7cdf4ca433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:42:21 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-a48e0459-c79d-4c5a-abf7-aa600cce4e41 tempest-SnapshotDependencyTests-156111334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b6cc494-84f3-4c63-b691-04a845543f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:42:21 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-a48e0459-c79d-4c5a-abf7-aa600cce4e41 tempest-SnapshotDependencyTests-156111334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b6cc494-84f3-4c63-b691-04a845543f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:42:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-105763570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=813cc986-df45-4888-b394-bb22af18e7ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='735577aa5d86470db119030b97fb68d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:42:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:42:21Z,use_quota=True,user_id='426714a7ceb141e1852cb9c7651c0511',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:42:21 devstack sudo[112221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-20059d47-dd80-4c12-81a4-7f5e32768aab Apr 29 15:42:21 devstack sudo[112221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:21 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-a48e0459-c79d-4c5a-abf7-aa600cce4e41 tempest-SnapshotDependencyTests-156111334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e137cf55-396b-4f7c-85ad-41e19d9ade88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:42:21 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-a48e0459-c79d-4c5a-abf7-aa600cce4e41 tempest-SnapshotDependencyTests-156111334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e137cf55-396b-4f7c-85ad-41e19d9ade88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:42:21 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-a48e0459-c79d-4c5a-abf7-aa600cce4e41 tempest-SnapshotDependencyTests-156111334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (581321dc-f88f-4850-8c38-0df705653a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:42:21 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-a48e0459-c79d-4c5a-abf7-aa600cce4e41 tempest-SnapshotDependencyTests-156111334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (581321dc-f88f-4850-8c38-0df705653a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '813cc986-df45-4888-b394-bb22af18e7ca', 'volume_name': 'volume-813cc986-df45-4888-b394-bb22af18e7ca', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:42:21 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-a48e0459-c79d-4c5a-abf7-aa600cce4e41 tempest-SnapshotDependencyTests-156111334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b060281-da28-41a2-bb19-ed8db5d35521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:42:21 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-a48e0459-c79d-4c5a-abf7-aa600cce4e41 tempest-SnapshotDependencyTests-156111334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b060281-da28-41a2-bb19-ed8db5d35521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:42:21 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-a48e0459-c79d-4c5a-abf7-aa600cce4e41 tempest-SnapshotDependencyTests-156111334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b15dfae-718c-4ae7-832e-1d8c013b444a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:42:21 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-a48e0459-c79d-4c5a-abf7-aa600cce4e41 tempest-SnapshotDependencyTests-156111334 None] Volume 813cc986-df45-4888-b394-bb22af18e7ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-813cc986-df45-4888-b394-bb22af18e7ca', 'volume_size': 1} Apr 29 15:42:21 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-a48e0459-c79d-4c5a-abf7-aa600cce4e41 tempest-SnapshotDependencyTests-156111334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:42:21 devstack sudo[112221]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:21 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ed47736f-28cc-4b2d-a1a6-f7fb3c9fde83 tempest-CreateVolumesFromSnapshotTest-1193587883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-20059d47-dd80-4c12-81a4-7f5e32768aab" returned: 0 in 0.734s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:21 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ed47736f-28cc-4b2d-a1a6-f7fb3c9fde83 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-20059d47-dd80-4c12-81a4-7f5e32768aab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-20059d47-dd80-4c12-81a4-7f5e32768aab.133b1327-05fc-43c7-872e-ead2a51ff800 1G {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:21 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-1047134e-d807-4325-8b11-bb20b0d21f11 tempest-VolumeDependencyTests-347675874 None] Acquiring lock "cinder-977f6a7a-1f28-4b8d-81c5-5105a37a54ae-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:42:21 devstack sudo[112226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-20059d47-dd80-4c12-81a4-7f5e32768aab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-20059d47-dd80-4c12-81a4-7f5e32768aab.133b1327-05fc-43c7-872e-ead2a51ff800 1G Apr 29 15:42:21 devstack sudo[112226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:21 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-1047134e-d807-4325-8b11-bb20b0d21f11 tempest-VolumeDependencyTests-347675874 None] Lock "cinder-977f6a7a-1f28-4b8d-81c5-5105a37a54ae-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:42:21 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-1047134e-d807-4325-8b11-bb20b0d21f11 tempest-VolumeDependencyTests-347675874 None] Acquiring lock "cinder-quobyte-977f6a7a-1f28-4b8d-81c5-5105a37a54ae" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:42:22 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-1047134e-d807-4325-8b11-bb20b0d21f11 tempest-VolumeDependencyTests-347675874 None] Lock "cinder-quobyte-977f6a7a-1f28-4b8d-81c5-5105a37a54ae" acquired by "delete_volume" :: waited 0.018s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:42:22 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f7e609-edb5-4b1d-9f69-06782aa6a972]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:42:22 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1047134e-d807-4325-8b11-bb20b0d21f11 tempest-VolumeDependencyTests-347675874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-977f6a7a-1f28-4b8d-81c5-5105a37a54ae {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:22 devstack sudo[112228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-977f6a7a-1f28-4b8d-81c5-5105a37a54ae Apr 29 15:42:22 devstack sudo[112228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:22 devstack sudo[112226]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:22 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ed47736f-28cc-4b2d-a1a6-f7fb3c9fde83 tempest-CreateVolumesFromSnapshotTest-1193587883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-20059d47-dd80-4c12-81a4-7f5e32768aab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-20059d47-dd80-4c12-81a4-7f5e32768aab.133b1327-05fc-43c7-872e-ead2a51ff800 1G" returned: 0 in 0.780s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:22 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ed47736f-28cc-4b2d-a1a6-f7fb3c9fde83 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20059d47-dd80-4c12-81a4-7f5e32768aab -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-20059d47-dd80-4c12-81a4-7f5e32768aab.133b1327-05fc-43c7-872e-ead2a51ff800 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:22 devstack sudo[112237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20059d47-dd80-4c12-81a4-7f5e32768aab -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-20059d47-dd80-4c12-81a4-7f5e32768aab.133b1327-05fc-43c7-872e-ead2a51ff800 Apr 29 15:42:22 devstack sudo[112237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:22 devstack sudo[112228]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:22 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1047134e-d807-4325-8b11-bb20b0d21f11 tempest-VolumeDependencyTests-347675874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-977f6a7a-1f28-4b8d-81c5-5105a37a54ae" returned: 0 in 0.753s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:22 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1047134e-d807-4325-8b11-bb20b0d21f11 tempest-VolumeDependencyTests-347675874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-977f6a7a-1f28-4b8d-81c5-5105a37a54ae {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:22 devstack sudo[112239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-977f6a7a-1f28-4b8d-81c5-5105a37a54ae Apr 29 15:42:22 devstack sudo[112239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:23 devstack sudo[112237]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:23 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ed47736f-28cc-4b2d-a1a6-f7fb3c9fde83 tempest-CreateVolumesFromSnapshotTest-1193587883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20059d47-dd80-4c12-81a4-7f5e32768aab -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-20059d47-dd80-4c12-81a4-7f5e32768aab.133b1327-05fc-43c7-872e-ead2a51ff800" returned: 0 in 0.643s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:23 devstack cinder-volume[84448]: WARNING cinder.volume.drivers.remotefs [None req-ed47736f-28cc-4b2d-a1a6-f7fb3c9fde83 tempest-CreateVolumesFromSnapshotTest-1193587883 None] /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-20059d47-dd80-4c12-81a4-7f5e32768aab.133b1327-05fc-43c7-872e-ead2a51ff800 is being set with open permissions: ugo+rw Apr 29 15:42:23 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ed47736f-28cc-4b2d-a1a6-f7fb3c9fde83 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-20059d47-dd80-4c12-81a4-7f5e32768aab.133b1327-05fc-43c7-872e-ead2a51ff800 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:23 devstack sudo[112245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-20059d47-dd80-4c12-81a4-7f5e32768aab.133b1327-05fc-43c7-872e-ead2a51ff800 Apr 29 15:42:23 devstack sudo[112245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:23 devstack sudo[112239]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:23 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1047134e-d807-4325-8b11-bb20b0d21f11 tempest-VolumeDependencyTests-347675874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-977f6a7a-1f28-4b8d-81c5-5105a37a54ae" returned: 0 in 0.597s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:23 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-1047134e-d807-4325-8b11-bb20b0d21f11 tempest-VolumeDependencyTests-347675874 None] Lock "cinder-quobyte-977f6a7a-1f28-4b8d-81c5-5105a37a54ae" released by "delete_volume" :: held 1.412s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:42:23 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-1047134e-d807-4325-8b11-bb20b0d21f11 tempest-VolumeDependencyTests-347675874 None] Created reservations ['47564a57-e80f-414a-8b64-9c84440dd70f', '61b3785f-f22e-4484-99a0-667d54964afd', '24034e20-8a83-4191-81e7-980ba9c67484', '48253dfe-8344-4285-aa68-251e25591aa3'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:42:23 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-1047134e-d807-4325-8b11-bb20b0d21f11 tempest-VolumeDependencyTests-347675874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:42:23 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-1047134e-d807-4325-8b11-bb20b0d21f11 tempest-VolumeDependencyTests-347675874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:42:23 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-1047134e-d807-4325-8b11-bb20b0d21f11 tempest-VolumeDependencyTests-347675874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:42:23 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-1047134e-d807-4325-8b11-bb20b0d21f11 tempest-VolumeDependencyTests-347675874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:42:23 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-1047134e-d807-4325-8b11-bb20b0d21f11 tempest-VolumeDependencyTests-347675874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:42:23 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1047134e-d807-4325-8b11-bb20b0d21f11 tempest-VolumeDependencyTests-347675874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:23 devstack sudo[112247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:42:23 devstack sudo[112247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:23 devstack sudo[112245]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:23 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ed47736f-28cc-4b2d-a1a6-f7fb3c9fde83 tempest-CreateVolumesFromSnapshotTest-1193587883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-20059d47-dd80-4c12-81a4-7f5e32768aab.133b1327-05fc-43c7-872e-ead2a51ff800" returned: 0 in 0.614s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:23 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ed47736f-28cc-4b2d-a1a6-f7fb3c9fde83 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-20059d47-dd80-4c12-81a4-7f5e32768aab.info {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:24 devstack sudo[112250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-20059d47-dd80-4c12-81a4-7f5e32768aab.info Apr 29 15:42:24 devstack sudo[112250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:24 devstack sudo[112247]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:24 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1047134e-d807-4325-8b11-bb20b0d21f11 tempest-VolumeDependencyTests-347675874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.606s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:24 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-1047134e-d807-4325-8b11-bb20b0d21f11 tempest-VolumeDependencyTests-347675874 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:42:24 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-1047134e-d807-4325-8b11-bb20b0d21f11 tempest-VolumeDependencyTests-347675874 None] Deleted volume successfully. Apr 29 15:42:24 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a2d5b0b2-94f2-4146-99fa-c28e7ab999d0 tempest-VolumeDependencyTests-347675874 None] Acquiring lock "cinder-fda57970-6ec3-47f5-9bda-f66cb6db29b3-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:42:24 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-1047134e-d807-4325-8b11-bb20b0d21f11 tempest-VolumeDependencyTests-347675874 None] Lock "cinder-977f6a7a-1f28-4b8d-81c5-5105a37a54ae-delete_volume" released by "delete_volume" :: held 2.250s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:42:24 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a2d5b0b2-94f2-4146-99fa-c28e7ab999d0 tempest-VolumeDependencyTests-347675874 None] Lock "cinder-fda57970-6ec3-47f5-9bda-f66cb6db29b3-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:42:24 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a2d5b0b2-94f2-4146-99fa-c28e7ab999d0 tempest-VolumeDependencyTests-347675874 None] Acquiring lock "cinder-quobyte-fda57970-6ec3-47f5-9bda-f66cb6db29b3" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:42:24 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a2d5b0b2-94f2-4146-99fa-c28e7ab999d0 tempest-VolumeDependencyTests-347675874 None] Lock "cinder-quobyte-fda57970-6ec3-47f5-9bda-f66cb6db29b3" acquired by "delete_volume" :: waited 0.016s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:42:24 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[61cfa747-03f1-43d6-8a5c-ccf0c181abff]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:42:24 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a2d5b0b2-94f2-4146-99fa-c28e7ab999d0 tempest-VolumeDependencyTests-347675874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-fda57970-6ec3-47f5-9bda-f66cb6db29b3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:24 devstack sudo[112253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-fda57970-6ec3-47f5-9bda-f66cb6db29b3 Apr 29 15:42:24 devstack sudo[112253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:24 devstack sudo[112250]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:24 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ed47736f-28cc-4b2d-a1a6-f7fb3c9fde83 tempest-CreateVolumesFromSnapshotTest-1193587883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-20059d47-dd80-4c12-81a4-7f5e32768aab.info" returned: 0 in 0.629s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:24 devstack cinder-volume[84448]: WARNING cinder.volume.drivers.remotefs [None req-ed47736f-28cc-4b2d-a1a6-f7fb3c9fde83 tempest-CreateVolumesFromSnapshotTest-1193587883 None] /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-20059d47-dd80-4c12-81a4-7f5e32768aab.info is being set with open permissions: ugo+rw Apr 29 15:42:24 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ed47736f-28cc-4b2d-a1a6-f7fb3c9fde83 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-20059d47-dd80-4c12-81a4-7f5e32768aab.info {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:24 devstack sudo[112256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-20059d47-dd80-4c12-81a4-7f5e32768aab.info Apr 29 15:42:24 devstack sudo[112256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:24 devstack sudo[112253]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:24 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a2d5b0b2-94f2-4146-99fa-c28e7ab999d0 tempest-VolumeDependencyTests-347675874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-fda57970-6ec3-47f5-9bda-f66cb6db29b3" returned: 0 in 0.719s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:24 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a2d5b0b2-94f2-4146-99fa-c28e7ab999d0 tempest-VolumeDependencyTests-347675874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-fda57970-6ec3-47f5-9bda-f66cb6db29b3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:25 devstack sudo[112261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-fda57970-6ec3-47f5-9bda-f66cb6db29b3 Apr 29 15:42:25 devstack sudo[112261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:25 devstack sudo[112256]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ed47736f-28cc-4b2d-a1a6-f7fb3c9fde83 tempest-CreateVolumesFromSnapshotTest-1193587883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-20059d47-dd80-4c12-81a4-7f5e32768aab.info" returned: 0 in 0.613s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-ed47736f-28cc-4b2d-a1a6-f7fb3c9fde83 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.158s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:42:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-a48e0459-c79d-4c5a-abf7-aa600cce4e41 tempest-SnapshotDependencyTests-156111334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.916s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:42:25 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-a48e0459-c79d-4c5a-abf7-aa600cce4e41 tempest-SnapshotDependencyTests-156111334 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:42:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-105763570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=813cc986-df45-4888-b394-bb22af18e7ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='735577aa5d86470db119030b97fb68d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:42:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:42:21Z,use_quota=True,user_id='426714a7ceb141e1852cb9c7651c0511',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:42:25 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-a48e0459-c79d-4c5a-abf7-aa600cce4e41 tempest-SnapshotDependencyTests-156111334 None] Creating volume 813cc986-df45-4888-b394-bb22af18e7ca {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:42:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-a48e0459-c79d-4c5a-abf7-aa600cce4e41 tempest-SnapshotDependencyTests-156111334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:42:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-a48e0459-c79d-4c5a-abf7-aa600cce4e41 tempest-SnapshotDependencyTests-156111334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:42:25 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-a48e0459-c79d-4c5a-abf7-aa600cce4e41 tempest-SnapshotDependencyTests-156111334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:42:25 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-a48e0459-c79d-4c5a-abf7-aa600cce4e41 tempest-SnapshotDependencyTests-156111334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:42:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-a48e0459-c79d-4c5a-abf7-aa600cce4e41 tempest-SnapshotDependencyTests-156111334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:42:25 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-a48e0459-c79d-4c5a-abf7-aa600cce4e41 tempest-SnapshotDependencyTests-156111334 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:42:25 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-a48e0459-c79d-4c5a-abf7-aa600cce4e41 tempest-SnapshotDependencyTests-156111334 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:42:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a48e0459-c79d-4c5a-abf7-aa600cce4e41 tempest-SnapshotDependencyTests-156111334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-813cc986-df45-4888-b394-bb22af18e7ca 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:25 devstack sudo[112264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-813cc986-df45-4888-b394-bb22af18e7ca 1073741824 Apr 29 15:42:25 devstack sudo[112264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:25 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-ed47736f-28cc-4b2d-a1a6-f7fb3c9fde83 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Create snapshot completed successfully Apr 29 15:42:25 devstack sudo[112261]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a2d5b0b2-94f2-4146-99fa-c28e7ab999d0 tempest-VolumeDependencyTests-347675874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-fda57970-6ec3-47f5-9bda-f66cb6db29b3" returned: 0 in 0.592s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:25 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a2d5b0b2-94f2-4146-99fa-c28e7ab999d0 tempest-VolumeDependencyTests-347675874 None] Lock "cinder-quobyte-fda57970-6ec3-47f5-9bda-f66cb6db29b3" released by "delete_volume" :: held 1.352s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:42:25 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-a2d5b0b2-94f2-4146-99fa-c28e7ab999d0 tempest-VolumeDependencyTests-347675874 None] Created reservations ['86a83d68-565e-4839-b260-6e615434b095', '071a2dd3-3e80-4c99-90ff-e2a007368acd', 'ab16b0e1-fbbc-456b-8d6b-c6b886bde606', 'cbb29121-fbb6-413c-b6db-37ff44bdfc01'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:42:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-a2d5b0b2-94f2-4146-99fa-c28e7ab999d0 tempest-VolumeDependencyTests-347675874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:42:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-a2d5b0b2-94f2-4146-99fa-c28e7ab999d0 tempest-VolumeDependencyTests-347675874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:42:25 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-a2d5b0b2-94f2-4146-99fa-c28e7ab999d0 tempest-VolumeDependencyTests-347675874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:42:25 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-a2d5b0b2-94f2-4146-99fa-c28e7ab999d0 tempest-VolumeDependencyTests-347675874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:42:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-a2d5b0b2-94f2-4146-99fa-c28e7ab999d0 tempest-VolumeDependencyTests-347675874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:42:25 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a2d5b0b2-94f2-4146-99fa-c28e7ab999d0 tempest-VolumeDependencyTests-347675874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:25 devstack sudo[112267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:42:25 devstack sudo[112267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:26 devstack sudo[112264]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a48e0459-c79d-4c5a-abf7-aa600cce4e41 tempest-SnapshotDependencyTests-156111334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-813cc986-df45-4888-b394-bb22af18e7ca 1073741824" returned: 0 in 0.888s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a48e0459-c79d-4c5a-abf7-aa600cce4e41 tempest-SnapshotDependencyTests-156111334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-813cc986-df45-4888-b394-bb22af18e7ca {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:26 devstack sudo[112273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-813cc986-df45-4888-b394-bb22af18e7ca Apr 29 15:42:26 devstack sudo[112273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:26 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-172f0427-58b3-4706-9f4a-8064ee696a0e tempest-CreateVolumesFromSnapshotTest-1193587883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:42:26 devstack sudo[112267]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:26 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-172f0427-58b3-4706-9f4a-8064ee696a0e tempest-CreateVolumesFromSnapshotTest-1193587883 None] Flow 'volume_create_manager' (019788ba-fbc2-4da3-9807-d82fbe9887dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:42:26 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-172f0427-58b3-4706-9f4a-8064ee696a0e tempest-CreateVolumesFromSnapshotTest-1193587883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d80671f-036c-4229-83f6-401caaf5b2e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:42:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a2d5b0b2-94f2-4146-99fa-c28e7ab999d0 tempest-VolumeDependencyTests-347675874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.688s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:26 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-a2d5b0b2-94f2-4146-99fa-c28e7ab999d0 tempest-VolumeDependencyTests-347675874 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:42:26 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-172f0427-58b3-4706-9f4a-8064ee696a0e tempest-CreateVolumesFromSnapshotTest-1193587883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d80671f-036c-4229-83f6-401caaf5b2e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:42:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1962537146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a83e4c0-3bd5-4dd5-8ebd-58a51a2e53c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc69cec5ae4a486083f88dfbeb5e2570',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:42:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:42:26Z,use_quota=True,user_id='cc0c3f24d7bc4f68b863ce492f25e005',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:42:26 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-172f0427-58b3-4706-9f4a-8064ee696a0e tempest-CreateVolumesFromSnapshotTest-1193587883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee14cda7-02ff-480e-8343-3075952ee540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:42:26 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-172f0427-58b3-4706-9f4a-8064ee696a0e tempest-CreateVolumesFromSnapshotTest-1193587883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee14cda7-02ff-480e-8343-3075952ee540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:42:26 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-172f0427-58b3-4706-9f4a-8064ee696a0e tempest-CreateVolumesFromSnapshotTest-1193587883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53cda2de-0fe9-42aa-99a4-b28d91d086c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:42:26 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-172f0427-58b3-4706-9f4a-8064ee696a0e tempest-CreateVolumesFromSnapshotTest-1193587883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53cda2de-0fe9-42aa-99a4-b28d91d086c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a83e4c0-3bd5-4dd5-8ebd-58a51a2e53c8', 'volume_name': 'volume-2a83e4c0-3bd5-4dd5-8ebd-58a51a2e53c8', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:42:26 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-172f0427-58b3-4706-9f4a-8064ee696a0e tempest-CreateVolumesFromSnapshotTest-1193587883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc09239a-b6c6-4b3f-a1c2-11ef1a94fb9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:42:26 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-172f0427-58b3-4706-9f4a-8064ee696a0e tempest-CreateVolumesFromSnapshotTest-1193587883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc09239a-b6c6-4b3f-a1c2-11ef1a94fb9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:42:26 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-172f0427-58b3-4706-9f4a-8064ee696a0e tempest-CreateVolumesFromSnapshotTest-1193587883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81b055fe-8b65-4117-99ec-46a5a92c67d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:42:26 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-172f0427-58b3-4706-9f4a-8064ee696a0e tempest-CreateVolumesFromSnapshotTest-1193587883 None] Volume 2a83e4c0-3bd5-4dd5-8ebd-58a51a2e53c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a83e4c0-3bd5-4dd5-8ebd-58a51a2e53c8', 'volume_size': 1} Apr 29 15:42:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-172f0427-58b3-4706-9f4a-8064ee696a0e tempest-CreateVolumesFromSnapshotTest-1193587883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:42:26 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-a2d5b0b2-94f2-4146-99fa-c28e7ab999d0 tempest-VolumeDependencyTests-347675874 None] Deleted volume successfully. Apr 29 15:42:26 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a2d5b0b2-94f2-4146-99fa-c28e7ab999d0 tempest-VolumeDependencyTests-347675874 None] Lock "cinder-fda57970-6ec3-47f5-9bda-f66cb6db29b3-delete_volume" released by "delete_volume" :: held 2.280s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:42:26 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-55a9b081-e0fd-46f5-b919-bd6d6f37635c tempest-VolumeDependencyTests-347675874 None] Acquiring lock "cinder-7dd50a7e-6504-4a5f-a442-4ce074d279f2-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:42:26 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-55a9b081-e0fd-46f5-b919-bd6d6f37635c tempest-VolumeDependencyTests-347675874 None] Lock "cinder-7dd50a7e-6504-4a5f-a442-4ce074d279f2-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:42:26 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-55a9b081-e0fd-46f5-b919-bd6d6f37635c tempest-VolumeDependencyTests-347675874 None] Acquiring lock "cinder-quobyte-7dd50a7e-6504-4a5f-a442-4ce074d279f2" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:42:26 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-55a9b081-e0fd-46f5-b919-bd6d6f37635c tempest-VolumeDependencyTests-347675874 None] Lock "cinder-quobyte-7dd50a7e-6504-4a5f-a442-4ce074d279f2" acquired by "delete_volume" :: waited 0.025s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:42:26 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[825a478d-3003-4ce3-a122-7a455472513a]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:42:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-55a9b081-e0fd-46f5-b919-bd6d6f37635c tempest-VolumeDependencyTests-347675874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7dd50a7e-6504-4a5f-a442-4ce074d279f2 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:26 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-df1ee5f5-6f3f-4ccf-8f37-c5fda1cb4f51 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:42:26 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-df1ee5f5-6f3f-4ccf-8f37-c5fda1cb4f51 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Flow 'volume_create_manager' (a66d7d83-0386-4175-a9b6-f8391a03eb23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:42:26 devstack sudo[112277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7dd50a7e-6504-4a5f-a442-4ce074d279f2 Apr 29 15:42:26 devstack sudo[112277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:26 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-df1ee5f5-6f3f-4ccf-8f37-c5fda1cb4f51 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec9716a5-e915-4d58-95c1-98eea04b71f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:42:26 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-df1ee5f5-6f3f-4ccf-8f37-c5fda1cb4f51 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec9716a5-e915-4d58-95c1-98eea04b71f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:42:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1098042266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e808535-78fb-4a50-b3fd-88227df756fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc69cec5ae4a486083f88dfbeb5e2570',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:42:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:42:27Z,use_quota=True,user_id='cc0c3f24d7bc4f68b863ce492f25e005',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:42:26 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-df1ee5f5-6f3f-4ccf-8f37-c5fda1cb4f51 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b151ed8-af77-4efa-8edc-5cf1b5177a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:42:26 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-df1ee5f5-6f3f-4ccf-8f37-c5fda1cb4f51 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b151ed8-af77-4efa-8edc-5cf1b5177a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:42:26 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-df1ee5f5-6f3f-4ccf-8f37-c5fda1cb4f51 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c437a909-17fe-4066-9bdd-5e310239d98b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:42:26 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-df1ee5f5-6f3f-4ccf-8f37-c5fda1cb4f51 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c437a909-17fe-4066-9bdd-5e310239d98b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e808535-78fb-4a50-b3fd-88227df756fc', 'volume_name': 'volume-3e808535-78fb-4a50-b3fd-88227df756fc', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:42:26 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-df1ee5f5-6f3f-4ccf-8f37-c5fda1cb4f51 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37d8e53a-14a5-48e1-9348-b04b8fd3b051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:42:26 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-df1ee5f5-6f3f-4ccf-8f37-c5fda1cb4f51 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37d8e53a-14a5-48e1-9348-b04b8fd3b051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:42:26 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-df1ee5f5-6f3f-4ccf-8f37-c5fda1cb4f51 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ed0a730-db3d-4342-aacf-e3d3a9af7dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:42:26 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-df1ee5f5-6f3f-4ccf-8f37-c5fda1cb4f51 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Volume 3e808535-78fb-4a50-b3fd-88227df756fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e808535-78fb-4a50-b3fd-88227df756fc', 'volume_size': 1} Apr 29 15:42:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-df1ee5f5-6f3f-4ccf-8f37-c5fda1cb4f51 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:42:26 devstack sudo[112273]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a48e0459-c79d-4c5a-abf7-aa600cce4e41 tempest-SnapshotDependencyTests-156111334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-813cc986-df45-4888-b394-bb22af18e7ca" returned: 0 in 0.783s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:26 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-a48e0459-c79d-4c5a-abf7-aa600cce4e41 tempest-SnapshotDependencyTests-156111334 None] <== create_volume: return (1724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:42:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-a48e0459-c79d-4c5a-abf7-aa600cce4e41 tempest-SnapshotDependencyTests-156111334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.727s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:42:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-172f0427-58b3-4706-9f4a-8064ee696a0e tempest-CreateVolumesFromSnapshotTest-1193587883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.523s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:42:26 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-172f0427-58b3-4706-9f4a-8064ee696a0e tempest-CreateVolumesFromSnapshotTest-1193587883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:42:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1962537146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a83e4c0-3bd5-4dd5-8ebd-58a51a2e53c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc69cec5ae4a486083f88dfbeb5e2570',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:42:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:42:26Z,use_quota=True,user_id='cc0c3f24d7bc4f68b863ce492f25e005',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:42:26 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-172f0427-58b3-4706-9f4a-8064ee696a0e tempest-CreateVolumesFromSnapshotTest-1193587883 None] Creating volume 2a83e4c0-3bd5-4dd5-8ebd-58a51a2e53c8 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:42:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-172f0427-58b3-4706-9f4a-8064ee696a0e tempest-CreateVolumesFromSnapshotTest-1193587883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:42:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-172f0427-58b3-4706-9f4a-8064ee696a0e tempest-CreateVolumesFromSnapshotTest-1193587883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:42:26 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-172f0427-58b3-4706-9f4a-8064ee696a0e tempest-CreateVolumesFromSnapshotTest-1193587883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:42:26 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-172f0427-58b3-4706-9f4a-8064ee696a0e tempest-CreateVolumesFromSnapshotTest-1193587883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:42:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-172f0427-58b3-4706-9f4a-8064ee696a0e tempest-CreateVolumesFromSnapshotTest-1193587883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:42:26 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-172f0427-58b3-4706-9f4a-8064ee696a0e tempest-CreateVolumesFromSnapshotTest-1193587883 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:42:26 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-172f0427-58b3-4706-9f4a-8064ee696a0e tempest-CreateVolumesFromSnapshotTest-1193587883 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:42:26 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-172f0427-58b3-4706-9f4a-8064ee696a0e tempest-CreateVolumesFromSnapshotTest-1193587883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2a83e4c0-3bd5-4dd5-8ebd-58a51a2e53c8 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:27 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-a48e0459-c79d-4c5a-abf7-aa600cce4e41 tempest-SnapshotDependencyTests-156111334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b15dfae-718c-4ae7-832e-1d8c013b444a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-813cc986-df45-4888-b394-bb22af18e7ca', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:42:27 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-a48e0459-c79d-4c5a-abf7-aa600cce4e41 tempest-SnapshotDependencyTests-156111334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9106a8fa-d4eb-4f39-95b3-9409445dad21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:42:27 devstack sudo[112280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2a83e4c0-3bd5-4dd5-8ebd-58a51a2e53c8 1073741824 Apr 29 15:42:27 devstack sudo[112280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:27 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-a48e0459-c79d-4c5a-abf7-aa600cce4e41 tempest-SnapshotDependencyTests-156111334 None] Volume volume-813cc986-df45-4888-b394-bb22af18e7ca (813cc986-df45-4888-b394-bb22af18e7ca): created successfully Apr 29 15:42:27 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-a48e0459-c79d-4c5a-abf7-aa600cce4e41 tempest-SnapshotDependencyTests-156111334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9106a8fa-d4eb-4f39-95b3-9409445dad21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:42:27 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-a48e0459-c79d-4c5a-abf7-aa600cce4e41 tempest-SnapshotDependencyTests-156111334 None] Flow 'volume_create_manager' (d4249faf-3296-4313-933f-4a7cdf4ca433) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:42:27 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-a48e0459-c79d-4c5a-abf7-aa600cce4e41 tempest-SnapshotDependencyTests-156111334 None] Created volume successfully. Apr 29 15:42:27 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-feaeb131-b673-4927-8344-07e66d1c8bd1 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:42:27 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-feaeb131-b673-4927-8344-07e66d1c8bd1 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Flow 'volume_create_manager' (ed7ae554-9af2-4af1-9f1e-72d6df056090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:42:27 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-feaeb131-b673-4927-8344-07e66d1c8bd1 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4611a202-596f-4ef8-b32f-b51bac95057b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:42:27 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-feaeb131-b673-4927-8344-07e66d1c8bd1 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4611a202-596f-4ef8-b32f-b51bac95057b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:42:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-97794783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ada50094-08e1-42d2-859a-1b48e50438b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc69cec5ae4a486083f88dfbeb5e2570',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:42:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:42:27Z,use_quota=True,user_id='cc0c3f24d7bc4f68b863ce492f25e005',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:42:27 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-feaeb131-b673-4927-8344-07e66d1c8bd1 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddf2cca4-eaf9-4a36-a0f2-6ddff4a9f428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:42:27 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-feaeb131-b673-4927-8344-07e66d1c8bd1 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddf2cca4-eaf9-4a36-a0f2-6ddff4a9f428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:42:27 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-feaeb131-b673-4927-8344-07e66d1c8bd1 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b72181c3-e218-4ecc-8982-865a00dbe21a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:42:27 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-feaeb131-b673-4927-8344-07e66d1c8bd1 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b72181c3-e218-4ecc-8982-865a00dbe21a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ada50094-08e1-42d2-859a-1b48e50438b9', 'volume_name': 'volume-ada50094-08e1-42d2-859a-1b48e50438b9', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:42:27 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-feaeb131-b673-4927-8344-07e66d1c8bd1 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25eeb2a6-be03-4ba8-83f3-98d9cd77379a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:42:27 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-feaeb131-b673-4927-8344-07e66d1c8bd1 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25eeb2a6-be03-4ba8-83f3-98d9cd77379a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:42:27 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-feaeb131-b673-4927-8344-07e66d1c8bd1 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c761880-e76b-41d2-9872-f6c110b36130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:42:27 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-feaeb131-b673-4927-8344-07e66d1c8bd1 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Volume ada50094-08e1-42d2-859a-1b48e50438b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ada50094-08e1-42d2-859a-1b48e50438b9', 'volume_size': 1} Apr 29 15:42:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-feaeb131-b673-4927-8344-07e66d1c8bd1 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:42:27 devstack sudo[112277]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-55a9b081-e0fd-46f5-b919-bd6d6f37635c tempest-VolumeDependencyTests-347675874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7dd50a7e-6504-4a5f-a442-4ce074d279f2" returned: 0 in 0.872s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-55a9b081-e0fd-46f5-b919-bd6d6f37635c tempest-VolumeDependencyTests-347675874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7dd50a7e-6504-4a5f-a442-4ce074d279f2 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:27 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cd262cd-1d16-4a9b-9cf6-f3c246662d30 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:42:27 devstack sudo[112285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7dd50a7e-6504-4a5f-a442-4ce074d279f2 Apr 29 15:42:27 devstack sudo[112285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:27 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4cd262cd-1d16-4a9b-9cf6-f3c246662d30 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Flow 'volume_create_manager' (7fb15b43-a4df-466a-bdd6-3aa499ed7c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:42:27 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4cd262cd-1d16-4a9b-9cf6-f3c246662d30 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b7d3a7c-0046-4f9e-a6e0-f370be593c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:42:27 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4cd262cd-1d16-4a9b-9cf6-f3c246662d30 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b7d3a7c-0046-4f9e-a6e0-f370be593c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:42:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-812979178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3257527e-22ed-45b9-ae90-df57ae741834,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc69cec5ae4a486083f88dfbeb5e2570',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:42:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:42:28Z,use_quota=True,user_id='cc0c3f24d7bc4f68b863ce492f25e005',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:42:27 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4cd262cd-1d16-4a9b-9cf6-f3c246662d30 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03639616-8429-4669-a7a3-33649dcb09a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:42:27 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4cd262cd-1d16-4a9b-9cf6-f3c246662d30 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03639616-8429-4669-a7a3-33649dcb09a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:42:27 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4cd262cd-1d16-4a9b-9cf6-f3c246662d30 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (400a811e-9832-4250-a621-af72410ab1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:42:27 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4cd262cd-1d16-4a9b-9cf6-f3c246662d30 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (400a811e-9832-4250-a621-af72410ab1a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3257527e-22ed-45b9-ae90-df57ae741834', 'volume_name': 'volume-3257527e-22ed-45b9-ae90-df57ae741834', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:42:27 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4cd262cd-1d16-4a9b-9cf6-f3c246662d30 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a1576ed-3090-49e9-9a3d-72be5385ed56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:42:27 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4cd262cd-1d16-4a9b-9cf6-f3c246662d30 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a1576ed-3090-49e9-9a3d-72be5385ed56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:42:27 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4cd262cd-1d16-4a9b-9cf6-f3c246662d30 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f70d885-f721-4a87-a57e-ae7d9a71f3d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:42:27 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-4cd262cd-1d16-4a9b-9cf6-f3c246662d30 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Volume 3257527e-22ed-45b9-ae90-df57ae741834: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3257527e-22ed-45b9-ae90-df57ae741834', 'volume_size': 1} Apr 29 15:42:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-4cd262cd-1d16-4a9b-9cf6-f3c246662d30 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:42:27 devstack sudo[112280]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:27 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-172f0427-58b3-4706-9f4a-8064ee696a0e tempest-CreateVolumesFromSnapshotTest-1193587883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2a83e4c0-3bd5-4dd5-8ebd-58a51a2e53c8 1073741824" returned: 0 in 0.994s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-172f0427-58b3-4706-9f4a-8064ee696a0e tempest-CreateVolumesFromSnapshotTest-1193587883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2a83e4c0-3bd5-4dd5-8ebd-58a51a2e53c8 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:28 devstack sudo[112290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2a83e4c0-3bd5-4dd5-8ebd-58a51a2e53c8 Apr 29 15:42:28 devstack sudo[112290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:28 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bfb6892-d0b6-45a4-ae4e-dff4f68d923d tempest-CreateVolumesFromSnapshotTest-1193587883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:42:28 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-9bfb6892-d0b6-45a4-ae4e-dff4f68d923d tempest-CreateVolumesFromSnapshotTest-1193587883 None] Flow 'volume_create_manager' (7afa22ad-6109-4003-ac45-03f7cfbeada0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:42:28 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-9bfb6892-d0b6-45a4-ae4e-dff4f68d923d tempest-CreateVolumesFromSnapshotTest-1193587883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a707567-405b-4c2f-98b0-685e8084604b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:42:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-f1f286cc-3960-41c0-8b86-c8cf7bfcba99 tempest-SnapshotDependencyTests-156111334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:42:28 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-9bfb6892-d0b6-45a4-ae4e-dff4f68d923d tempest-CreateVolumesFromSnapshotTest-1193587883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a707567-405b-4c2f-98b0-685e8084604b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:42:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1978588969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7495cd47-19f7-438e-8829-98523c678178,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc69cec5ae4a486083f88dfbeb5e2570',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:42:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:42:28Z,use_quota=True,user_id='cc0c3f24d7bc4f68b863ce492f25e005',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:42:28 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-9bfb6892-d0b6-45a4-ae4e-dff4f68d923d tempest-CreateVolumesFromSnapshotTest-1193587883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d21abe0-fe8a-4060-9aa3-6f1ce01683f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:42:28 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-9bfb6892-d0b6-45a4-ae4e-dff4f68d923d tempest-CreateVolumesFromSnapshotTest-1193587883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d21abe0-fe8a-4060-9aa3-6f1ce01683f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:42:28 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-9bfb6892-d0b6-45a4-ae4e-dff4f68d923d tempest-CreateVolumesFromSnapshotTest-1193587883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aad04983-393b-4847-931d-e7238e30964c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:42:28 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-9bfb6892-d0b6-45a4-ae4e-dff4f68d923d tempest-CreateVolumesFromSnapshotTest-1193587883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aad04983-393b-4847-931d-e7238e30964c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7495cd47-19f7-438e-8829-98523c678178', 'volume_name': 'volume-7495cd47-19f7-438e-8829-98523c678178', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:42:28 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-9bfb6892-d0b6-45a4-ae4e-dff4f68d923d tempest-CreateVolumesFromSnapshotTest-1193587883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b8c05d7-7b2e-45ee-b3be-d1dd6be91529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:42:28 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-9bfb6892-d0b6-45a4-ae4e-dff4f68d923d tempest-CreateVolumesFromSnapshotTest-1193587883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b8c05d7-7b2e-45ee-b3be-d1dd6be91529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:42:28 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-9bfb6892-d0b6-45a4-ae4e-dff4f68d923d tempest-CreateVolumesFromSnapshotTest-1193587883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06d4acec-7e31-4a9f-94a1-75992675405f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:42:28 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-9bfb6892-d0b6-45a4-ae4e-dff4f68d923d tempest-CreateVolumesFromSnapshotTest-1193587883 None] Volume 7495cd47-19f7-438e-8829-98523c678178: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7495cd47-19f7-438e-8829-98523c678178', 'volume_size': 1} Apr 29 15:42:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-9bfb6892-d0b6-45a4-ae4e-dff4f68d923d tempest-CreateVolumesFromSnapshotTest-1193587883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:42:28 devstack sudo[112285]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-55a9b081-e0fd-46f5-b919-bd6d6f37635c tempest-VolumeDependencyTests-347675874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7dd50a7e-6504-4a5f-a442-4ce074d279f2" returned: 0 in 0.785s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:28 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-55a9b081-e0fd-46f5-b919-bd6d6f37635c tempest-VolumeDependencyTests-347675874 None] Lock "cinder-quobyte-7dd50a7e-6504-4a5f-a442-4ce074d279f2" released by "delete_volume" :: held 1.701s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:42:28 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-55a9b081-e0fd-46f5-b919-bd6d6f37635c tempest-VolumeDependencyTests-347675874 None] Created reservations ['58d28f57-d531-4f4a-9211-dc5246dd61d1', 'a6d16696-2ff4-4fa2-954c-d4df50ea0646', 'a60c99f6-b7d3-4d8b-adbb-235c62e682c0', '94c05bdb-6a14-4a19-8982-ccd306381639'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:42:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-55a9b081-e0fd-46f5-b919-bd6d6f37635c tempest-VolumeDependencyTests-347675874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:42:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-55a9b081-e0fd-46f5-b919-bd6d6f37635c tempest-VolumeDependencyTests-347675874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:42:28 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-55a9b081-e0fd-46f5-b919-bd6d6f37635c tempest-VolumeDependencyTests-347675874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:42:28 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-55a9b081-e0fd-46f5-b919-bd6d6f37635c tempest-VolumeDependencyTests-347675874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:42:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-55a9b081-e0fd-46f5-b919-bd6d6f37635c tempest-VolumeDependencyTests-347675874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:42:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-55a9b081-e0fd-46f5-b919-bd6d6f37635c tempest-VolumeDependencyTests-347675874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:28 devstack sudo[112293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:42:28 devstack sudo[112293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:28 devstack sudo[112290]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-172f0427-58b3-4706-9f4a-8064ee696a0e tempest-CreateVolumesFromSnapshotTest-1193587883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2a83e4c0-3bd5-4dd5-8ebd-58a51a2e53c8" returned: 0 in 0.611s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:28 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-172f0427-58b3-4706-9f4a-8064ee696a0e tempest-CreateVolumesFromSnapshotTest-1193587883 None] <== create_volume: return (1653ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:42:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-172f0427-58b3-4706-9f4a-8064ee696a0e tempest-CreateVolumesFromSnapshotTest-1193587883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.658s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:42:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-df1ee5f5-6f3f-4ccf-8f37-c5fda1cb4f51 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.752s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:42:28 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-df1ee5f5-6f3f-4ccf-8f37-c5fda1cb4f51 tempest-CreateVolumesFromSnapshotTest-1193587883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:42:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1098042266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e808535-78fb-4a50-b3fd-88227df756fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc69cec5ae4a486083f88dfbeb5e2570',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:42:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:42:27Z,use_quota=True,user_id='cc0c3f24d7bc4f68b863ce492f25e005',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:42:28 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-df1ee5f5-6f3f-4ccf-8f37-c5fda1cb4f51 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Creating volume 3e808535-78fb-4a50-b3fd-88227df756fc {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:42:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-df1ee5f5-6f3f-4ccf-8f37-c5fda1cb4f51 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:42:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-df1ee5f5-6f3f-4ccf-8f37-c5fda1cb4f51 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:42:28 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-df1ee5f5-6f3f-4ccf-8f37-c5fda1cb4f51 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:42:28 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-df1ee5f5-6f3f-4ccf-8f37-c5fda1cb4f51 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:42:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-df1ee5f5-6f3f-4ccf-8f37-c5fda1cb4f51 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:42:28 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-df1ee5f5-6f3f-4ccf-8f37-c5fda1cb4f51 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:42:28 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-df1ee5f5-6f3f-4ccf-8f37-c5fda1cb4f51 tempest-CreateVolumesFromSnapshotTest-1193587883 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:42:28 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-df1ee5f5-6f3f-4ccf-8f37-c5fda1cb4f51 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3e808535-78fb-4a50-b3fd-88227df756fc 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:28 devstack sudo[112296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3e808535-78fb-4a50-b3fd-88227df756fc 1073741824 Apr 29 15:42:28 devstack sudo[112296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:28 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-172f0427-58b3-4706-9f4a-8064ee696a0e tempest-CreateVolumesFromSnapshotTest-1193587883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81b055fe-8b65-4117-99ec-46a5a92c67d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a83e4c0-3bd5-4dd5-8ebd-58a51a2e53c8', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:42:28 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-172f0427-58b3-4706-9f4a-8064ee696a0e tempest-CreateVolumesFromSnapshotTest-1193587883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57fadbb7-f51b-405d-a526-2df10841b63b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:42:28 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-172f0427-58b3-4706-9f4a-8064ee696a0e tempest-CreateVolumesFromSnapshotTest-1193587883 None] Volume volume-2a83e4c0-3bd5-4dd5-8ebd-58a51a2e53c8 (2a83e4c0-3bd5-4dd5-8ebd-58a51a2e53c8): created successfully Apr 29 15:42:28 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-172f0427-58b3-4706-9f4a-8064ee696a0e tempest-CreateVolumesFromSnapshotTest-1193587883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57fadbb7-f51b-405d-a526-2df10841b63b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:42:28 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-172f0427-58b3-4706-9f4a-8064ee696a0e tempest-CreateVolumesFromSnapshotTest-1193587883 None] Flow 'volume_create_manager' (019788ba-fbc2-4da3-9807-d82fbe9887dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:42:28 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-172f0427-58b3-4706-9f4a-8064ee696a0e tempest-CreateVolumesFromSnapshotTest-1193587883 None] Created volume successfully. Apr 29 15:42:29 devstack sudo[112293]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-55a9b081-e0fd-46f5-b919-bd6d6f37635c tempest-VolumeDependencyTests-347675874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.625s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:29 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-55a9b081-e0fd-46f5-b919-bd6d6f37635c tempest-VolumeDependencyTests-347675874 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:42:29 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-55a9b081-e0fd-46f5-b919-bd6d6f37635c tempest-VolumeDependencyTests-347675874 None] Deleted volume successfully. Apr 29 15:42:29 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-55a9b081-e0fd-46f5-b919-bd6d6f37635c tempest-VolumeDependencyTests-347675874 None] Lock "cinder-7dd50a7e-6504-4a5f-a442-4ce074d279f2-delete_volume" released by "delete_volume" :: held 2.540s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:42:29 devstack sudo[112296]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-df1ee5f5-6f3f-4ccf-8f37-c5fda1cb4f51 tempest-CreateVolumesFromSnapshotTest-1193587883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3e808535-78fb-4a50-b3fd-88227df756fc 1073741824" returned: 0 in 0.876s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:29 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-df1ee5f5-6f3f-4ccf-8f37-c5fda1cb4f51 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3e808535-78fb-4a50-b3fd-88227df756fc {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:29 devstack sudo[112303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3e808535-78fb-4a50-b3fd-88227df756fc Apr 29 15:42:29 devstack sudo[112303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:30 devstack sudo[112303]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-df1ee5f5-6f3f-4ccf-8f37-c5fda1cb4f51 tempest-CreateVolumesFromSnapshotTest-1193587883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3e808535-78fb-4a50-b3fd-88227df756fc" returned: 0 in 0.623s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-df1ee5f5-6f3f-4ccf-8f37-c5fda1cb4f51 tempest-CreateVolumesFromSnapshotTest-1193587883 None] <== create_volume: return (1541ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:42:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-df1ee5f5-6f3f-4ccf-8f37-c5fda1cb4f51 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.547s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:42:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-feaeb131-b673-4927-8344-07e66d1c8bd1 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.875s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:42:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-feaeb131-b673-4927-8344-07e66d1c8bd1 tempest-CreateVolumesFromSnapshotTest-1193587883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:42:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-97794783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ada50094-08e1-42d2-859a-1b48e50438b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc69cec5ae4a486083f88dfbeb5e2570',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:42:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:42:27Z,use_quota=True,user_id='cc0c3f24d7bc4f68b863ce492f25e005',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:42:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-feaeb131-b673-4927-8344-07e66d1c8bd1 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Creating volume ada50094-08e1-42d2-859a-1b48e50438b9 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:42:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-feaeb131-b673-4927-8344-07e66d1c8bd1 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:42:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-feaeb131-b673-4927-8344-07e66d1c8bd1 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:42:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-feaeb131-b673-4927-8344-07e66d1c8bd1 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:42:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-feaeb131-b673-4927-8344-07e66d1c8bd1 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:42:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-feaeb131-b673-4927-8344-07e66d1c8bd1 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:42:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-feaeb131-b673-4927-8344-07e66d1c8bd1 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:42:30 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-feaeb131-b673-4927-8344-07e66d1c8bd1 tempest-CreateVolumesFromSnapshotTest-1193587883 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:42:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-feaeb131-b673-4927-8344-07e66d1c8bd1 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ada50094-08e1-42d2-859a-1b48e50438b9 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:30 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-df1ee5f5-6f3f-4ccf-8f37-c5fda1cb4f51 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ed0a730-db3d-4342-aacf-e3d3a9af7dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e808535-78fb-4a50-b3fd-88227df756fc', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:42:30 devstack sudo[112306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ada50094-08e1-42d2-859a-1b48e50438b9 1073741824 Apr 29 15:42:30 devstack sudo[112306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:30 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-df1ee5f5-6f3f-4ccf-8f37-c5fda1cb4f51 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a01ff3a-1100-4afc-814f-ab83eda3cadc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:42:30 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-df1ee5f5-6f3f-4ccf-8f37-c5fda1cb4f51 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Volume volume-3e808535-78fb-4a50-b3fd-88227df756fc (3e808535-78fb-4a50-b3fd-88227df756fc): created successfully Apr 29 15:42:30 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-df1ee5f5-6f3f-4ccf-8f37-c5fda1cb4f51 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a01ff3a-1100-4afc-814f-ab83eda3cadc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:42:30 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-df1ee5f5-6f3f-4ccf-8f37-c5fda1cb4f51 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Flow 'volume_create_manager' (a66d7d83-0386-4175-a9b6-f8391a03eb23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:42:30 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-df1ee5f5-6f3f-4ccf-8f37-c5fda1cb4f51 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Created volume successfully. Apr 29 15:42:30 devstack cinder-volume[84448]: DEBUG oslo_service.periodic_task [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84448) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 15:42:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:42:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:42:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:42:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:42:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:42:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:30 devstack sudo[112308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:42:30 devstack sudo[112308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:31 devstack sudo[112306]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-feaeb131-b673-4927-8344-07e66d1c8bd1 tempest-CreateVolumesFromSnapshotTest-1193587883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ada50094-08e1-42d2-859a-1b48e50438b9 1073741824" returned: 0 in 0.836s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:31 devstack sudo[112308]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.612s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:31 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:42:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-feaeb131-b673-4927-8344-07e66d1c8bd1 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ada50094-08e1-42d2-859a-1b48e50438b9 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:31 devstack sudo[112314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ada50094-08e1-42d2-859a-1b48e50438b9 Apr 29 15:42:31 devstack sudo[112314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:31 devstack sudo[112314]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-feaeb131-b673-4927-8344-07e66d1c8bd1 tempest-CreateVolumesFromSnapshotTest-1193587883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ada50094-08e1-42d2-859a-1b48e50438b9" returned: 0 in 0.605s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:31 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-feaeb131-b673-4927-8344-07e66d1c8bd1 tempest-CreateVolumesFromSnapshotTest-1193587883 None] <== create_volume: return (1488ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:42:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-feaeb131-b673-4927-8344-07e66d1c8bd1 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.491s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:42:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-4cd262cd-1d16-4a9b-9cf6-f3c246662d30 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.963s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:42:31 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-4cd262cd-1d16-4a9b-9cf6-f3c246662d30 tempest-CreateVolumesFromSnapshotTest-1193587883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:42:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-812979178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3257527e-22ed-45b9-ae90-df57ae741834,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc69cec5ae4a486083f88dfbeb5e2570',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:42:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:42:28Z,use_quota=True,user_id='cc0c3f24d7bc4f68b863ce492f25e005',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:42:31 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-4cd262cd-1d16-4a9b-9cf6-f3c246662d30 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Creating volume 3257527e-22ed-45b9-ae90-df57ae741834 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:42:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-4cd262cd-1d16-4a9b-9cf6-f3c246662d30 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:42:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-4cd262cd-1d16-4a9b-9cf6-f3c246662d30 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:42:31 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-4cd262cd-1d16-4a9b-9cf6-f3c246662d30 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:42:31 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-4cd262cd-1d16-4a9b-9cf6-f3c246662d30 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:42:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-4cd262cd-1d16-4a9b-9cf6-f3c246662d30 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:42:31 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-4cd262cd-1d16-4a9b-9cf6-f3c246662d30 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:42:31 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-4cd262cd-1d16-4a9b-9cf6-f3c246662d30 tempest-CreateVolumesFromSnapshotTest-1193587883 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:42:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-4cd262cd-1d16-4a9b-9cf6-f3c246662d30 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3257527e-22ed-45b9-ae90-df57ae741834 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:31 devstack sudo[112317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3257527e-22ed-45b9-ae90-df57ae741834 1073741824 Apr 29 15:42:31 devstack sudo[112317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:31 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-feaeb131-b673-4927-8344-07e66d1c8bd1 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c761880-e76b-41d2-9872-f6c110b36130) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ada50094-08e1-42d2-859a-1b48e50438b9', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:42:31 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-feaeb131-b673-4927-8344-07e66d1c8bd1 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2009c984-17c2-4266-95e9-26e005843504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:42:31 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-feaeb131-b673-4927-8344-07e66d1c8bd1 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Volume volume-ada50094-08e1-42d2-859a-1b48e50438b9 (ada50094-08e1-42d2-859a-1b48e50438b9): created successfully Apr 29 15:42:31 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-feaeb131-b673-4927-8344-07e66d1c8bd1 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2009c984-17c2-4266-95e9-26e005843504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:42:31 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-feaeb131-b673-4927-8344-07e66d1c8bd1 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Flow 'volume_create_manager' (ed7ae554-9af2-4af1-9f1e-72d6df056090) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:42:31 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-feaeb131-b673-4927-8344-07e66d1c8bd1 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Created volume successfully. Apr 29 15:42:32 devstack sudo[112317]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:32 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-4cd262cd-1d16-4a9b-9cf6-f3c246662d30 tempest-CreateVolumesFromSnapshotTest-1193587883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3257527e-22ed-45b9-ae90-df57ae741834 1073741824" returned: 0 in 0.757s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:32 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-4cd262cd-1d16-4a9b-9cf6-f3c246662d30 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3257527e-22ed-45b9-ae90-df57ae741834 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:32 devstack sudo[112322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3257527e-22ed-45b9-ae90-df57ae741834 Apr 29 15:42:32 devstack sudo[112322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:33 devstack sudo[112322]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:33 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-4cd262cd-1d16-4a9b-9cf6-f3c246662d30 tempest-CreateVolumesFromSnapshotTest-1193587883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3257527e-22ed-45b9-ae90-df57ae741834" returned: 0 in 0.604s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:33 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-4cd262cd-1d16-4a9b-9cf6-f3c246662d30 tempest-CreateVolumesFromSnapshotTest-1193587883 None] <== create_volume: return (1397ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:42:33 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-4cd262cd-1d16-4a9b-9cf6-f3c246662d30 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.400s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:42:33 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-f1f286cc-3960-41c0-8b86-c8cf7bfcba99 tempest-SnapshotDependencyTests-156111334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.976s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:42:33 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4cd262cd-1d16-4a9b-9cf6-f3c246662d30 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f70d885-f721-4a87-a57e-ae7d9a71f3d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3257527e-22ed-45b9-ae90-df57ae741834', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:42:33 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4cd262cd-1d16-4a9b-9cf6-f3c246662d30 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56f61a00-95ab-4a30-a8d2-9159a4874467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:42:33 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-f1f286cc-3960-41c0-8b86-c8cf7bfcba99 tempest-SnapshotDependencyTests-156111334 None] Creating offline snapshot 349a7af7-edda-4095-a933-fb88106c7eb0 of volume 813cc986-df45-4888-b394-bb22af18e7ca {{(pid=84448) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 15:42:33 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc01584-84c9-4b19-a22e-043aeb35afdc]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:42:33 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f1f286cc-3960-41c0-8b86-c8cf7bfcba99 tempest-SnapshotDependencyTests-156111334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-813cc986-df45-4888-b394-bb22af18e7ca {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:33 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-4cd262cd-1d16-4a9b-9cf6-f3c246662d30 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Volume volume-3257527e-22ed-45b9-ae90-df57ae741834 (3257527e-22ed-45b9-ae90-df57ae741834): created successfully Apr 29 15:42:33 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4cd262cd-1d16-4a9b-9cf6-f3c246662d30 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56f61a00-95ab-4a30-a8d2-9159a4874467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:42:33 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-4cd262cd-1d16-4a9b-9cf6-f3c246662d30 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Flow 'volume_create_manager' (7fb15b43-a4df-466a-bdd6-3aa499ed7c2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:42:33 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-4cd262cd-1d16-4a9b-9cf6-f3c246662d30 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Created volume successfully. Apr 29 15:42:33 devstack sudo[112331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-813cc986-df45-4888-b394-bb22af18e7ca Apr 29 15:42:33 devstack sudo[112331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:33 devstack sudo[112331]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:33 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f1f286cc-3960-41c0-8b86-c8cf7bfcba99 tempest-SnapshotDependencyTests-156111334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-813cc986-df45-4888-b394-bb22af18e7ca" returned: 0 in 0.706s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:33 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f1f286cc-3960-41c0-8b86-c8cf7bfcba99 tempest-SnapshotDependencyTests-156111334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-813cc986-df45-4888-b394-bb22af18e7ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-813cc986-df45-4888-b394-bb22af18e7ca.349a7af7-edda-4095-a933-fb88106c7eb0 1G {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:33 devstack sudo[112336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-813cc986-df45-4888-b394-bb22af18e7ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-813cc986-df45-4888-b394-bb22af18e7ca.349a7af7-edda-4095-a933-fb88106c7eb0 1G Apr 29 15:42:33 devstack sudo[112336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:34 devstack sudo[112336]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:34 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f1f286cc-3960-41c0-8b86-c8cf7bfcba99 tempest-SnapshotDependencyTests-156111334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-813cc986-df45-4888-b394-bb22af18e7ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-813cc986-df45-4888-b394-bb22af18e7ca.349a7af7-edda-4095-a933-fb88106c7eb0 1G" returned: 0 in 0.710s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:34 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f1f286cc-3960-41c0-8b86-c8cf7bfcba99 tempest-SnapshotDependencyTests-156111334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-813cc986-df45-4888-b394-bb22af18e7ca -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-813cc986-df45-4888-b394-bb22af18e7ca.349a7af7-edda-4095-a933-fb88106c7eb0 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:34 devstack sudo[112341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-813cc986-df45-4888-b394-bb22af18e7ca -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-813cc986-df45-4888-b394-bb22af18e7ca.349a7af7-edda-4095-a933-fb88106c7eb0 Apr 29 15:42:34 devstack sudo[112341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:35 devstack sudo[112341]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:35 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f1f286cc-3960-41c0-8b86-c8cf7bfcba99 tempest-SnapshotDependencyTests-156111334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-813cc986-df45-4888-b394-bb22af18e7ca -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-813cc986-df45-4888-b394-bb22af18e7ca.349a7af7-edda-4095-a933-fb88106c7eb0" returned: 0 in 0.618s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:35 devstack cinder-volume[84448]: WARNING cinder.volume.drivers.remotefs [None req-f1f286cc-3960-41c0-8b86-c8cf7bfcba99 tempest-SnapshotDependencyTests-156111334 None] /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-813cc986-df45-4888-b394-bb22af18e7ca.349a7af7-edda-4095-a933-fb88106c7eb0 is being set with open permissions: ugo+rw Apr 29 15:42:35 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f1f286cc-3960-41c0-8b86-c8cf7bfcba99 tempest-SnapshotDependencyTests-156111334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-813cc986-df45-4888-b394-bb22af18e7ca.349a7af7-edda-4095-a933-fb88106c7eb0 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:35 devstack sudo[112346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-813cc986-df45-4888-b394-bb22af18e7ca.349a7af7-edda-4095-a933-fb88106c7eb0 Apr 29 15:42:35 devstack sudo[112346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:35 devstack sudo[112346]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:35 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f1f286cc-3960-41c0-8b86-c8cf7bfcba99 tempest-SnapshotDependencyTests-156111334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-813cc986-df45-4888-b394-bb22af18e7ca.349a7af7-edda-4095-a933-fb88106c7eb0" returned: 0 in 0.596s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:35 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f1f286cc-3960-41c0-8b86-c8cf7bfcba99 tempest-SnapshotDependencyTests-156111334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-813cc986-df45-4888-b394-bb22af18e7ca.info {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:35 devstack sudo[112349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-813cc986-df45-4888-b394-bb22af18e7ca.info Apr 29 15:42:35 devstack sudo[112349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:36 devstack sudo[112349]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:36 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f1f286cc-3960-41c0-8b86-c8cf7bfcba99 tempest-SnapshotDependencyTests-156111334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-813cc986-df45-4888-b394-bb22af18e7ca.info" returned: 0 in 0.606s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:36 devstack cinder-volume[84448]: WARNING cinder.volume.drivers.remotefs [None req-f1f286cc-3960-41c0-8b86-c8cf7bfcba99 tempest-SnapshotDependencyTests-156111334 None] /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-813cc986-df45-4888-b394-bb22af18e7ca.info is being set with open permissions: ugo+rw Apr 29 15:42:36 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f1f286cc-3960-41c0-8b86-c8cf7bfcba99 tempest-SnapshotDependencyTests-156111334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-813cc986-df45-4888-b394-bb22af18e7ca.info {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:36 devstack sudo[112353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-813cc986-df45-4888-b394-bb22af18e7ca.info Apr 29 15:42:36 devstack sudo[112353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:36 devstack sudo[112353]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:36 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-f1f286cc-3960-41c0-8b86-c8cf7bfcba99 tempest-SnapshotDependencyTests-156111334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-813cc986-df45-4888-b394-bb22af18e7ca.info" returned: 0 in 0.586s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-f1f286cc-3960-41c0-8b86-c8cf7bfcba99 tempest-SnapshotDependencyTests-156111334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.921s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:42:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-9bfb6892-d0b6-45a4-ae4e-dff4f68d923d tempest-CreateVolumesFromSnapshotTest-1193587883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.844s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:42:37 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-9bfb6892-d0b6-45a4-ae4e-dff4f68d923d tempest-CreateVolumesFromSnapshotTest-1193587883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:42:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1978588969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7495cd47-19f7-438e-8829-98523c678178,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc69cec5ae4a486083f88dfbeb5e2570',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:42:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:42:28Z,use_quota=True,user_id='cc0c3f24d7bc4f68b863ce492f25e005',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:42:37 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-9bfb6892-d0b6-45a4-ae4e-dff4f68d923d tempest-CreateVolumesFromSnapshotTest-1193587883 None] Creating volume 7495cd47-19f7-438e-8829-98523c678178 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:42:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-9bfb6892-d0b6-45a4-ae4e-dff4f68d923d tempest-CreateVolumesFromSnapshotTest-1193587883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:42:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-9bfb6892-d0b6-45a4-ae4e-dff4f68d923d tempest-CreateVolumesFromSnapshotTest-1193587883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:42:37 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-9bfb6892-d0b6-45a4-ae4e-dff4f68d923d tempest-CreateVolumesFromSnapshotTest-1193587883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:42:37 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-9bfb6892-d0b6-45a4-ae4e-dff4f68d923d tempest-CreateVolumesFromSnapshotTest-1193587883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:42:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-9bfb6892-d0b6-45a4-ae4e-dff4f68d923d tempest-CreateVolumesFromSnapshotTest-1193587883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:42:37 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-9bfb6892-d0b6-45a4-ae4e-dff4f68d923d tempest-CreateVolumesFromSnapshotTest-1193587883 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:42:37 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-9bfb6892-d0b6-45a4-ae4e-dff4f68d923d tempest-CreateVolumesFromSnapshotTest-1193587883 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:42:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-9bfb6892-d0b6-45a4-ae4e-dff4f68d923d tempest-CreateVolumesFromSnapshotTest-1193587883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7495cd47-19f7-438e-8829-98523c678178 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:37 devstack sudo[112356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7495cd47-19f7-438e-8829-98523c678178 1073741824 Apr 29 15:42:37 devstack sudo[112356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:37 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-f1f286cc-3960-41c0-8b86-c8cf7bfcba99 tempest-SnapshotDependencyTests-156111334 None] Create snapshot completed successfully Apr 29 15:42:37 devstack sudo[112356]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-9bfb6892-d0b6-45a4-ae4e-dff4f68d923d tempest-CreateVolumesFromSnapshotTest-1193587883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7495cd47-19f7-438e-8829-98523c678178 1073741824" returned: 0 in 0.786s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:37 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-9bfb6892-d0b6-45a4-ae4e-dff4f68d923d tempest-CreateVolumesFromSnapshotTest-1193587883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7495cd47-19f7-438e-8829-98523c678178 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:37 devstack sudo[112361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7495cd47-19f7-438e-8829-98523c678178 Apr 29 15:42:37 devstack sudo[112361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:37 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e1a0fc8-c9ce-49c2-8003-39b8524c9981 tempest-SnapshotDependencyTests-156111334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:42:37 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-8e1a0fc8-c9ce-49c2-8003-39b8524c9981 tempest-SnapshotDependencyTests-156111334 None] Flow 'volume_create_manager' (c09d3b54-4055-4648-8d91-ada52d4b49fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:42:37 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-8e1a0fc8-c9ce-49c2-8003-39b8524c9981 tempest-SnapshotDependencyTests-156111334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9772384-0bd7-42a0-8642-8d01be1ca8a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:42:37 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-8e1a0fc8-c9ce-49c2-8003-39b8524c9981 tempest-SnapshotDependencyTests-156111334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9772384-0bd7-42a0-8642-8d01be1ca8a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:42:38Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcdd8ef3-e60c-4212-9aef-aa9676530e90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='735577aa5d86470db119030b97fb68d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:42:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=349a7af7-edda-4095-a933-fb88106c7eb0,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:42:38Z,use_quota=True,user_id='426714a7ceb141e1852cb9c7651c0511',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:42:37 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-8e1a0fc8-c9ce-49c2-8003-39b8524c9981 tempest-SnapshotDependencyTests-156111334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c386f61c-9281-4203-8b08-98d9b12ac0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:42:37 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-8e1a0fc8-c9ce-49c2-8003-39b8524c9981 tempest-SnapshotDependencyTests-156111334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c386f61c-9281-4203-8b08-98d9b12ac0de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:42:37 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-8e1a0fc8-c9ce-49c2-8003-39b8524c9981 tempest-SnapshotDependencyTests-156111334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bebf1845-b7ea-4915-829c-242b37d92ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:42:38 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-8e1a0fc8-c9ce-49c2-8003-39b8524c9981 tempest-SnapshotDependencyTests-156111334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bebf1845-b7ea-4915-829c-242b37d92ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fcdd8ef3-e60c-4212-9aef-aa9676530e90', 'volume_name': 'volume-fcdd8ef3-e60c-4212-9aef-aa9676530e90', 'volume_size': 1, 'snapshot_id': '349a7af7-edda-4095-a933-fb88106c7eb0'}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:42:38 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-8e1a0fc8-c9ce-49c2-8003-39b8524c9981 tempest-SnapshotDependencyTests-156111334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e3b9a42-c83b-481a-84a8-21e53ec19fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:42:38 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-8e1a0fc8-c9ce-49c2-8003-39b8524c9981 tempest-SnapshotDependencyTests-156111334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e3b9a42-c83b-481a-84a8-21e53ec19fa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:42:38 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-8e1a0fc8-c9ce-49c2-8003-39b8524c9981 tempest-SnapshotDependencyTests-156111334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf7082b3-1a8e-45c8-b173-7deb1d9194c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:42:38 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-8e1a0fc8-c9ce-49c2-8003-39b8524c9981 tempest-SnapshotDependencyTests-156111334 None] Volume fcdd8ef3-e60c-4212-9aef-aa9676530e90: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fcdd8ef3-e60c-4212-9aef-aa9676530e90', 'volume_size': 1, 'snapshot_id': '349a7af7-edda-4095-a933-fb88106c7eb0'} Apr 29 15:42:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-8e1a0fc8-c9ce-49c2-8003-39b8524c9981 tempest-SnapshotDependencyTests-156111334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:42:38 devstack sudo[112361]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-9bfb6892-d0b6-45a4-ae4e-dff4f68d923d tempest-CreateVolumesFromSnapshotTest-1193587883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7495cd47-19f7-438e-8829-98523c678178" returned: 0 in 0.602s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:38 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-9bfb6892-d0b6-45a4-ae4e-dff4f68d923d tempest-CreateVolumesFromSnapshotTest-1193587883 None] <== create_volume: return (1429ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:42:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-9bfb6892-d0b6-45a4-ae4e-dff4f68d923d tempest-CreateVolumesFromSnapshotTest-1193587883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.432s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:42:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-8e1a0fc8-c9ce-49c2-8003-39b8524c9981 tempest-SnapshotDependencyTests-156111334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.423s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:42:38 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-8e1a0fc8-c9ce-49c2-8003-39b8524c9981 tempest-SnapshotDependencyTests-156111334 None] Acquiring lock "cinder-quobyte-349a7af7-edda-4095-a933-fb88106c7eb0-fcdd8ef3-e60c-4212-9aef-aa9676530e90" by "_create_volume_from_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:42:38 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-9bfb6892-d0b6-45a4-ae4e-dff4f68d923d tempest-CreateVolumesFromSnapshotTest-1193587883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06d4acec-7e31-4a9f-94a1-75992675405f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7495cd47-19f7-438e-8829-98523c678178', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:42:38 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-9bfb6892-d0b6-45a4-ae4e-dff4f68d923d tempest-CreateVolumesFromSnapshotTest-1193587883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dce57c00-288a-4592-919d-37a6c2f81db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:42:38 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-8e1a0fc8-c9ce-49c2-8003-39b8524c9981 tempest-SnapshotDependencyTests-156111334 None] Lock "cinder-quobyte-349a7af7-edda-4095-a933-fb88106c7eb0-fcdd8ef3-e60c-4212-9aef-aa9676530e90" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:42:38 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-8e1a0fc8-c9ce-49c2-8003-39b8524c9981 tempest-SnapshotDependencyTests-156111334 None] Creating volume fcdd8ef3-e60c-4212-9aef-aa9676530e90 from snapshot 349a7af7-edda-4095-a933-fb88106c7eb0 {{(pid=84448) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 15:42:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-8e1a0fc8-c9ce-49c2-8003-39b8524c9981 tempest-SnapshotDependencyTests-156111334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:42:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-8e1a0fc8-c9ce-49c2-8003-39b8524c9981 tempest-SnapshotDependencyTests-156111334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:42:38 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-8e1a0fc8-c9ce-49c2-8003-39b8524c9981 tempest-SnapshotDependencyTests-156111334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:42:38 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-8e1a0fc8-c9ce-49c2-8003-39b8524c9981 tempest-SnapshotDependencyTests-156111334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:42:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-8e1a0fc8-c9ce-49c2-8003-39b8524c9981 tempest-SnapshotDependencyTests-156111334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:42:38 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-8e1a0fc8-c9ce-49c2-8003-39b8524c9981 tempest-SnapshotDependencyTests-156111334 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:42:38 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-8e1a0fc8-c9ce-49c2-8003-39b8524c9981 tempest-SnapshotDependencyTests-156111334 None] Acquiring lock "cinder-quobyte-fcdd8ef3-e60c-4212-9aef-aa9676530e90" by "_copy_volume_from_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:42:38 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-9bfb6892-d0b6-45a4-ae4e-dff4f68d923d tempest-CreateVolumesFromSnapshotTest-1193587883 None] Volume volume-7495cd47-19f7-438e-8829-98523c678178 (7495cd47-19f7-438e-8829-98523c678178): created successfully Apr 29 15:42:38 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-9bfb6892-d0b6-45a4-ae4e-dff4f68d923d tempest-CreateVolumesFromSnapshotTest-1193587883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dce57c00-288a-4592-919d-37a6c2f81db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:42:38 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-9bfb6892-d0b6-45a4-ae4e-dff4f68d923d tempest-CreateVolumesFromSnapshotTest-1193587883 None] Flow 'volume_create_manager' (7afa22ad-6109-4003-ac45-03f7cfbeada0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:42:38 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-8e1a0fc8-c9ce-49c2-8003-39b8524c9981 tempest-SnapshotDependencyTests-156111334 None] Lock "cinder-quobyte-fcdd8ef3-e60c-4212-9aef-aa9676530e90" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:42:38 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-8e1a0fc8-c9ce-49c2-8003-39b8524c9981 tempest-SnapshotDependencyTests-156111334 None] snapshot: 349a7af7-edda-4095-a933-fb88106c7eb0, volume: fcdd8ef3-e60c-4212-9aef-aa9676530e90, {{(pid=84448) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 15:42:38 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-9bfb6892-d0b6-45a4-ae4e-dff4f68d923d tempest-CreateVolumesFromSnapshotTest-1193587883 None] Created volume successfully. Apr 29 15:42:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-8e1a0fc8-c9ce-49c2-8003-39b8524c9981 tempest-SnapshotDependencyTests-156111334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:42:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-8e1a0fc8-c9ce-49c2-8003-39b8524c9981 tempest-SnapshotDependencyTests-156111334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:42:38 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-8e1a0fc8-c9ce-49c2-8003-39b8524c9981 tempest-SnapshotDependencyTests-156111334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:42:38 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-8e1a0fc8-c9ce-49c2-8003-39b8524c9981 tempest-SnapshotDependencyTests-156111334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:42:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-8e1a0fc8-c9ce-49c2-8003-39b8524c9981 tempest-SnapshotDependencyTests-156111334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:42:38 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[94067326-7b0f-4710-a703-6bd5642f42e4]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:42:38 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-8e1a0fc8-c9ce-49c2-8003-39b8524c9981 tempest-SnapshotDependencyTests-156111334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-813cc986-df45-4888-b394-bb22af18e7ca.349a7af7-edda-4095-a933-fb88106c7eb0 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:38 devstack sudo[112364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-813cc986-df45-4888-b394-bb22af18e7ca.349a7af7-edda-4095-a933-fb88106c7eb0 Apr 29 15:42:38 devstack sudo[112364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:38 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-9e15c177-fe98-4122-8236-9ed7293c785b tempest-CreateVolumesFromSnapshotTest-1193587883 None] Acquiring lock "cinder-7495cd47-19f7-438e-8829-98523c678178-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:42:38 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-9e15c177-fe98-4122-8236-9ed7293c785b tempest-CreateVolumesFromSnapshotTest-1193587883 None] Lock "cinder-7495cd47-19f7-438e-8829-98523c678178-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:42:39 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-9e15c177-fe98-4122-8236-9ed7293c785b tempest-CreateVolumesFromSnapshotTest-1193587883 None] Acquiring lock "cinder-quobyte-7495cd47-19f7-438e-8829-98523c678178" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:42:39 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-9e15c177-fe98-4122-8236-9ed7293c785b tempest-CreateVolumesFromSnapshotTest-1193587883 None] Lock "cinder-quobyte-7495cd47-19f7-438e-8829-98523c678178" acquired by "delete_volume" :: waited 0.015s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:42:39 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe64a105-5f21-483d-81c5-c5b21a456ec1]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:42:39 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-9e15c177-fe98-4122-8236-9ed7293c785b tempest-CreateVolumesFromSnapshotTest-1193587883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7495cd47-19f7-438e-8829-98523c678178 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:39 devstack sudo[112366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7495cd47-19f7-438e-8829-98523c678178 Apr 29 15:42:39 devstack sudo[112366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:39 devstack sudo[112364]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:39 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-8e1a0fc8-c9ce-49c2-8003-39b8524c9981 tempest-SnapshotDependencyTests-156111334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-813cc986-df45-4888-b394-bb22af18e7ca.349a7af7-edda-4095-a933-fb88106c7eb0" returned: 0 in 0.742s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:39 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-8e1a0fc8-c9ce-49c2-8003-39b8524c9981 tempest-SnapshotDependencyTests-156111334 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-813cc986-df45-4888-b394-bb22af18e7ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84448) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 15:42:39 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-8e1a0fc8-c9ce-49c2-8003-39b8524c9981 tempest-SnapshotDependencyTests-156111334 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-813cc986-df45-4888-b394-bb22af18e7ca {{(pid=84448) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 15:42:39 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-8e1a0fc8-c9ce-49c2-8003-39b8524c9981 tempest-SnapshotDependencyTests-156111334 None] Creating direct copy from snapshot {{(pid=84448) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 15:42:39 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[454f67a8-a0ad-4824-bed7-1df16323bcc9]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:42:39 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-8e1a0fc8-c9ce-49c2-8003-39b8524c9981 tempest-SnapshotDependencyTests-156111334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-813cc986-df45-4888-b394-bb22af18e7ca {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:39 devstack sudo[112372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-813cc986-df45-4888-b394-bb22af18e7ca Apr 29 15:42:39 devstack sudo[112372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:39 devstack sudo[112366]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:39 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-9e15c177-fe98-4122-8236-9ed7293c785b tempest-CreateVolumesFromSnapshotTest-1193587883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7495cd47-19f7-438e-8829-98523c678178" returned: 0 in 0.721s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:39 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-9e15c177-fe98-4122-8236-9ed7293c785b tempest-CreateVolumesFromSnapshotTest-1193587883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7495cd47-19f7-438e-8829-98523c678178 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:39 devstack sudo[112377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7495cd47-19f7-438e-8829-98523c678178 Apr 29 15:42:39 devstack sudo[112377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:40 devstack sudo[112372]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:40 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-8e1a0fc8-c9ce-49c2-8003-39b8524c9981 tempest-SnapshotDependencyTests-156111334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-813cc986-df45-4888-b394-bb22af18e7ca" returned: 0 in 0.765s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:40 devstack cinder-volume[84448]: DEBUG cinder.utils [None req-8e1a0fc8-c9ce-49c2-8003-39b8524c9981 tempest-SnapshotDependencyTests-156111334 None] Path /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-fcdd8ef3-e60c-4212-9aef-aa9676530e90 not found in is_blk_device check {{(pid=84448) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 15:42:40 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-8e1a0fc8-c9ce-49c2-8003-39b8524c9981 tempest-SnapshotDependencyTests-156111334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-813cc986-df45-4888-b394-bb22af18e7ca /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-fcdd8ef3-e60c-4212-9aef-aa9676530e90 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:40 devstack sudo[112416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-813cc986-df45-4888-b394-bb22af18e7ca /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-fcdd8ef3-e60c-4212-9aef-aa9676530e90 Apr 29 15:42:40 devstack sudo[112416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:40 devstack sudo[112377]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:40 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-9e15c177-fe98-4122-8236-9ed7293c785b tempest-CreateVolumesFromSnapshotTest-1193587883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-7495cd47-19f7-438e-8829-98523c678178" returned: 0 in 0.673s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:40 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-9e15c177-fe98-4122-8236-9ed7293c785b tempest-CreateVolumesFromSnapshotTest-1193587883 None] Lock "cinder-quobyte-7495cd47-19f7-438e-8829-98523c678178" released by "delete_volume" :: held 1.440s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:42:40 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-9e15c177-fe98-4122-8236-9ed7293c785b tempest-CreateVolumesFromSnapshotTest-1193587883 None] Created reservations ['5e2143d6-313c-423f-af22-d8c7d250227f', '7babcab4-cfb7-425b-be8e-9b71eb4b4525', '870033a0-75da-4f73-b0b2-1f8cf81f734f', 'a2557ddb-69b5-4bae-9182-c7a3b511fd94'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:42:40 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-9e15c177-fe98-4122-8236-9ed7293c785b tempest-CreateVolumesFromSnapshotTest-1193587883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:42:40 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-9e15c177-fe98-4122-8236-9ed7293c785b tempest-CreateVolumesFromSnapshotTest-1193587883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:42:40 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-9e15c177-fe98-4122-8236-9ed7293c785b tempest-CreateVolumesFromSnapshotTest-1193587883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:42:40 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-9e15c177-fe98-4122-8236-9ed7293c785b tempest-CreateVolumesFromSnapshotTest-1193587883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:42:40 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-9e15c177-fe98-4122-8236-9ed7293c785b tempest-CreateVolumesFromSnapshotTest-1193587883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:42:40 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-9e15c177-fe98-4122-8236-9ed7293c785b tempest-CreateVolumesFromSnapshotTest-1193587883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:40 devstack sudo[112421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:42:40 devstack sudo[112421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:41 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-05106ac1-8ee3-42de-9a4e-3e3a130547da tempest-CreateVolumesFromSnapshotTest-1193587883 None] Acquiring lock "cinder-3257527e-22ed-45b9-ae90-df57ae741834-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:42:41 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-05106ac1-8ee3-42de-9a4e-3e3a130547da tempest-CreateVolumesFromSnapshotTest-1193587883 None] Lock "cinder-3257527e-22ed-45b9-ae90-df57ae741834-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:42:41 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-05106ac1-8ee3-42de-9a4e-3e3a130547da tempest-CreateVolumesFromSnapshotTest-1193587883 None] Acquiring lock "cinder-quobyte-3257527e-22ed-45b9-ae90-df57ae741834" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:42:41 devstack sudo[112421]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-9e15c177-fe98-4122-8236-9ed7293c785b tempest-CreateVolumesFromSnapshotTest-1193587883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.931s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:41 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-9e15c177-fe98-4122-8236-9ed7293c785b tempest-CreateVolumesFromSnapshotTest-1193587883 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:42:41 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-05106ac1-8ee3-42de-9a4e-3e3a130547da tempest-CreateVolumesFromSnapshotTest-1193587883 None] Lock "cinder-quobyte-3257527e-22ed-45b9-ae90-df57ae741834" acquired by "delete_volume" :: waited 0.032s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:42:41 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-9e15c177-fe98-4122-8236-9ed7293c785b tempest-CreateVolumesFromSnapshotTest-1193587883 None] Deleted volume successfully. Apr 29 15:42:41 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[f71880d2-ffb3-4112-a39f-b7f7cde4974c]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:42:41 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-05106ac1-8ee3-42de-9a4e-3e3a130547da tempest-CreateVolumesFromSnapshotTest-1193587883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3257527e-22ed-45b9-ae90-df57ae741834 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:41 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-9e15c177-fe98-4122-8236-9ed7293c785b tempest-CreateVolumesFromSnapshotTest-1193587883 None] Lock "cinder-7495cd47-19f7-438e-8829-98523c678178-delete_volume" released by "delete_volume" :: held 2.659s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:42:41 devstack sudo[112435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3257527e-22ed-45b9-ae90-df57ae741834 Apr 29 15:42:41 devstack sudo[112435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:42 devstack sudo[112435]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:42 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-05106ac1-8ee3-42de-9a4e-3e3a130547da tempest-CreateVolumesFromSnapshotTest-1193587883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3257527e-22ed-45b9-ae90-df57ae741834" returned: 0 in 1.312s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:42 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-05106ac1-8ee3-42de-9a4e-3e3a130547da tempest-CreateVolumesFromSnapshotTest-1193587883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3257527e-22ed-45b9-ae90-df57ae741834 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:42 devstack sudo[112442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3257527e-22ed-45b9-ae90-df57ae741834 Apr 29 15:42:42 devstack sudo[112442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:44 devstack sudo[112442]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:44 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-05106ac1-8ee3-42de-9a4e-3e3a130547da tempest-CreateVolumesFromSnapshotTest-1193587883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3257527e-22ed-45b9-ae90-df57ae741834" returned: 0 in 1.520s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:44 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-05106ac1-8ee3-42de-9a4e-3e3a130547da tempest-CreateVolumesFromSnapshotTest-1193587883 None] Lock "cinder-quobyte-3257527e-22ed-45b9-ae90-df57ae741834" released by "delete_volume" :: held 2.931s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:42:44 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-05106ac1-8ee3-42de-9a4e-3e3a130547da tempest-CreateVolumesFromSnapshotTest-1193587883 None] Created reservations ['be57b22b-dcd7-4994-ba9a-df196c57774c', 'a967a6e6-f9c9-42c1-b9d5-488751445bf2', 'cc2aa421-5e33-4226-879d-56159a45faa2', '4d0909e2-7397-402c-86c9-f37992c90ab9'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:42:44 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-05106ac1-8ee3-42de-9a4e-3e3a130547da tempest-CreateVolumesFromSnapshotTest-1193587883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:42:44 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-05106ac1-8ee3-42de-9a4e-3e3a130547da tempest-CreateVolumesFromSnapshotTest-1193587883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:42:44 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-05106ac1-8ee3-42de-9a4e-3e3a130547da tempest-CreateVolumesFromSnapshotTest-1193587883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:42:44 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-05106ac1-8ee3-42de-9a4e-3e3a130547da tempest-CreateVolumesFromSnapshotTest-1193587883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:42:44 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-05106ac1-8ee3-42de-9a4e-3e3a130547da tempest-CreateVolumesFromSnapshotTest-1193587883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:42:44 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-05106ac1-8ee3-42de-9a4e-3e3a130547da tempest-CreateVolumesFromSnapshotTest-1193587883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:44 devstack sudo[112445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:42:44 devstack sudo[112445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:45 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-23ed74dd-2355-40b1-993d-28480258ae71 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Acquiring lock "cinder-ada50094-08e1-42d2-859a-1b48e50438b9-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:42:45 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-23ed74dd-2355-40b1-993d-28480258ae71 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Lock "cinder-ada50094-08e1-42d2-859a-1b48e50438b9-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:42:45 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-23ed74dd-2355-40b1-993d-28480258ae71 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Acquiring lock "cinder-quobyte-ada50094-08e1-42d2-859a-1b48e50438b9" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:42:45 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-23ed74dd-2355-40b1-993d-28480258ae71 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Lock "cinder-quobyte-ada50094-08e1-42d2-859a-1b48e50438b9" acquired by "delete_volume" :: waited 0.065s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:42:45 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d42fab-ce99-4bc3-b7b6-ee3e41195cc0]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:42:45 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-23ed74dd-2355-40b1-993d-28480258ae71 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ada50094-08e1-42d2-859a-1b48e50438b9 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:45 devstack sudo[112447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ada50094-08e1-42d2-859a-1b48e50438b9 Apr 29 15:42:45 devstack sudo[112447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:45 devstack sudo[112416]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:45 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-8e1a0fc8-c9ce-49c2-8003-39b8524c9981 tempest-SnapshotDependencyTests-156111334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-813cc986-df45-4888-b394-bb22af18e7ca /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-fcdd8ef3-e60c-4212-9aef-aa9676530e90" returned: 0 in 5.569s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:45 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[f398323b-8f75-43ab-945b-000ea1fa4775]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:42:45 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-8e1a0fc8-c9ce-49c2-8003-39b8524c9981 tempest-SnapshotDependencyTests-156111334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-813cc986-df45-4888-b394-bb22af18e7ca {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:45 devstack sudo[112445]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:45 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-05106ac1-8ee3-42de-9a4e-3e3a130547da tempest-CreateVolumesFromSnapshotTest-1193587883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 1.109s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:45 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-05106ac1-8ee3-42de-9a4e-3e3a130547da tempest-CreateVolumesFromSnapshotTest-1193587883 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:42:45 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-05106ac1-8ee3-42de-9a4e-3e3a130547da tempest-CreateVolumesFromSnapshotTest-1193587883 None] Deleted volume successfully. Apr 29 15:42:45 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-05106ac1-8ee3-42de-9a4e-3e3a130547da tempest-CreateVolumesFromSnapshotTest-1193587883 None] Lock "cinder-3257527e-22ed-45b9-ae90-df57ae741834-delete_volume" released by "delete_volume" :: held 4.445s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:42:45 devstack sudo[112450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-813cc986-df45-4888-b394-bb22af18e7ca Apr 29 15:42:45 devstack sudo[112450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:46 devstack sudo[112447]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:46 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-23ed74dd-2355-40b1-993d-28480258ae71 tempest-CreateVolumesFromSnapshotTest-1193587883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ada50094-08e1-42d2-859a-1b48e50438b9" returned: 0 in 0.910s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:46 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-23ed74dd-2355-40b1-993d-28480258ae71 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ada50094-08e1-42d2-859a-1b48e50438b9 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:46 devstack sudo[112455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ada50094-08e1-42d2-859a-1b48e50438b9 Apr 29 15:42:46 devstack sudo[112455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:46 devstack sudo[112450]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:46 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-8e1a0fc8-c9ce-49c2-8003-39b8524c9981 tempest-SnapshotDependencyTests-156111334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-813cc986-df45-4888-b394-bb22af18e7ca" returned: 0 in 0.914s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:46 devstack cinder-volume[84448]: DEBUG cinder.image.image_utils [None req-8e1a0fc8-c9ce-49c2-8003-39b8524c9981 tempest-SnapshotDependencyTests-156111334 None] Image conversion details: src /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-813cc986-df45-4888-b394-bb22af18e7ca, size 1024.00 MB, duration 5.57 sec, destination /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-fcdd8ef3-e60c-4212-9aef-aa9676530e90 {{(pid=84448) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 15:42:46 devstack cinder-volume[84448]: INFO cinder.image.image_utils [None req-8e1a0fc8-c9ce-49c2-8003-39b8524c9981 tempest-SnapshotDependencyTests-156111334 None] Converted 1024.00 MB image at 183.82 MB/s Apr 29 15:42:46 devstack cinder-volume[84448]: WARNING cinder.volume.drivers.remotefs [None req-8e1a0fc8-c9ce-49c2-8003-39b8524c9981 tempest-SnapshotDependencyTests-156111334 None] /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-fcdd8ef3-e60c-4212-9aef-aa9676530e90 is being set with open permissions: ugo+rw Apr 29 15:42:46 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-8e1a0fc8-c9ce-49c2-8003-39b8524c9981 tempest-SnapshotDependencyTests-156111334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-fcdd8ef3-e60c-4212-9aef-aa9676530e90 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:46 devstack sudo[112461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-fcdd8ef3-e60c-4212-9aef-aa9676530e90 Apr 29 15:42:46 devstack sudo[112461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:46 devstack sudo[112455]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:46 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-23ed74dd-2355-40b1-993d-28480258ae71 tempest-CreateVolumesFromSnapshotTest-1193587883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ada50094-08e1-42d2-859a-1b48e50438b9" returned: 0 in 0.630s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:46 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-23ed74dd-2355-40b1-993d-28480258ae71 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Lock "cinder-quobyte-ada50094-08e1-42d2-859a-1b48e50438b9" released by "delete_volume" :: held 1.652s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:42:47 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-23ed74dd-2355-40b1-993d-28480258ae71 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Created reservations ['e7f0a281-aee1-4f27-b958-5412058cf344', 'f30a224f-70f8-42f4-8a08-095ab3923d6e', '13554dc9-66ed-47f4-9271-bfc97175d74f', '4d1b41ce-27c5-4edc-ba7c-8f4ed7e4342b'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:42:47 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-23ed74dd-2355-40b1-993d-28480258ae71 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:42:47 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-23ed74dd-2355-40b1-993d-28480258ae71 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:42:47 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-23ed74dd-2355-40b1-993d-28480258ae71 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:42:47 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-23ed74dd-2355-40b1-993d-28480258ae71 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:42:47 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-23ed74dd-2355-40b1-993d-28480258ae71 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:42:47 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-23ed74dd-2355-40b1-993d-28480258ae71 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:47 devstack sudo[112464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:42:47 devstack sudo[112464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:47 devstack sudo[112461]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:47 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-8e1a0fc8-c9ce-49c2-8003-39b8524c9981 tempest-SnapshotDependencyTests-156111334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-fcdd8ef3-e60c-4212-9aef-aa9676530e90" returned: 0 in 0.591s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:47 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-8e1a0fc8-c9ce-49c2-8003-39b8524c9981 tempest-SnapshotDependencyTests-156111334 None] Lock "cinder-quobyte-fcdd8ef3-e60c-4212-9aef-aa9676530e90" released by "_copy_volume_from_snapshot" :: held 8.739s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:42:47 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-8e1a0fc8-c9ce-49c2-8003-39b8524c9981 tempest-SnapshotDependencyTests-156111334 None] Lock "cinder-quobyte-349a7af7-edda-4095-a933-fb88106c7eb0-fcdd8ef3-e60c-4212-9aef-aa9676530e90" released by "_create_volume_from_snapshot" :: held 8.784s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:42:47 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-8e1a0fc8-c9ce-49c2-8003-39b8524c9981 tempest-SnapshotDependencyTests-156111334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.819s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:42:47 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-8e1a0fc8-c9ce-49c2-8003-39b8524c9981 tempest-SnapshotDependencyTests-156111334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf7082b3-1a8e-45c8-b173-7deb1d9194c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcdd8ef3-e60c-4212-9aef-aa9676530e90', 'volume_size': 1, 'snapshot_id': '349a7af7-edda-4095-a933-fb88106c7eb0'}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:42:47 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-8e1a0fc8-c9ce-49c2-8003-39b8524c9981 tempest-SnapshotDependencyTests-156111334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (453d1602-02d4-4a3a-a5cc-0b8d3d235a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:42:47 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-8e1a0fc8-c9ce-49c2-8003-39b8524c9981 tempest-SnapshotDependencyTests-156111334 None] Volume volume-fcdd8ef3-e60c-4212-9aef-aa9676530e90 (fcdd8ef3-e60c-4212-9aef-aa9676530e90): created successfully Apr 29 15:42:47 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-8e1a0fc8-c9ce-49c2-8003-39b8524c9981 tempest-SnapshotDependencyTests-156111334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (453d1602-02d4-4a3a-a5cc-0b8d3d235a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:42:47 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-8e1a0fc8-c9ce-49c2-8003-39b8524c9981 tempest-SnapshotDependencyTests-156111334 None] Flow 'volume_create_manager' (c09d3b54-4055-4648-8d91-ada52d4b49fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:42:47 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-8e1a0fc8-c9ce-49c2-8003-39b8524c9981 tempest-SnapshotDependencyTests-156111334 None] Created volume successfully. Apr 29 15:42:47 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-15a115a2-b4dd-44d1-b8f6-5f29639bdaa3 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Acquiring lock "cinder-3e808535-78fb-4a50-b3fd-88227df756fc-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:42:47 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-15a115a2-b4dd-44d1-b8f6-5f29639bdaa3 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Lock "cinder-3e808535-78fb-4a50-b3fd-88227df756fc-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:42:47 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-15a115a2-b4dd-44d1-b8f6-5f29639bdaa3 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Acquiring lock "cinder-quobyte-3e808535-78fb-4a50-b3fd-88227df756fc" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:42:47 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-15a115a2-b4dd-44d1-b8f6-5f29639bdaa3 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Lock "cinder-quobyte-3e808535-78fb-4a50-b3fd-88227df756fc" acquired by "delete_volume" :: waited 0.017s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:42:47 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[760c5231-9d98-42db-89f0-d9a8b68cf49f]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:42:47 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-15a115a2-b4dd-44d1-b8f6-5f29639bdaa3 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3e808535-78fb-4a50-b3fd-88227df756fc {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:47 devstack sudo[112467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3e808535-78fb-4a50-b3fd-88227df756fc Apr 29 15:42:47 devstack sudo[112467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:47 devstack sudo[112464]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:47 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-23ed74dd-2355-40b1-993d-28480258ae71 tempest-CreateVolumesFromSnapshotTest-1193587883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.635s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:47 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-23ed74dd-2355-40b1-993d-28480258ae71 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:42:47 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-23ed74dd-2355-40b1-993d-28480258ae71 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Deleted volume successfully. Apr 29 15:42:47 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-23ed74dd-2355-40b1-993d-28480258ae71 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Lock "cinder-ada50094-08e1-42d2-859a-1b48e50438b9-delete_volume" released by "delete_volume" :: held 2.594s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:42:48 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a6ba6bf0-a4d0-43bc-ba57-cef12bd629ed tempest-SnapshotDependencyTests-156111334 None] Acquiring lock "cinder-349a7af7-edda-4095-a933-fb88106c7eb0-delete_snapshot" by "delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:42:48 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a6ba6bf0-a4d0-43bc-ba57-cef12bd629ed tempest-SnapshotDependencyTests-156111334 None] Lock "cinder-349a7af7-edda-4095-a933-fb88106c7eb0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:42:48 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a6ba6bf0-a4d0-43bc-ba57-cef12bd629ed tempest-SnapshotDependencyTests-156111334 None] Acquiring lock "cinder-quobyte-813cc986-df45-4888-b394-bb22af18e7ca" by "delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:42:48 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a6ba6bf0-a4d0-43bc-ba57-cef12bd629ed tempest-SnapshotDependencyTests-156111334 None] Lock "cinder-quobyte-813cc986-df45-4888-b394-bb22af18e7ca" acquired by "delete_snapshot" :: waited 0.017s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:42:48 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a6ba6bf0-a4d0-43bc-ba57-cef12bd629ed tempest-SnapshotDependencyTests-156111334 None] Acquiring lock "cinder-quobyte-349a7af7-edda-4095-a933-fb88106c7eb0" by "_delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:42:48 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a6ba6bf0-a4d0-43bc-ba57-cef12bd629ed tempest-SnapshotDependencyTests-156111334 None] Lock "cinder-quobyte-349a7af7-edda-4095-a933-fb88106c7eb0" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:42:48 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-a6ba6bf0-a4d0-43bc-ba57-cef12bd629ed tempest-SnapshotDependencyTests-156111334 None] Deleting offline snapshot 349a7af7-edda-4095-a933-fb88106c7eb0 of volume 813cc986-df45-4888-b394-bb22af18e7ca {{(pid=84448) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 15:42:48 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-a6ba6bf0-a4d0-43bc-ba57-cef12bd629ed tempest-SnapshotDependencyTests-156111334 None] snapshot_file for this snap is: volume-813cc986-df45-4888-b394-bb22af18e7ca.349a7af7-edda-4095-a933-fb88106c7eb0 {{(pid=84448) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 15:42:48 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f4f8d5-85b9-4d42-99af-0cd252497569]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:42:48 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a6ba6bf0-a4d0-43bc-ba57-cef12bd629ed tempest-SnapshotDependencyTests-156111334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-813cc986-df45-4888-b394-bb22af18e7ca.349a7af7-edda-4095-a933-fb88106c7eb0 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:48 devstack sudo[112470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-813cc986-df45-4888-b394-bb22af18e7ca.349a7af7-edda-4095-a933-fb88106c7eb0 Apr 29 15:42:48 devstack sudo[112470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:48 devstack sudo[112467]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:48 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-15a115a2-b4dd-44d1-b8f6-5f29639bdaa3 tempest-CreateVolumesFromSnapshotTest-1193587883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3e808535-78fb-4a50-b3fd-88227df756fc" returned: 0 in 0.742s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:48 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-15a115a2-b4dd-44d1-b8f6-5f29639bdaa3 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3e808535-78fb-4a50-b3fd-88227df756fc {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:48 devstack sudo[112475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3e808535-78fb-4a50-b3fd-88227df756fc Apr 29 15:42:48 devstack sudo[112475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:48 devstack sudo[112470]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:48 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a6ba6bf0-a4d0-43bc-ba57-cef12bd629ed tempest-SnapshotDependencyTests-156111334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-813cc986-df45-4888-b394-bb22af18e7ca.349a7af7-edda-4095-a933-fb88106c7eb0" returned: 0 in 0.733s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:48 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-a6ba6bf0-a4d0-43bc-ba57-cef12bd629ed tempest-SnapshotDependencyTests-156111334 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-813cc986-df45-4888-b394-bb22af18e7ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84448) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 15:42:48 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[390ad66f-d0d0-4e64-911c-c708e4af41ff]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:42:48 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a6ba6bf0-a4d0-43bc-ba57-cef12bd629ed tempest-SnapshotDependencyTests-156111334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-813cc986-df45-4888-b394-bb22af18e7ca {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:48 devstack sudo[112475]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:48 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-15a115a2-b4dd-44d1-b8f6-5f29639bdaa3 tempest-CreateVolumesFromSnapshotTest-1193587883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-3e808535-78fb-4a50-b3fd-88227df756fc" returned: 0 in 0.630s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:48 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-15a115a2-b4dd-44d1-b8f6-5f29639bdaa3 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Lock "cinder-quobyte-3e808535-78fb-4a50-b3fd-88227df756fc" released by "delete_volume" :: held 1.414s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:42:48 devstack sudo[112481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-813cc986-df45-4888-b394-bb22af18e7ca Apr 29 15:42:48 devstack sudo[112481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:49 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-15a115a2-b4dd-44d1-b8f6-5f29639bdaa3 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Created reservations ['977db4f8-eae8-442b-bf49-c8216d2be4ab', '7ae55045-8d0a-41f9-86b6-acc35b463e45', 'da757923-0ba3-4ccd-b505-7c7c593f1027', '2135f10b-c25f-4a43-9ab5-310830423587'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:42:49 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-15a115a2-b4dd-44d1-b8f6-5f29639bdaa3 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:42:49 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-15a115a2-b4dd-44d1-b8f6-5f29639bdaa3 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:42:49 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-15a115a2-b4dd-44d1-b8f6-5f29639bdaa3 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:42:49 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-15a115a2-b4dd-44d1-b8f6-5f29639bdaa3 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:42:49 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-15a115a2-b4dd-44d1-b8f6-5f29639bdaa3 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:42:49 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-15a115a2-b4dd-44d1-b8f6-5f29639bdaa3 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:49 devstack sudo[112483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:42:49 devstack sudo[112483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:49 devstack sudo[112481]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:49 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a6ba6bf0-a4d0-43bc-ba57-cef12bd629ed tempest-SnapshotDependencyTests-156111334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-813cc986-df45-4888-b394-bb22af18e7ca" returned: 0 in 0.730s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:49 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a6ba6bf0-a4d0-43bc-ba57-cef12bd629ed tempest-SnapshotDependencyTests-156111334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-813cc986-df45-4888-b394-bb22af18e7ca.349a7af7-edda-4095-a933-fb88106c7eb0 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:49 devstack sudo[112489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-813cc986-df45-4888-b394-bb22af18e7ca.349a7af7-edda-4095-a933-fb88106c7eb0 Apr 29 15:42:49 devstack sudo[112489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:49 devstack sudo[112483]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:49 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-15a115a2-b4dd-44d1-b8f6-5f29639bdaa3 tempest-CreateVolumesFromSnapshotTest-1193587883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.608s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:49 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-15a115a2-b4dd-44d1-b8f6-5f29639bdaa3 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:42:49 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-15a115a2-b4dd-44d1-b8f6-5f29639bdaa3 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Deleted volume successfully. Apr 29 15:42:49 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-06cec7e1-926e-4136-8e96-640744646d20 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Acquiring lock "cinder-2a83e4c0-3bd5-4dd5-8ebd-58a51a2e53c8-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:42:49 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-06cec7e1-926e-4136-8e96-640744646d20 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Lock "cinder-2a83e4c0-3bd5-4dd5-8ebd-58a51a2e53c8-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:42:49 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-15a115a2-b4dd-44d1-b8f6-5f29639bdaa3 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Lock "cinder-3e808535-78fb-4a50-b3fd-88227df756fc-delete_volume" released by "delete_volume" :: held 2.259s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:42:49 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-06cec7e1-926e-4136-8e96-640744646d20 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Acquiring lock "cinder-quobyte-2a83e4c0-3bd5-4dd5-8ebd-58a51a2e53c8" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:42:49 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-06cec7e1-926e-4136-8e96-640744646d20 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Lock "cinder-quobyte-2a83e4c0-3bd5-4dd5-8ebd-58a51a2e53c8" acquired by "delete_volume" :: waited 0.013s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:42:49 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[51be0954-132a-4087-bcfb-8deb7d1d2632]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:42:49 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-06cec7e1-926e-4136-8e96-640744646d20 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2a83e4c0-3bd5-4dd5-8ebd-58a51a2e53c8 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:49 devstack sudo[112491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2a83e4c0-3bd5-4dd5-8ebd-58a51a2e53c8 Apr 29 15:42:49 devstack sudo[112491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:50 devstack sudo[112489]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a6ba6bf0-a4d0-43bc-ba57-cef12bd629ed tempest-SnapshotDependencyTests-156111334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-813cc986-df45-4888-b394-bb22af18e7ca.349a7af7-edda-4095-a933-fb88106c7eb0" returned: 0 in 0.726s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a6ba6bf0-a4d0-43bc-ba57-cef12bd629ed tempest-SnapshotDependencyTests-156111334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-813cc986-df45-4888-b394-bb22af18e7ca.349a7af7-edda-4095-a933-fb88106c7eb0 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:50 devstack sudo[112496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-813cc986-df45-4888-b394-bb22af18e7ca.349a7af7-edda-4095-a933-fb88106c7eb0 Apr 29 15:42:50 devstack sudo[112496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:50 devstack sudo[112491]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-06cec7e1-926e-4136-8e96-640744646d20 tempest-CreateVolumesFromSnapshotTest-1193587883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2a83e4c0-3bd5-4dd5-8ebd-58a51a2e53c8" returned: 0 in 0.767s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-06cec7e1-926e-4136-8e96-640744646d20 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2a83e4c0-3bd5-4dd5-8ebd-58a51a2e53c8 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:50 devstack sudo[112501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2a83e4c0-3bd5-4dd5-8ebd-58a51a2e53c8 Apr 29 15:42:50 devstack sudo[112501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:50 devstack sudo[112496]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:50 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-a6ba6bf0-a4d0-43bc-ba57-cef12bd629ed tempest-SnapshotDependencyTests-156111334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-813cc986-df45-4888-b394-bb22af18e7ca.349a7af7-edda-4095-a933-fb88106c7eb0" returned: 0 in 0.611s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:51 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a6ba6bf0-a4d0-43bc-ba57-cef12bd629ed tempest-SnapshotDependencyTests-156111334 None] Lock "cinder-quobyte-349a7af7-edda-4095-a933-fb88106c7eb0" released by "_delete_snapshot" :: held 2.910s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:42:51 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a6ba6bf0-a4d0-43bc-ba57-cef12bd629ed tempest-SnapshotDependencyTests-156111334 None] Lock "cinder-quobyte-813cc986-df45-4888-b394-bb22af18e7ca" released by "delete_snapshot" :: held 2.938s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:42:51 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-a6ba6bf0-a4d0-43bc-ba57-cef12bd629ed tempest-SnapshotDependencyTests-156111334 None] Created reservations ['b7914877-9a94-42bf-b46d-cb60f1f4e50c', '336797f4-fbe1-4b3e-bbf1-e7c17799b3f6', '645e6859-b547-4522-8dfd-54bf97d5a7db', 'e94cab3b-fb22-4366-9c93-63f869f61f3f'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:42:51 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-a6ba6bf0-a4d0-43bc-ba57-cef12bd629ed tempest-SnapshotDependencyTests-156111334 None] Delete snapshot completed successfully. Apr 29 15:42:51 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-a6ba6bf0-a4d0-43bc-ba57-cef12bd629ed tempest-SnapshotDependencyTests-156111334 None] Lock "cinder-349a7af7-edda-4095-a933-fb88106c7eb0-delete_snapshot" released by "delete_snapshot" :: held 3.108s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:42:51 devstack sudo[112501]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:51 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-9ef56919-bf46-4bee-976f-1e03a5ce5a53 tempest-SnapshotDependencyTests-156111334 None] Acquiring lock "cinder-813cc986-df45-4888-b394-bb22af18e7ca-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:42:51 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-06cec7e1-926e-4136-8e96-640744646d20 tempest-CreateVolumesFromSnapshotTest-1193587883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-2a83e4c0-3bd5-4dd5-8ebd-58a51a2e53c8" returned: 0 in 0.646s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:51 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-06cec7e1-926e-4136-8e96-640744646d20 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Lock "cinder-quobyte-2a83e4c0-3bd5-4dd5-8ebd-58a51a2e53c8" released by "delete_volume" :: held 1.454s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:42:51 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-9ef56919-bf46-4bee-976f-1e03a5ce5a53 tempest-SnapshotDependencyTests-156111334 None] Lock "cinder-813cc986-df45-4888-b394-bb22af18e7ca-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:42:51 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-9ef56919-bf46-4bee-976f-1e03a5ce5a53 tempest-SnapshotDependencyTests-156111334 None] Acquiring lock "cinder-quobyte-813cc986-df45-4888-b394-bb22af18e7ca" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:42:51 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-06cec7e1-926e-4136-8e96-640744646d20 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Created reservations ['80e26888-fbac-42ee-9d85-4055d567c064', '9c0f3c4f-7afe-4fd8-87d3-d206884a85c4', '5679bddd-de0a-4f83-bf0e-7f712c7575cc', 'c8d0d1b1-6557-497e-849d-d39c2236dd9b'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:42:51 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-9ef56919-bf46-4bee-976f-1e03a5ce5a53 tempest-SnapshotDependencyTests-156111334 None] Lock "cinder-quobyte-813cc986-df45-4888-b394-bb22af18e7ca" acquired by "delete_volume" :: waited 0.020s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:42:51 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2e101f1-6605-4aba-aacb-c691c962d1a3]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:42:51 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-9ef56919-bf46-4bee-976f-1e03a5ce5a53 tempest-SnapshotDependencyTests-156111334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-813cc986-df45-4888-b394-bb22af18e7ca {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:51 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-06cec7e1-926e-4136-8e96-640744646d20 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:42:51 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-06cec7e1-926e-4136-8e96-640744646d20 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:42:51 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-06cec7e1-926e-4136-8e96-640744646d20 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:42:51 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-06cec7e1-926e-4136-8e96-640744646d20 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:42:51 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-06cec7e1-926e-4136-8e96-640744646d20 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:42:51 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-06cec7e1-926e-4136-8e96-640744646d20 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:51 devstack sudo[112506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:42:51 devstack sudo[112506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:51 devstack sudo[112505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-813cc986-df45-4888-b394-bb22af18e7ca Apr 29 15:42:51 devstack sudo[112505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:51 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-8f150bea-72bd-470d-ae93-f08c283623f4 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Acquiring lock "cinder-133b1327-05fc-43c7-872e-ead2a51ff800-delete_snapshot" by "delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:42:51 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-8f150bea-72bd-470d-ae93-f08c283623f4 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Lock "cinder-133b1327-05fc-43c7-872e-ead2a51ff800-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:42:51 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-8f150bea-72bd-470d-ae93-f08c283623f4 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Acquiring lock "cinder-quobyte-20059d47-dd80-4c12-81a4-7f5e32768aab" by "delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:42:52 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-8f150bea-72bd-470d-ae93-f08c283623f4 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Lock "cinder-quobyte-20059d47-dd80-4c12-81a4-7f5e32768aab" acquired by "delete_snapshot" :: waited 0.017s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:42:52 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-8f150bea-72bd-470d-ae93-f08c283623f4 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Acquiring lock "cinder-quobyte-133b1327-05fc-43c7-872e-ead2a51ff800" by "_delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:42:52 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-8f150bea-72bd-470d-ae93-f08c283623f4 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Lock "cinder-quobyte-133b1327-05fc-43c7-872e-ead2a51ff800" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:42:52 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-8f150bea-72bd-470d-ae93-f08c283623f4 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Deleting offline snapshot 133b1327-05fc-43c7-872e-ead2a51ff800 of volume 20059d47-dd80-4c12-81a4-7f5e32768aab {{(pid=84448) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 15:42:52 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-8f150bea-72bd-470d-ae93-f08c283623f4 tempest-CreateVolumesFromSnapshotTest-1193587883 None] snapshot_file for this snap is: volume-20059d47-dd80-4c12-81a4-7f5e32768aab.133b1327-05fc-43c7-872e-ead2a51ff800 {{(pid=84448) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 15:42:52 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[35cf2def-83bd-4e35-9ff9-6a350b538006]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:42:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-8f150bea-72bd-470d-ae93-f08c283623f4 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-20059d47-dd80-4c12-81a4-7f5e32768aab.133b1327-05fc-43c7-872e-ead2a51ff800 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:52 devstack sudo[112506]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-06cec7e1-926e-4136-8e96-640744646d20 tempest-CreateVolumesFromSnapshotTest-1193587883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.649s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:52 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-06cec7e1-926e-4136-8e96-640744646d20 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:42:52 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-06cec7e1-926e-4136-8e96-640744646d20 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Deleted volume successfully. Apr 29 15:42:52 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-06cec7e1-926e-4136-8e96-640744646d20 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Lock "cinder-2a83e4c0-3bd5-4dd5-8ebd-58a51a2e53c8-delete_volume" released by "delete_volume" :: held 2.380s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:42:52 devstack sudo[112505]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-9ef56919-bf46-4bee-976f-1e03a5ce5a53 tempest-SnapshotDependencyTests-156111334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-813cc986-df45-4888-b394-bb22af18e7ca" returned: 0 in 0.767s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-9ef56919-bf46-4bee-976f-1e03a5ce5a53 tempest-SnapshotDependencyTests-156111334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-813cc986-df45-4888-b394-bb22af18e7ca {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:52 devstack sudo[112515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-813cc986-df45-4888-b394-bb22af18e7ca Apr 29 15:42:52 devstack sudo[112515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:52 devstack sudo[112514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-20059d47-dd80-4c12-81a4-7f5e32768aab.133b1327-05fc-43c7-872e-ead2a51ff800 Apr 29 15:42:52 devstack sudo[112514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:52 devstack sudo[112515]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-9ef56919-bf46-4bee-976f-1e03a5ce5a53 tempest-SnapshotDependencyTests-156111334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-813cc986-df45-4888-b394-bb22af18e7ca" returned: 0 in 0.600s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:52 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-9ef56919-bf46-4bee-976f-1e03a5ce5a53 tempest-SnapshotDependencyTests-156111334 None] Lock "cinder-quobyte-813cc986-df45-4888-b394-bb22af18e7ca" released by "delete_volume" :: held 1.431s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:42:52 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-9ef56919-bf46-4bee-976f-1e03a5ce5a53 tempest-SnapshotDependencyTests-156111334 None] Created reservations ['a281ef15-c6af-4618-a877-fb7fc215b7ee', '5cee0ab1-7852-4f99-8d91-9281852d0bf8', '0cccc174-7687-46c2-a707-8fda81eb9c8a', '600b3f39-ed8c-46e6-b8b1-4750aa117478'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:42:52 devstack sudo[112514]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-8f150bea-72bd-470d-ae93-f08c283623f4 tempest-CreateVolumesFromSnapshotTest-1193587883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-20059d47-dd80-4c12-81a4-7f5e32768aab.133b1327-05fc-43c7-872e-ead2a51ff800" returned: 0 in 0.776s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:52 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-8f150bea-72bd-470d-ae93-f08c283623f4 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20059d47-dd80-4c12-81a4-7f5e32768aab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84448) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 15:42:52 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f349ed-b6d9-4c8b-ba66-c13f8ae258d3]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:42:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-8f150bea-72bd-470d-ae93-f08c283623f4 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-20059d47-dd80-4c12-81a4-7f5e32768aab {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-9ef56919-bf46-4bee-976f-1e03a5ce5a53 tempest-SnapshotDependencyTests-156111334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:42:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-9ef56919-bf46-4bee-976f-1e03a5ce5a53 tempest-SnapshotDependencyTests-156111334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:42:52 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-9ef56919-bf46-4bee-976f-1e03a5ce5a53 tempest-SnapshotDependencyTests-156111334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:42:52 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-9ef56919-bf46-4bee-976f-1e03a5ce5a53 tempest-SnapshotDependencyTests-156111334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:42:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-9ef56919-bf46-4bee-976f-1e03a5ce5a53 tempest-SnapshotDependencyTests-156111334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:42:52 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-9ef56919-bf46-4bee-976f-1e03a5ce5a53 tempest-SnapshotDependencyTests-156111334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:52 devstack sudo[112523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:42:52 devstack sudo[112523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:52 devstack sudo[112522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-20059d47-dd80-4c12-81a4-7f5e32768aab Apr 29 15:42:52 devstack sudo[112522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:53 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-c4d0879c-ae2e-4bfc-b6d1-6d403afe6099 tempest-SnapshotDependencyTests-156111334 None] Acquiring lock "cinder-fcdd8ef3-e60c-4212-9aef-aa9676530e90-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:42:53 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-c4d0879c-ae2e-4bfc-b6d1-6d403afe6099 tempest-SnapshotDependencyTests-156111334 None] Lock "cinder-fcdd8ef3-e60c-4212-9aef-aa9676530e90-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:42:53 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-c4d0879c-ae2e-4bfc-b6d1-6d403afe6099 tempest-SnapshotDependencyTests-156111334 None] Acquiring lock "cinder-quobyte-fcdd8ef3-e60c-4212-9aef-aa9676530e90" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:42:53 devstack sudo[112523]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-9ef56919-bf46-4bee-976f-1e03a5ce5a53 tempest-SnapshotDependencyTests-156111334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.641s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:53 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-9ef56919-bf46-4bee-976f-1e03a5ce5a53 tempest-SnapshotDependencyTests-156111334 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:42:53 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-c4d0879c-ae2e-4bfc-b6d1-6d403afe6099 tempest-SnapshotDependencyTests-156111334 None] Lock "cinder-quobyte-fcdd8ef3-e60c-4212-9aef-aa9676530e90" acquired by "delete_volume" :: waited 0.022s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:42:53 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-9ef56919-bf46-4bee-976f-1e03a5ce5a53 tempest-SnapshotDependencyTests-156111334 None] Deleted volume successfully. Apr 29 15:42:53 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc5d6645-4df6-439b-b17e-8be4d66f701d]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:42:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c4d0879c-ae2e-4bfc-b6d1-6d403afe6099 tempest-SnapshotDependencyTests-156111334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-fcdd8ef3-e60c-4212-9aef-aa9676530e90 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:53 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-9ef56919-bf46-4bee-976f-1e03a5ce5a53 tempest-SnapshotDependencyTests-156111334 None] Lock "cinder-813cc986-df45-4888-b394-bb22af18e7ca-delete_volume" released by "delete_volume" :: held 2.362s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:42:53 devstack sudo[112522]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-8f150bea-72bd-470d-ae93-f08c283623f4 tempest-CreateVolumesFromSnapshotTest-1193587883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-20059d47-dd80-4c12-81a4-7f5e32768aab" returned: 0 in 0.807s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:53 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-8f150bea-72bd-470d-ae93-f08c283623f4 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-20059d47-dd80-4c12-81a4-7f5e32768aab.133b1327-05fc-43c7-872e-ead2a51ff800 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:53 devstack sudo[112532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-20059d47-dd80-4c12-81a4-7f5e32768aab.133b1327-05fc-43c7-872e-ead2a51ff800 Apr 29 15:42:53 devstack sudo[112532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:53 devstack sudo[112531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-fcdd8ef3-e60c-4212-9aef-aa9676530e90 Apr 29 15:42:53 devstack sudo[112531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:54 devstack sudo[112531]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c4d0879c-ae2e-4bfc-b6d1-6d403afe6099 tempest-SnapshotDependencyTests-156111334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-fcdd8ef3-e60c-4212-9aef-aa9676530e90" returned: 0 in 0.735s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c4d0879c-ae2e-4bfc-b6d1-6d403afe6099 tempest-SnapshotDependencyTests-156111334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-fcdd8ef3-e60c-4212-9aef-aa9676530e90 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:54 devstack sudo[112542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-fcdd8ef3-e60c-4212-9aef-aa9676530e90 Apr 29 15:42:54 devstack sudo[112542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:54 devstack sudo[112532]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-8f150bea-72bd-470d-ae93-f08c283623f4 tempest-CreateVolumesFromSnapshotTest-1193587883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-20059d47-dd80-4c12-81a4-7f5e32768aab.133b1327-05fc-43c7-872e-ead2a51ff800" returned: 0 in 0.733s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-8f150bea-72bd-470d-ae93-f08c283623f4 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-20059d47-dd80-4c12-81a4-7f5e32768aab.133b1327-05fc-43c7-872e-ead2a51ff800 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:54 devstack sudo[112544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-20059d47-dd80-4c12-81a4-7f5e32768aab.133b1327-05fc-43c7-872e-ead2a51ff800 Apr 29 15:42:54 devstack sudo[112544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:54 devstack sudo[112542]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:54 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c4d0879c-ae2e-4bfc-b6d1-6d403afe6099 tempest-SnapshotDependencyTests-156111334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-fcdd8ef3-e60c-4212-9aef-aa9676530e90" returned: 0 in 0.625s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:55 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-c4d0879c-ae2e-4bfc-b6d1-6d403afe6099 tempest-SnapshotDependencyTests-156111334 None] Lock "cinder-quobyte-fcdd8ef3-e60c-4212-9aef-aa9676530e90" released by "delete_volume" :: held 1.415s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:42:55 devstack sudo[112544]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-8f150bea-72bd-470d-ae93-f08c283623f4 tempest-CreateVolumesFromSnapshotTest-1193587883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-20059d47-dd80-4c12-81a4-7f5e32768aab.133b1327-05fc-43c7-872e-ead2a51ff800" returned: 0 in 0.631s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:55 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-c4d0879c-ae2e-4bfc-b6d1-6d403afe6099 tempest-SnapshotDependencyTests-156111334 None] Created reservations ['204ef99a-832b-4a41-9da5-2348f55504be', '4abcb4f0-3a5b-4411-a9cb-320f7ecea001', '179280c7-d786-4e3e-817a-82a21f078a59', 'e1f6da91-cc89-4b2c-9bd9-837b3cb767af'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:42:55 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-8f150bea-72bd-470d-ae93-f08c283623f4 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Lock "cinder-quobyte-133b1327-05fc-43c7-872e-ead2a51ff800" released by "_delete_snapshot" :: held 3.064s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:42:55 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-8f150bea-72bd-470d-ae93-f08c283623f4 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Lock "cinder-quobyte-20059d47-dd80-4c12-81a4-7f5e32768aab" released by "delete_snapshot" :: held 3.092s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:42:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-c4d0879c-ae2e-4bfc-b6d1-6d403afe6099 tempest-SnapshotDependencyTests-156111334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:42:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-c4d0879c-ae2e-4bfc-b6d1-6d403afe6099 tempest-SnapshotDependencyTests-156111334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:42:55 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-c4d0879c-ae2e-4bfc-b6d1-6d403afe6099 tempest-SnapshotDependencyTests-156111334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:42:55 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-c4d0879c-ae2e-4bfc-b6d1-6d403afe6099 tempest-SnapshotDependencyTests-156111334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:42:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-c4d0879c-ae2e-4bfc-b6d1-6d403afe6099 tempest-SnapshotDependencyTests-156111334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:42:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c4d0879c-ae2e-4bfc-b6d1-6d403afe6099 tempest-SnapshotDependencyTests-156111334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:55 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-8f150bea-72bd-470d-ae93-f08c283623f4 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Created reservations ['1f7f6f55-24e4-4522-9720-deb7647c1631', 'dd3da7d8-6d85-4e0f-9253-5e01965466a8', '8d27d794-5767-4b50-97b9-c83c26970a3b', '78cc6058-5f73-41a8-848f-a48200fdf25a'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:42:55 devstack sudo[112548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:42:55 devstack sudo[112548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:55 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-8f150bea-72bd-470d-ae93-f08c283623f4 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Delete snapshot completed successfully. Apr 29 15:42:55 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-8f150bea-72bd-470d-ae93-f08c283623f4 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Lock "cinder-133b1327-05fc-43c7-872e-ead2a51ff800-delete_snapshot" released by "delete_snapshot" :: held 3.276s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:42:55 devstack sudo[112548]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:55 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-c4d0879c-ae2e-4bfc-b6d1-6d403afe6099 tempest-SnapshotDependencyTests-156111334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.614s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:55 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-c4d0879c-ae2e-4bfc-b6d1-6d403afe6099 tempest-SnapshotDependencyTests-156111334 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:42:55 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-c4d0879c-ae2e-4bfc-b6d1-6d403afe6099 tempest-SnapshotDependencyTests-156111334 None] Deleted volume successfully. Apr 29 15:42:55 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-c4d0879c-ae2e-4bfc-b6d1-6d403afe6099 tempest-SnapshotDependencyTests-156111334 None] Lock "cinder-fcdd8ef3-e60c-4212-9aef-aa9676530e90-delete_volume" released by "delete_volume" :: held 2.318s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:42:56 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-cbfb3cc6-7c09-4fce-bcd5-c93e12dc4719 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Acquiring lock "cinder-20059d47-dd80-4c12-81a4-7f5e32768aab-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:42:56 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-cbfb3cc6-7c09-4fce-bcd5-c93e12dc4719 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Lock "cinder-20059d47-dd80-4c12-81a4-7f5e32768aab-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:42:56 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-cbfb3cc6-7c09-4fce-bcd5-c93e12dc4719 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Acquiring lock "cinder-quobyte-20059d47-dd80-4c12-81a4-7f5e32768aab" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:42:56 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-cbfb3cc6-7c09-4fce-bcd5-c93e12dc4719 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Lock "cinder-quobyte-20059d47-dd80-4c12-81a4-7f5e32768aab" acquired by "delete_volume" :: waited 0.014s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:42:56 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd4658de-5b3a-4764-81b4-cb03261016f4]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:42:56 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cbfb3cc6-7c09-4fce-bcd5-c93e12dc4719 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-20059d47-dd80-4c12-81a4-7f5e32768aab {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:56 devstack sudo[112551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-20059d47-dd80-4c12-81a4-7f5e32768aab Apr 29 15:42:56 devstack sudo[112551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:57 devstack sudo[112551]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:57 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cbfb3cc6-7c09-4fce-bcd5-c93e12dc4719 tempest-CreateVolumesFromSnapshotTest-1193587883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-20059d47-dd80-4c12-81a4-7f5e32768aab" returned: 0 in 0.742s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:57 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cbfb3cc6-7c09-4fce-bcd5-c93e12dc4719 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-20059d47-dd80-4c12-81a4-7f5e32768aab {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:57 devstack sudo[112558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-20059d47-dd80-4c12-81a4-7f5e32768aab Apr 29 15:42:57 devstack sudo[112558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:57 devstack sudo[112558]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:57 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cbfb3cc6-7c09-4fce-bcd5-c93e12dc4719 tempest-CreateVolumesFromSnapshotTest-1193587883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-20059d47-dd80-4c12-81a4-7f5e32768aab" returned: 0 in 0.622s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:57 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-cbfb3cc6-7c09-4fce-bcd5-c93e12dc4719 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Lock "cinder-quobyte-20059d47-dd80-4c12-81a4-7f5e32768aab" released by "delete_volume" :: held 1.439s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:42:57 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-cbfb3cc6-7c09-4fce-bcd5-c93e12dc4719 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Created reservations ['22e2d6c3-1dfa-45bf-8f19-f24d0a3e7442', '42f955f5-af7e-4527-9910-decbed436edb', '1c710b97-72ce-47b7-ab88-f2acb3627eb8', '33a52ccf-09e9-4dd1-9492-f1fa5a267e95'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:42:57 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-cbfb3cc6-7c09-4fce-bcd5-c93e12dc4719 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:42:57 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-cbfb3cc6-7c09-4fce-bcd5-c93e12dc4719 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:42:57 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-cbfb3cc6-7c09-4fce-bcd5-c93e12dc4719 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:42:57 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-cbfb3cc6-7c09-4fce-bcd5-c93e12dc4719 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:42:57 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-cbfb3cc6-7c09-4fce-bcd5-c93e12dc4719 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:42:57 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cbfb3cc6-7c09-4fce-bcd5-c93e12dc4719 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:42:57 devstack sudo[112562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:42:57 devstack sudo[112562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:42:58 devstack sudo[112562]: pam_unix(sudo:session): session closed for user root Apr 29 15:42:58 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-cbfb3cc6-7c09-4fce-bcd5-c93e12dc4719 tempest-CreateVolumesFromSnapshotTest-1193587883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.652s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:42:58 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-cbfb3cc6-7c09-4fce-bcd5-c93e12dc4719 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:42:58 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-cbfb3cc6-7c09-4fce-bcd5-c93e12dc4719 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Deleted volume successfully. Apr 29 15:42:58 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-cbfb3cc6-7c09-4fce-bcd5-c93e12dc4719 tempest-CreateVolumesFromSnapshotTest-1193587883 None] Lock "cinder-20059d47-dd80-4c12-81a4-7f5e32768aab-delete_volume" released by "delete_volume" :: held 2.321s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:43:01 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fe7a091-7528-4b0d-a569-18bc1a25da87 tempest-CinderUnicodeTest-69529497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:43:01 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-3fe7a091-7528-4b0d-a569-18bc1a25da87 tempest-CinderUnicodeTest-69529497 None] Flow 'volume_create_manager' (8fa6b27d-b72e-4051-8b3c-8880a0552b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:43:01 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-3fe7a091-7528-4b0d-a569-18bc1a25da87 tempest-CinderUnicodeTest-69529497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a43872df-383f-48a7-8fa1-072c0ef385c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:43:01 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-3fe7a091-7528-4b0d-a569-18bc1a25da87 tempest-CinderUnicodeTest-69529497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a43872df-383f-48a7-8fa1-072c0ef385c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:43:01Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae5bb898-15e9-4d6f-883f-854d8cd5d99e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acf893f3a4a648f69802b18c8e2d1ee3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:43:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:43:02Z,use_quota=True,user_id='3c132e883d1b4aa4914443e5cb25b1e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:43:01 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-3fe7a091-7528-4b0d-a569-18bc1a25da87 tempest-CinderUnicodeTest-69529497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ad0bc1a-9209-48ee-9c83-297dacbe53f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:43:01 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-3fe7a091-7528-4b0d-a569-18bc1a25da87 tempest-CinderUnicodeTest-69529497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ad0bc1a-9209-48ee-9c83-297dacbe53f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:43:01 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-3fe7a091-7528-4b0d-a569-18bc1a25da87 tempest-CinderUnicodeTest-69529497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95a344fe-5e49-42f6-b7e8-7f44fdd6c8ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:43:01 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-3fe7a091-7528-4b0d-a569-18bc1a25da87 tempest-CinderUnicodeTest-69529497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95a344fe-5e49-42f6-b7e8-7f44fdd6c8ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae5bb898-15e9-4d6f-883f-854d8cd5d99e', 'volume_name': 'volume-ae5bb898-15e9-4d6f-883f-854d8cd5d99e', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:43:01 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-3fe7a091-7528-4b0d-a569-18bc1a25da87 tempest-CinderUnicodeTest-69529497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9696f297-dc14-43c3-a47f-1e76a3917948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:43:01 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-3fe7a091-7528-4b0d-a569-18bc1a25da87 tempest-CinderUnicodeTest-69529497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9696f297-dc14-43c3-a47f-1e76a3917948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:43:01 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-3fe7a091-7528-4b0d-a569-18bc1a25da87 tempest-CinderUnicodeTest-69529497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdaaea26-54bd-472d-a712-b6ffc74cd6fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:43:01 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-3fe7a091-7528-4b0d-a569-18bc1a25da87 tempest-CinderUnicodeTest-69529497 None] Volume ae5bb898-15e9-4d6f-883f-854d8cd5d99e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae5bb898-15e9-4d6f-883f-854d8cd5d99e', 'volume_size': 1} Apr 29 15:43:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-3fe7a091-7528-4b0d-a569-18bc1a25da87 tempest-CinderUnicodeTest-69529497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:43:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-3fe7a091-7528-4b0d-a569-18bc1a25da87 tempest-CinderUnicodeTest-69529497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:43:01 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-3fe7a091-7528-4b0d-a569-18bc1a25da87 tempest-CinderUnicodeTest-69529497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:43:01Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae5bb898-15e9-4d6f-883f-854d8cd5d99e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acf893f3a4a648f69802b18c8e2d1ee3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:43:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:43:02Z,use_quota=True,user_id='3c132e883d1b4aa4914443e5cb25b1e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:43:01 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-3fe7a091-7528-4b0d-a569-18bc1a25da87 tempest-CinderUnicodeTest-69529497 None] Creating volume ae5bb898-15e9-4d6f-883f-854d8cd5d99e {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:43:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-3fe7a091-7528-4b0d-a569-18bc1a25da87 tempest-CinderUnicodeTest-69529497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:43:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-3fe7a091-7528-4b0d-a569-18bc1a25da87 tempest-CinderUnicodeTest-69529497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:43:01 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-3fe7a091-7528-4b0d-a569-18bc1a25da87 tempest-CinderUnicodeTest-69529497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:43:01 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-3fe7a091-7528-4b0d-a569-18bc1a25da87 tempest-CinderUnicodeTest-69529497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:43:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-3fe7a091-7528-4b0d-a569-18bc1a25da87 tempest-CinderUnicodeTest-69529497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:43:01 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-3fe7a091-7528-4b0d-a569-18bc1a25da87 tempest-CinderUnicodeTest-69529497 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:43:01 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-3fe7a091-7528-4b0d-a569-18bc1a25da87 tempest-CinderUnicodeTest-69529497 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:43:01 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-3fe7a091-7528-4b0d-a569-18bc1a25da87 tempest-CinderUnicodeTest-69529497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ae5bb898-15e9-4d6f-883f-854d8cd5d99e 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:43:01 devstack sudo[112568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ae5bb898-15e9-4d6f-883f-854d8cd5d99e 1073741824 Apr 29 15:43:01 devstack sudo[112568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:43:02 devstack sudo[112568]: pam_unix(sudo:session): session closed for user root Apr 29 15:43:02 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-3fe7a091-7528-4b0d-a569-18bc1a25da87 tempest-CinderUnicodeTest-69529497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ae5bb898-15e9-4d6f-883f-854d8cd5d99e 1073741824" returned: 0 in 0.882s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:43:02 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-3fe7a091-7528-4b0d-a569-18bc1a25da87 tempest-CinderUnicodeTest-69529497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ae5bb898-15e9-4d6f-883f-854d8cd5d99e {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:43:02 devstack sudo[112573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ae5bb898-15e9-4d6f-883f-854d8cd5d99e Apr 29 15:43:02 devstack sudo[112573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:43:03 devstack sudo[112573]: pam_unix(sudo:session): session closed for user root Apr 29 15:43:03 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-3fe7a091-7528-4b0d-a569-18bc1a25da87 tempest-CinderUnicodeTest-69529497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ae5bb898-15e9-4d6f-883f-854d8cd5d99e" returned: 0 in 0.643s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:43:03 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-3fe7a091-7528-4b0d-a569-18bc1a25da87 tempest-CinderUnicodeTest-69529497 None] <== create_volume: return (1594ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:43:03 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-3fe7a091-7528-4b0d-a569-18bc1a25da87 tempest-CinderUnicodeTest-69529497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.596s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:43:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-3fe7a091-7528-4b0d-a569-18bc1a25da87 tempest-CinderUnicodeTest-69529497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdaaea26-54bd-472d-a712-b6ffc74cd6fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae5bb898-15e9-4d6f-883f-854d8cd5d99e', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:43:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-3fe7a091-7528-4b0d-a569-18bc1a25da87 tempest-CinderUnicodeTest-69529497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fe278dd-ff50-457d-a1cd-d17bece10db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:43:03 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-3fe7a091-7528-4b0d-a569-18bc1a25da87 tempest-CinderUnicodeTest-69529497 None] Volume volume-ae5bb898-15e9-4d6f-883f-854d8cd5d99e (ae5bb898-15e9-4d6f-883f-854d8cd5d99e): created successfully Apr 29 15:43:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-3fe7a091-7528-4b0d-a569-18bc1a25da87 tempest-CinderUnicodeTest-69529497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fe278dd-ff50-457d-a1cd-d17bece10db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:43:03 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-3fe7a091-7528-4b0d-a569-18bc1a25da87 tempest-CinderUnicodeTest-69529497 None] Flow 'volume_create_manager' (8fa6b27d-b72e-4051-8b3c-8880a0552b65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:43:03 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-3fe7a091-7528-4b0d-a569-18bc1a25da87 tempest-CinderUnicodeTest-69529497 None] Created volume successfully. Apr 29 15:43:04 devstack cinder-volume[84448]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d27f12d-5e93-4ab5-8244-28a1e0c201b2 tempest-CinderUnicodeTest-69529497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84448) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 15:43:04 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-7d27f12d-5e93-4ab5-8244-28a1e0c201b2 tempest-CinderUnicodeTest-69529497 None] Flow 'volume_create_manager' (4c4eaeda-8e42-402e-8ad7-edb1dd8b5647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:43:04 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-7d27f12d-5e93-4ab5-8244-28a1e0c201b2 tempest-CinderUnicodeTest-69529497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9434f2da-cdaa-49d7-ba5d-d902167f0ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:43:04 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-7d27f12d-5e93-4ab5-8244-28a1e0c201b2 tempest-CinderUnicodeTest-69529497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9434f2da-cdaa-49d7-ba5d-d902167f0ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:43:04Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-911178509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08ae1824-3876-4d7c-a63f-324c25593c19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acf893f3a4a648f69802b18c8e2d1ee3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:43:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:43:04Z,use_quota=True,user_id='3c132e883d1b4aa4914443e5cb25b1e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:43:04 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-7d27f12d-5e93-4ab5-8244-28a1e0c201b2 tempest-CinderUnicodeTest-69529497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (095fbd6e-a604-49bb-9012-a811b536988d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:43:04 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-7d27f12d-5e93-4ab5-8244-28a1e0c201b2 tempest-CinderUnicodeTest-69529497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (095fbd6e-a604-49bb-9012-a811b536988d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:43:04 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-7d27f12d-5e93-4ab5-8244-28a1e0c201b2 tempest-CinderUnicodeTest-69529497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e2afc38-8148-4039-ac1b-4ddf9bd9ce07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:43:04 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-7d27f12d-5e93-4ab5-8244-28a1e0c201b2 tempest-CinderUnicodeTest-69529497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e2afc38-8148-4039-ac1b-4ddf9bd9ce07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08ae1824-3876-4d7c-a63f-324c25593c19', 'volume_name': 'volume-08ae1824-3876-4d7c-a63f-324c25593c19', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:43:04 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-7d27f12d-5e93-4ab5-8244-28a1e0c201b2 tempest-CinderUnicodeTest-69529497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f97591f4-1c81-4b50-8141-ebccf013098b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:43:04 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-7d27f12d-5e93-4ab5-8244-28a1e0c201b2 tempest-CinderUnicodeTest-69529497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f97591f4-1c81-4b50-8141-ebccf013098b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:43:04 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-7d27f12d-5e93-4ab5-8244-28a1e0c201b2 tempest-CinderUnicodeTest-69529497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5aeda84-dd68-45bb-b674-a3bc79f0f836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:43:04 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-7d27f12d-5e93-4ab5-8244-28a1e0c201b2 tempest-CinderUnicodeTest-69529497 None] Volume 08ae1824-3876-4d7c-a63f-324c25593c19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08ae1824-3876-4d7c-a63f-324c25593c19', 'volume_size': 1} Apr 29 15:43:04 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-7d27f12d-5e93-4ab5-8244-28a1e0c201b2 tempest-CinderUnicodeTest-69529497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:43:04 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-7d27f12d-5e93-4ab5-8244-28a1e0c201b2 tempest-CinderUnicodeTest-69529497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:43:04 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-7d27f12d-5e93-4ab5-8244-28a1e0c201b2 tempest-CinderUnicodeTest-69529497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T13:43:04Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-911178509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08ae1824-3876-4d7c-a63f-324c25593c19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acf893f3a4a648f69802b18c8e2d1ee3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T13:43:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T13:43:04Z,use_quota=True,user_id='3c132e883d1b4aa4914443e5cb25b1e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79417965-78cd-48f2-8c96-dc98052d690a),volume_type_id=79417965-78cd-48f2-8c96-dc98052d690a)}" {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 15:43:04 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-7d27f12d-5e93-4ab5-8244-28a1e0c201b2 tempest-CinderUnicodeTest-69529497 None] Creating volume 08ae1824-3876-4d7c-a63f-324c25593c19 {{(pid=84448) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 15:43:04 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-7d27f12d-5e93-4ab5-8244-28a1e0c201b2 tempest-CinderUnicodeTest-69529497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:43:04 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-7d27f12d-5e93-4ab5-8244-28a1e0c201b2 tempest-CinderUnicodeTest-69529497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:43:04 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-7d27f12d-5e93-4ab5-8244-28a1e0c201b2 tempest-CinderUnicodeTest-69529497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:43:04 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-7d27f12d-5e93-4ab5-8244-28a1e0c201b2 tempest-CinderUnicodeTest-69529497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:43:04 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-7d27f12d-5e93-4ab5-8244-28a1e0c201b2 tempest-CinderUnicodeTest-69529497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:43:04 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-7d27f12d-5e93-4ab5-8244-28a1e0c201b2 tempest-CinderUnicodeTest-69529497 None] Selected osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a as target Quobyte volume. {{(pid=84448) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 15:43:04 devstack cinder-volume[84448]: INFO cinder.volume.drivers.remotefs [None req-7d27f12d-5e93-4ab5-8244-28a1e0c201b2 tempest-CinderUnicodeTest-69529497 None] casted to osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a Apr 29 15:43:04 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7d27f12d-5e93-4ab5-8244-28a1e0c201b2 tempest-CinderUnicodeTest-69529497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-08ae1824-3876-4d7c-a63f-324c25593c19 1073741824 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:43:04 devstack sudo[112577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-08ae1824-3876-4d7c-a63f-324c25593c19 1073741824 Apr 29 15:43:04 devstack sudo[112577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:43:05 devstack sudo[112577]: pam_unix(sudo:session): session closed for user root Apr 29 15:43:05 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7d27f12d-5e93-4ab5-8244-28a1e0c201b2 tempest-CinderUnicodeTest-69529497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-08ae1824-3876-4d7c-a63f-324c25593c19 1073741824" returned: 0 in 0.839s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:43:05 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7d27f12d-5e93-4ab5-8244-28a1e0c201b2 tempest-CinderUnicodeTest-69529497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-08ae1824-3876-4d7c-a63f-324c25593c19 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:43:05 devstack sudo[112583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-08ae1824-3876-4d7c-a63f-324c25593c19 Apr 29 15:43:05 devstack sudo[112583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:43:05 devstack sudo[112583]: pam_unix(sudo:session): session closed for user root Apr 29 15:43:05 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-7d27f12d-5e93-4ab5-8244-28a1e0c201b2 tempest-CinderUnicodeTest-69529497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-08ae1824-3876-4d7c-a63f-324c25593c19" returned: 0 in 0.622s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:43:05 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-7d27f12d-5e93-4ab5-8244-28a1e0c201b2 tempest-CinderUnicodeTest-69529497 None] <== create_volume: return (1511ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'} {{(pid=84448) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 15:43:05 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-7d27f12d-5e93-4ab5-8244-28a1e0c201b2 tempest-CinderUnicodeTest-69529497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.515s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:43:05 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-7d27f12d-5e93-4ab5-8244-28a1e0c201b2 tempest-CinderUnicodeTest-69529497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5aeda84-dd68-45bb-b674-a3bc79f0f836) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08ae1824-3876-4d7c-a63f-324c25593c19', 'volume_size': 1}' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:43:05 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-7d27f12d-5e93-4ab5-8244-28a1e0c201b2 tempest-CinderUnicodeTest-69529497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38b2c9ac-f132-464f-a2f3-c32bbf82ab80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 15:43:05 devstack cinder-volume[84448]: INFO cinder.volume.flows.manager.create_volume [None req-7d27f12d-5e93-4ab5-8244-28a1e0c201b2 tempest-CinderUnicodeTest-69529497 None] Volume volume-08ae1824-3876-4d7c-a63f-324c25593c19 (08ae1824-3876-4d7c-a63f-324c25593c19): created successfully Apr 29 15:43:05 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-7d27f12d-5e93-4ab5-8244-28a1e0c201b2 tempest-CinderUnicodeTest-69529497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38b2c9ac-f132-464f-a2f3-c32bbf82ab80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84448) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 15:43:05 devstack cinder-volume[84448]: DEBUG cinder.volume.manager [None req-7d27f12d-5e93-4ab5-8244-28a1e0c201b2 tempest-CinderUnicodeTest-69529497 None] Flow 'volume_create_manager' (4c4eaeda-8e42-402e-8ad7-edb1dd8b5647) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84448) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 15:43:05 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-7d27f12d-5e93-4ab5-8244-28a1e0c201b2 tempest-CinderUnicodeTest-69529497 None] Created volume successfully. Apr 29 15:43:06 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-1350a811-fa9f-4756-9ea0-ead84ae37654 tempest-CinderUnicodeTest-69529497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:43:06 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-1350a811-fa9f-4756-9ea0-ead84ae37654 tempest-CinderUnicodeTest-69529497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:43:06 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-1350a811-fa9f-4756-9ea0-ead84ae37654 tempest-CinderUnicodeTest-69529497 None] Creating offline snapshot e7390ff1-d26e-4777-b25d-1a6ee3b3b6c0 of volume 08ae1824-3876-4d7c-a63f-324c25593c19 {{(pid=84448) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 15:43:06 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[85307514-2191-4f40-86f5-a3fb6d0f5c94]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:43:06 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1350a811-fa9f-4756-9ea0-ead84ae37654 tempest-CinderUnicodeTest-69529497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-08ae1824-3876-4d7c-a63f-324c25593c19 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:43:06 devstack sudo[112587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-08ae1824-3876-4d7c-a63f-324c25593c19 Apr 29 15:43:06 devstack sudo[112587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:43:07 devstack sudo[112587]: pam_unix(sudo:session): session closed for user root Apr 29 15:43:07 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1350a811-fa9f-4756-9ea0-ead84ae37654 tempest-CinderUnicodeTest-69529497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-08ae1824-3876-4d7c-a63f-324c25593c19" returned: 0 in 0.711s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:43:07 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1350a811-fa9f-4756-9ea0-ead84ae37654 tempest-CinderUnicodeTest-69529497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-08ae1824-3876-4d7c-a63f-324c25593c19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-08ae1824-3876-4d7c-a63f-324c25593c19.e7390ff1-d26e-4777-b25d-1a6ee3b3b6c0 1G {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:43:07 devstack sudo[112592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-08ae1824-3876-4d7c-a63f-324c25593c19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-08ae1824-3876-4d7c-a63f-324c25593c19.e7390ff1-d26e-4777-b25d-1a6ee3b3b6c0 1G Apr 29 15:43:07 devstack sudo[112592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:43:08 devstack sudo[112592]: pam_unix(sudo:session): session closed for user root Apr 29 15:43:08 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1350a811-fa9f-4756-9ea0-ead84ae37654 tempest-CinderUnicodeTest-69529497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-08ae1824-3876-4d7c-a63f-324c25593c19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-08ae1824-3876-4d7c-a63f-324c25593c19.e7390ff1-d26e-4777-b25d-1a6ee3b3b6c0 1G" returned: 0 in 0.751s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:43:08 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1350a811-fa9f-4756-9ea0-ead84ae37654 tempest-CinderUnicodeTest-69529497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08ae1824-3876-4d7c-a63f-324c25593c19 -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-08ae1824-3876-4d7c-a63f-324c25593c19.e7390ff1-d26e-4777-b25d-1a6ee3b3b6c0 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:43:08 devstack sudo[112597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08ae1824-3876-4d7c-a63f-324c25593c19 -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-08ae1824-3876-4d7c-a63f-324c25593c19.e7390ff1-d26e-4777-b25d-1a6ee3b3b6c0 Apr 29 15:43:08 devstack sudo[112597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:43:08 devstack sudo[112597]: pam_unix(sudo:session): session closed for user root Apr 29 15:43:08 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1350a811-fa9f-4756-9ea0-ead84ae37654 tempest-CinderUnicodeTest-69529497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08ae1824-3876-4d7c-a63f-324c25593c19 -F qcow2 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-08ae1824-3876-4d7c-a63f-324c25593c19.e7390ff1-d26e-4777-b25d-1a6ee3b3b6c0" returned: 0 in 0.651s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:43:08 devstack cinder-volume[84448]: WARNING cinder.volume.drivers.remotefs [None req-1350a811-fa9f-4756-9ea0-ead84ae37654 tempest-CinderUnicodeTest-69529497 None] /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-08ae1824-3876-4d7c-a63f-324c25593c19.e7390ff1-d26e-4777-b25d-1a6ee3b3b6c0 is being set with open permissions: ugo+rw Apr 29 15:43:08 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1350a811-fa9f-4756-9ea0-ead84ae37654 tempest-CinderUnicodeTest-69529497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-08ae1824-3876-4d7c-a63f-324c25593c19.e7390ff1-d26e-4777-b25d-1a6ee3b3b6c0 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:43:08 devstack sudo[112602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-08ae1824-3876-4d7c-a63f-324c25593c19.e7390ff1-d26e-4777-b25d-1a6ee3b3b6c0 Apr 29 15:43:08 devstack sudo[112602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:43:09 devstack sudo[112602]: pam_unix(sudo:session): session closed for user root Apr 29 15:43:09 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1350a811-fa9f-4756-9ea0-ead84ae37654 tempest-CinderUnicodeTest-69529497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-08ae1824-3876-4d7c-a63f-324c25593c19.e7390ff1-d26e-4777-b25d-1a6ee3b3b6c0" returned: 0 in 0.584s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:43:09 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1350a811-fa9f-4756-9ea0-ead84ae37654 tempest-CinderUnicodeTest-69529497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-08ae1824-3876-4d7c-a63f-324c25593c19.info {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:43:09 devstack sudo[112605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-08ae1824-3876-4d7c-a63f-324c25593c19.info Apr 29 15:43:09 devstack sudo[112605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:43:09 devstack sudo[112605]: pam_unix(sudo:session): session closed for user root Apr 29 15:43:09 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1350a811-fa9f-4756-9ea0-ead84ae37654 tempest-CinderUnicodeTest-69529497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-08ae1824-3876-4d7c-a63f-324c25593c19.info" returned: 0 in 0.627s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:43:09 devstack cinder-volume[84448]: WARNING cinder.volume.drivers.remotefs [None req-1350a811-fa9f-4756-9ea0-ead84ae37654 tempest-CinderUnicodeTest-69529497 None] /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-08ae1824-3876-4d7c-a63f-324c25593c19.info is being set with open permissions: ugo+rw Apr 29 15:43:09 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1350a811-fa9f-4756-9ea0-ead84ae37654 tempest-CinderUnicodeTest-69529497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-08ae1824-3876-4d7c-a63f-324c25593c19.info {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:43:09 devstack sudo[112608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-08ae1824-3876-4d7c-a63f-324c25593c19.info Apr 29 15:43:09 devstack sudo[112608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:43:10 devstack sudo[112608]: pam_unix(sudo:session): session closed for user root Apr 29 15:43:10 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-1350a811-fa9f-4756-9ea0-ead84ae37654 tempest-CinderUnicodeTest-69529497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-08ae1824-3876-4d7c-a63f-324c25593c19.info" returned: 0 in 0.579s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:43:10 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-1350a811-fa9f-4756-9ea0-ead84ae37654 tempest-CinderUnicodeTest-69529497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.989s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:43:10 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-1350a811-fa9f-4756-9ea0-ead84ae37654 tempest-CinderUnicodeTest-69529497 None] Create snapshot completed successfully Apr 29 15:43:10 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-ca40b6a4-1742-4e4f-80d3-0cdc8fed7101 tempest-CinderUnicodeTest-69529497 None] Acquiring lock "cinder-e7390ff1-d26e-4777-b25d-1a6ee3b3b6c0-delete_snapshot" by "delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:43:10 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-ca40b6a4-1742-4e4f-80d3-0cdc8fed7101 tempest-CinderUnicodeTest-69529497 None] Lock "cinder-e7390ff1-d26e-4777-b25d-1a6ee3b3b6c0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:43:10 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-ca40b6a4-1742-4e4f-80d3-0cdc8fed7101 tempest-CinderUnicodeTest-69529497 None] Acquiring lock "cinder-quobyte-08ae1824-3876-4d7c-a63f-324c25593c19" by "delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:43:10 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-ca40b6a4-1742-4e4f-80d3-0cdc8fed7101 tempest-CinderUnicodeTest-69529497 None] Lock "cinder-quobyte-08ae1824-3876-4d7c-a63f-324c25593c19" acquired by "delete_snapshot" :: waited 0.016s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:43:10 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-ca40b6a4-1742-4e4f-80d3-0cdc8fed7101 tempest-CinderUnicodeTest-69529497 None] Acquiring lock "cinder-quobyte-e7390ff1-d26e-4777-b25d-1a6ee3b3b6c0" by "_delete_snapshot" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:43:10 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-ca40b6a4-1742-4e4f-80d3-0cdc8fed7101 tempest-CinderUnicodeTest-69529497 None] Lock "cinder-quobyte-e7390ff1-d26e-4777-b25d-1a6ee3b3b6c0" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:43:10 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-ca40b6a4-1742-4e4f-80d3-0cdc8fed7101 tempest-CinderUnicodeTest-69529497 None] Deleting offline snapshot e7390ff1-d26e-4777-b25d-1a6ee3b3b6c0 of volume 08ae1824-3876-4d7c-a63f-324c25593c19 {{(pid=84448) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 15:43:10 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-ca40b6a4-1742-4e4f-80d3-0cdc8fed7101 tempest-CinderUnicodeTest-69529497 None] snapshot_file for this snap is: volume-08ae1824-3876-4d7c-a63f-324c25593c19.e7390ff1-d26e-4777-b25d-1a6ee3b3b6c0 {{(pid=84448) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 15:43:10 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[999d3d8c-22d5-4b07-a1bf-0eae101e8109]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:43:10 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ca40b6a4-1742-4e4f-80d3-0cdc8fed7101 tempest-CinderUnicodeTest-69529497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-08ae1824-3876-4d7c-a63f-324c25593c19.e7390ff1-d26e-4777-b25d-1a6ee3b3b6c0 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:43:10 devstack sudo[112612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-08ae1824-3876-4d7c-a63f-324c25593c19.e7390ff1-d26e-4777-b25d-1a6ee3b3b6c0 Apr 29 15:43:10 devstack sudo[112612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:43:11 devstack sudo[112612]: pam_unix(sudo:session): session closed for user root Apr 29 15:43:11 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ca40b6a4-1742-4e4f-80d3-0cdc8fed7101 tempest-CinderUnicodeTest-69529497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-08ae1824-3876-4d7c-a63f-324c25593c19.e7390ff1-d26e-4777-b25d-1a6ee3b3b6c0" returned: 0 in 0.736s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:43:11 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.remotefs [None req-ca40b6a4-1742-4e4f-80d3-0cdc8fed7101 tempest-CinderUnicodeTest-69529497 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08ae1824-3876-4d7c-a63f-324c25593c19(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84448) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 15:43:11 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[733f80e0-a18d-4040-bb1e-a000a7440c3d]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:43:11 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ca40b6a4-1742-4e4f-80d3-0cdc8fed7101 tempest-CinderUnicodeTest-69529497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-08ae1824-3876-4d7c-a63f-324c25593c19 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:43:11 devstack sudo[112617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-08ae1824-3876-4d7c-a63f-324c25593c19 Apr 29 15:43:11 devstack sudo[112617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:43:12 devstack sudo[112617]: pam_unix(sudo:session): session closed for user root Apr 29 15:43:12 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ca40b6a4-1742-4e4f-80d3-0cdc8fed7101 tempest-CinderUnicodeTest-69529497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-08ae1824-3876-4d7c-a63f-324c25593c19" returned: 0 in 0.692s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:43:12 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ca40b6a4-1742-4e4f-80d3-0cdc8fed7101 tempest-CinderUnicodeTest-69529497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-08ae1824-3876-4d7c-a63f-324c25593c19.e7390ff1-d26e-4777-b25d-1a6ee3b3b6c0 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:43:12 devstack sudo[112623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-08ae1824-3876-4d7c-a63f-324c25593c19.e7390ff1-d26e-4777-b25d-1a6ee3b3b6c0 Apr 29 15:43:12 devstack sudo[112623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:43:12 devstack sudo[112623]: pam_unix(sudo:session): session closed for user root Apr 29 15:43:12 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ca40b6a4-1742-4e4f-80d3-0cdc8fed7101 tempest-CinderUnicodeTest-69529497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-08ae1824-3876-4d7c-a63f-324c25593c19.e7390ff1-d26e-4777-b25d-1a6ee3b3b6c0" returned: 0 in 0.665s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:43:12 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ca40b6a4-1742-4e4f-80d3-0cdc8fed7101 tempest-CinderUnicodeTest-69529497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-08ae1824-3876-4d7c-a63f-324c25593c19.e7390ff1-d26e-4777-b25d-1a6ee3b3b6c0 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:43:12 devstack sudo[112628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-08ae1824-3876-4d7c-a63f-324c25593c19.e7390ff1-d26e-4777-b25d-1a6ee3b3b6c0 Apr 29 15:43:12 devstack sudo[112628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:43:13 devstack sudo[112628]: pam_unix(sudo:session): session closed for user root Apr 29 15:43:13 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-ca40b6a4-1742-4e4f-80d3-0cdc8fed7101 tempest-CinderUnicodeTest-69529497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-08ae1824-3876-4d7c-a63f-324c25593c19.e7390ff1-d26e-4777-b25d-1a6ee3b3b6c0" returned: 0 in 0.597s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:43:13 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-ca40b6a4-1742-4e4f-80d3-0cdc8fed7101 tempest-CinderUnicodeTest-69529497 None] Lock "cinder-quobyte-e7390ff1-d26e-4777-b25d-1a6ee3b3b6c0" released by "_delete_snapshot" :: held 2.797s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:43:13 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-ca40b6a4-1742-4e4f-80d3-0cdc8fed7101 tempest-CinderUnicodeTest-69529497 None] Lock "cinder-quobyte-08ae1824-3876-4d7c-a63f-324c25593c19" released by "delete_snapshot" :: held 2.816s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:43:13 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-ca40b6a4-1742-4e4f-80d3-0cdc8fed7101 tempest-CinderUnicodeTest-69529497 None] Created reservations ['373b5a69-4c12-45e7-8287-148c2d82d520', '6cc3c56f-bd61-449d-a87f-3ef082f68580', 'b13453ab-2b76-4042-b27b-516019cf2ead', '1c22605f-1087-4272-9574-d48025b68283'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:43:13 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-ca40b6a4-1742-4e4f-80d3-0cdc8fed7101 tempest-CinderUnicodeTest-69529497 None] Delete snapshot completed successfully. Apr 29 15:43:13 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-ca40b6a4-1742-4e4f-80d3-0cdc8fed7101 tempest-CinderUnicodeTest-69529497 None] Lock "cinder-e7390ff1-d26e-4777-b25d-1a6ee3b3b6c0-delete_snapshot" released by "delete_snapshot" :: held 2.937s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:43:13 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-b245c62d-6da2-4ec7-936d-c6cf4230bed5 tempest-CinderUnicodeTest-69529497 None] Acquiring lock "cinder-08ae1824-3876-4d7c-a63f-324c25593c19-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:43:13 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-b245c62d-6da2-4ec7-936d-c6cf4230bed5 tempest-CinderUnicodeTest-69529497 None] Lock "cinder-08ae1824-3876-4d7c-a63f-324c25593c19-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:43:13 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-b245c62d-6da2-4ec7-936d-c6cf4230bed5 tempest-CinderUnicodeTest-69529497 None] Acquiring lock "cinder-quobyte-08ae1824-3876-4d7c-a63f-324c25593c19" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:43:13 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-b245c62d-6da2-4ec7-936d-c6cf4230bed5 tempest-CinderUnicodeTest-69529497 None] Lock "cinder-quobyte-08ae1824-3876-4d7c-a63f-324c25593c19" acquired by "delete_volume" :: waited 0.014s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:43:14 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[71560cc0-dfe9-4ae1-8533-1f554ce8c91c]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:43:14 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-b245c62d-6da2-4ec7-936d-c6cf4230bed5 tempest-CinderUnicodeTest-69529497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-08ae1824-3876-4d7c-a63f-324c25593c19 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:43:14 devstack sudo[112631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-08ae1824-3876-4d7c-a63f-324c25593c19 Apr 29 15:43:14 devstack sudo[112631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:43:14 devstack sudo[112631]: pam_unix(sudo:session): session closed for user root Apr 29 15:43:14 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-b245c62d-6da2-4ec7-936d-c6cf4230bed5 tempest-CinderUnicodeTest-69529497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-08ae1824-3876-4d7c-a63f-324c25593c19" returned: 0 in 0.702s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:43:14 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-b245c62d-6da2-4ec7-936d-c6cf4230bed5 tempest-CinderUnicodeTest-69529497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-08ae1824-3876-4d7c-a63f-324c25593c19 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:43:14 devstack sudo[112636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-08ae1824-3876-4d7c-a63f-324c25593c19 Apr 29 15:43:14 devstack sudo[112636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:43:15 devstack sudo[112636]: pam_unix(sudo:session): session closed for user root Apr 29 15:43:15 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-b245c62d-6da2-4ec7-936d-c6cf4230bed5 tempest-CinderUnicodeTest-69529497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-08ae1824-3876-4d7c-a63f-324c25593c19" returned: 0 in 0.629s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:43:15 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-b245c62d-6da2-4ec7-936d-c6cf4230bed5 tempest-CinderUnicodeTest-69529497 None] Lock "cinder-quobyte-08ae1824-3876-4d7c-a63f-324c25593c19" released by "delete_volume" :: held 1.385s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:43:15 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-b245c62d-6da2-4ec7-936d-c6cf4230bed5 tempest-CinderUnicodeTest-69529497 None] Created reservations ['f62da462-b32e-41ff-9fcb-6ed33ff11304', 'e3f911bd-aa58-4449-9c0c-a77931694867', '32d7a434-f55f-43b9-9c26-aad6638d71bd', 'd6e21293-d2e4-4fa2-945e-4969f60ff9e0'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:43:15 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-b245c62d-6da2-4ec7-936d-c6cf4230bed5 tempest-CinderUnicodeTest-69529497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:43:15 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-b245c62d-6da2-4ec7-936d-c6cf4230bed5 tempest-CinderUnicodeTest-69529497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:43:15 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-b245c62d-6da2-4ec7-936d-c6cf4230bed5 tempest-CinderUnicodeTest-69529497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:43:15 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-b245c62d-6da2-4ec7-936d-c6cf4230bed5 tempest-CinderUnicodeTest-69529497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:43:15 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-b245c62d-6da2-4ec7-936d-c6cf4230bed5 tempest-CinderUnicodeTest-69529497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:43:15 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-b245c62d-6da2-4ec7-936d-c6cf4230bed5 tempest-CinderUnicodeTest-69529497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:43:15 devstack sudo[112639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:43:15 devstack sudo[112639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:43:16 devstack sudo[112639]: pam_unix(sudo:session): session closed for user root Apr 29 15:43:16 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-b245c62d-6da2-4ec7-936d-c6cf4230bed5 tempest-CinderUnicodeTest-69529497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.588s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:43:16 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-b245c62d-6da2-4ec7-936d-c6cf4230bed5 tempest-CinderUnicodeTest-69529497 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:43:16 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-b245c62d-6da2-4ec7-936d-c6cf4230bed5 tempest-CinderUnicodeTest-69529497 None] Deleted volume successfully. Apr 29 15:43:16 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-b245c62d-6da2-4ec7-936d-c6cf4230bed5 tempest-CinderUnicodeTest-69529497 None] Lock "cinder-08ae1824-3876-4d7c-a63f-324c25593c19-delete_volume" released by "delete_volume" :: held 2.157s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:43:16 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-14f5bd78-e8b9-42dd-bae4-11acec64273f tempest-CinderUnicodeTest-69529497 None] Acquiring lock "cinder-ae5bb898-15e9-4d6f-883f-854d8cd5d99e-delete_volume" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:43:16 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-14f5bd78-e8b9-42dd-bae4-11acec64273f tempest-CinderUnicodeTest-69529497 None] Lock "cinder-ae5bb898-15e9-4d6f-883f-854d8cd5d99e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:43:16 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-14f5bd78-e8b9-42dd-bae4-11acec64273f tempest-CinderUnicodeTest-69529497 None] Acquiring lock "cinder-quobyte-ae5bb898-15e9-4d6f-883f-854d8cd5d99e" by "delete_volume" {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 15:43:16 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-14f5bd78-e8b9-42dd-bae4-11acec64273f tempest-CinderUnicodeTest-69529497 None] Lock "cinder-quobyte-ae5bb898-15e9-4d6f-883f-854d8cd5d99e" acquired by "delete_volume" :: waited 0.020s {{(pid=84448) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 15:43:16 devstack cinder-volume[84448]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d2c1479-06a5-40d9-9523-f7524de4b461]: (4, 'qcow2') {{(pid=84914) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 15:43:16 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-14f5bd78-e8b9-42dd-bae4-11acec64273f tempest-CinderUnicodeTest-69529497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ae5bb898-15e9-4d6f-883f-854d8cd5d99e {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:43:16 devstack sudo[112642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ae5bb898-15e9-4d6f-883f-854d8cd5d99e Apr 29 15:43:16 devstack sudo[112642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:43:16 devstack sudo[112642]: pam_unix(sudo:session): session closed for user root Apr 29 15:43:16 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-14f5bd78-e8b9-42dd-bae4-11acec64273f tempest-CinderUnicodeTest-69529497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ae5bb898-15e9-4d6f-883f-854d8cd5d99e" returned: 0 in 0.694s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:43:16 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-14f5bd78-e8b9-42dd-bae4-11acec64273f tempest-CinderUnicodeTest-69529497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ae5bb898-15e9-4d6f-883f-854d8cd5d99e {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:43:16 devstack sudo[112648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ae5bb898-15e9-4d6f-883f-854d8cd5d99e Apr 29 15:43:16 devstack sudo[112648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:43:17 devstack sudo[112648]: pam_unix(sudo:session): session closed for user root Apr 29 15:43:17 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-14f5bd78-e8b9-42dd-bae4-11acec64273f tempest-CinderUnicodeTest-69529497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3/volume-ae5bb898-15e9-4d6f-883f-854d8cd5d99e" returned: 0 in 0.596s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:43:17 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-14f5bd78-e8b9-42dd-bae4-11acec64273f tempest-CinderUnicodeTest-69529497 None] Lock "cinder-quobyte-ae5bb898-15e9-4d6f-883f-854d8cd5d99e" released by "delete_volume" :: held 1.329s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:43:17 devstack cinder-volume[84448]: DEBUG cinder.quota [None req-14f5bd78-e8b9-42dd-bae4-11acec64273f tempest-CinderUnicodeTest-69529497 None] Created reservations ['d6e7a96b-6fb5-401c-9c58-36b7bea57900', '1993d1bf-00e0-4bb5-8973-f8949bc3f7b5', '677a8473-49e7-43a6-b9c1-57e04b5f0849', '5e49c63b-dbac-4092-9d91-9115e292edf3'] {{(pid=84448) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 15:43:17 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-14f5bd78-e8b9-42dd-bae4-11acec64273f tempest-CinderUnicodeTest-69529497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:43:17 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-14f5bd78-e8b9-42dd-bae4-11acec64273f tempest-CinderUnicodeTest-69529497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:43:17 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-14f5bd78-e8b9-42dd-bae4-11acec64273f tempest-CinderUnicodeTest-69529497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:43:17 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-14f5bd78-e8b9-42dd-bae4-11acec64273f tempest-CinderUnicodeTest-69529497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:43:17 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-14f5bd78-e8b9-42dd-bae4-11acec64273f tempest-CinderUnicodeTest-69529497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:43:17 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-14f5bd78-e8b9-42dd-bae4-11acec64273f tempest-CinderUnicodeTest-69529497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:43:17 devstack sudo[112651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:43:17 devstack sudo[112651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:43:18 devstack sudo[112651]: pam_unix(sudo:session): session closed for user root Apr 29 15:43:18 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-14f5bd78-e8b9-42dd-bae4-11acec64273f tempest-CinderUnicodeTest-69529497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.609s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:43:18 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-14f5bd78-e8b9-42dd-bae4-11acec64273f tempest-CinderUnicodeTest-69529497 None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:43:18 devstack cinder-volume[84448]: INFO cinder.volume.manager [None req-14f5bd78-e8b9-42dd-bae4-11acec64273f tempest-CinderUnicodeTest-69529497 None] Deleted volume successfully. Apr 29 15:43:18 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:UPDATE=156,cinder:SELECT=102,cinder:INSERT=40,cinder:DELETE=11 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:43:18 devstack cinder-volume[84448]: DEBUG cinder.coordination [None req-14f5bd78-e8b9-42dd-bae4-11acec64273f tempest-CinderUnicodeTest-69529497 None] Lock "cinder-ae5bb898-15e9-4d6f-883f-854d8cd5d99e-delete_volume" released by "delete_volume" :: held 2.146s {{(pid=84448) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 15:43:22 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:SELECT=121,cinder:UPDATE=152,cinder:INSERT=36,cinder:DELETE=15 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 15:43:30 devstack cinder-volume[84448]: DEBUG oslo_service.periodic_task [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84448) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 15:43:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 15:43:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 15:43:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a': None} {{(pid=84448) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 15:43:30 devstack cinder-volume[84448]: DEBUG cinder.volume.drivers.quobyte [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef2edf86-99cd-47e9-841f-2a4c943fce7a'] {{(pid=84448) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 15:43:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.lockutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84448) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 15:43:30 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 15:43:30 devstack sudo[112659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3 Apr 29 15:43:30 devstack sudo[112659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 15:43:31 devstack sudo[112659]: pam_unix(sudo:session): session closed for user root Apr 29 15:43:31 devstack cinder-volume[84448]: DEBUG oslo_concurrency.processutils [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1995038d8335bcc65ed240f93b806ab3" returned: 0 in 0.586s {{(pid=84448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 15:43:31 devstack cinder-volume[84448]: DEBUG cinder.manager [None req-857b6fc8-4dbd-4c13-8845-9218238a78ed None None] Notifying Schedulers of capabilities ... {{(pid=84448) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 15:43:32 devstack cinder-volume[84448]: DEBUG dbcounter [-] [84448] Writing DB stats cinder:UPDATE=1 {{(pid=84448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}